Foundations Module 3
Software Development Program (SDP):
Signature Course Immersive Experience Reflection
Martin Radley - Adapted from material developed by Ray Bareiss, Ph.D
NOTE: for optimal viewing please view in slideshow mode.
Agenda
[5 minutes] Your Assignment [5 minutes] Requirements [10 minutes] Logistics [10 minutes] Help and Hints [60 minutes] Do Project [60 minutes] Reflection
--------------------------------------------
Previous Module
This Module
Sample reports Heuristic evaluations The signature pedagogy Did the project achieve its learning outcomes?
Reflection on Sample Reports
No title page. No names or date.
Issues should be listed in order of severity
Log of heuristic issues meets project requirements
Reflection on Sample Reports
Good title page. Includes names, date and university
Reflection on Sample Reports
Issues should be listed in order of severity
Log of heuristic issues meets project requirements
Reflection on Sample Reports
Numbering the issues is a good idea
Organizing the issues by scenario makes it easier for the customer to understand
Column titles are not accurate (Description should be Scenario and Relevant Heuristics should be Heuristics/Issue s)
Reflection on Sample Reports
Detailed issue description s
Numbering the issues is a good idea
Screen capture is better than text to describe issues
Issues should be listed in order of severity
Reflection on Sample Reports
Numberin g the issues is a good idea
Screen capture is better than text to describe issues
Detailed issue description Make sure s issue descriptions are informative and grammatically correct
Which heuristics associated with which description s?
Reflection on Sample Reports
Numberin g the issues is a good idea
Screen capture is better than text to describe issues
Informative issue descriptions. One issue per row.
Issues should be listed in order of severity, or possibly by severity by scenario
Reflection on Sample Reports
Is it important to review the description of each specific issue that is reported?
Make sure No. Takes up too much time to review all. Samples issue will suffice.
descriptions are informative and grammatically correct
Reflection on Sample Reports - Summary
Reports generally meet requirements
Most do the minimum to achieve the recommended report format Problem with providing templates to students Many do not consider what it means to present to your management team and the customer Implies formality and professionalism Might want to include summary information
Any show stoppers Summary defects
Some miss basic project requirements Team member or university names
Reflection on Heuristic Evaluations
How well do you think heuristic evaluations work?
Heuristic evaluations find about 50% of problems Novices only find about 29% Usability specialists find about 46% Usability specialists with application domain expertise find about 60% Misses about 20% of serious problems Produces up to 50% false positives, i.e., problems in principle that arent problems in reality.
Is this good or bad?
Reflection on Heuristic Evaluations
What are the issues with heuristic evaluation?
Its completely general, i.e., its not tailored specifically to the personas of the users targeted by the system. Non-experts may misunderstand the heuristics, and when they do, they tend to ignore them.
Reflection on Heuristic Evaluations
What are the heuristic evaluation advantages?
Relatively quick, easy, and low-cost. It can be done very early in the process -- before you have a working interface; even when you just have a screen or two.
Reflection on the Pedagogy Course Material
How did the material on the LMS support the teaching approach for this project?
For the Student:
1. 2. 3.
4.
Project begins with an email from the manager Project Requirements are provided Reading assignments were provided that must be completed before the project begins Hints and Help are provided
1.
For the Instructor:
2.
Sample Solution Feedback
Reflection - Did the Project Meet our Learning Outcomes?
Stated Project Outcomes:
As a result of completing this project attendees will be able to: 1. Organize and/or perform a usability analysis as an individual or as a member of a team 2. Apply iCarnegies signature learn-by-doing principles to their own teaching
Reflection on the Pedagogy
Having been through this mini-project, are you now better able to organize and/or perform a usability analysis
Individually As a member of a team?
Reflection on the Pedagogy
What signature course teaching principles did you experience?
How course material is connected to the pedagogy Role playing Manager Coach Teacher Assessing deliverables
Reflection on the Pedagogy Course Material
What course material was missing from the project?
Instructor material:
Instructors Guide Deliverable and Professional Behavior Assessments Rubrics Tests Solutions
Reflection on the Pedagogy Course Material
How would it affect your project experience if you did not come prepared (did not complete the reading assignments)?
Reflection on the Pedagogy Role Playing
Did you (the student) feel more like a student or an employee?
Student: Project was run in an academic environment Employee: Project was a realistic work simulation:
Project was given to you by your manager Your job was to please your manager and the customer, and not just get a good grade Your deliverable was assessed by your manager
Reflection on the Pedagogy Role Playing
Did the person leading this project act more like a Manager, Coach or Teacher?
Manager: Introduced project as a manager Provided feedback on deliverable as a manager Coach: Provided hints and guidance on specific project issues to watch out for Teacher: Introduced heuristic evaluations as a teacher Described strengths and weaknesses of heuristic evaluations as a teacher
Reflection on the Pedagogy Role Playing
How would the experience have been different if the manager/coach had been live (not videotaped)
Real-time answers to questions Real-time feedback on behavior Real-time hints and guidance on whether the student is on the right path in terms of: Planning/organizing work Getting work done Exhibiting professional behavior
Reflection on the Pedagogy Feedback on Deliverables
Students either completed the project, or they didnt
As at work, students evaluated on what they produced
Positive and Negative Feedback presented using positive styles
Comments used to help student recognize: What they got right What they can improve next time For example: What will a customer expect in a presentation?
Many of the lessons learned are general
Summary
Did the Project meet Stated Outcomes:
As a result of completing this project attendees will be able to: 1. Organize and/or perform a usability analysis as an individual or as a member of a team 2. Apply iCarnegies signature learn-by-doing principles to their own teaching
As students, did you feel engaged during the project? Did your engagement lead to your accomplishing the outcomes?
Did the project encourage active learning?
Thank You Very Much
