heuristic evaluation
DESCRIPTION
Heuristic Evaluation. Evaluating with experts. Discount Evaluation Techniques. Basis: Observing users can be time-consuming and expensive Try to predict usability rather than observing it directly Conserve resources (quick & low cost). Approach - inspections. Expert reviewers used - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/1.jpg)
Heuristic Evaluation
Evaluating with experts
![Page 2: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/2.jpg)
Discount Evaluation Techniques Basis:
Observing users can be time-consuming and expensive
Try to predict usability rather than observing it directly
Conserve resources (quick & low cost)
![Page 3: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/3.jpg)
Approach - inspections
Expert reviewers usedHCI experts interact with system and
try to find potential problems and give prescriptive feedback
Best if• Haven’t used earlier prototype• Familiar with domain or task• Understand user perspectives
![Page 4: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/4.jpg)
Discount Evaluation Methods
1. Scenarios
2. Heuristic Evaluation
3. Cognitive Walkthrough• Separate presentation
![Page 5: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/5.jpg)
Heuristic Evaluation
Developed by Jakob Nielsen
Several expert usability evaluators assess system based on simple and general heuristics (principles or rules of thumb)
(Web site: www.useit.com)
![Page 6: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/6.jpg)
Heuristic Evaluation
Mainly qualitative use with experts predictive
![Page 7: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/7.jpg)
Procedure
1. Gather inputs
2. Evaluate system
3. Debriefing and collection
4. Severity rating
![Page 8: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/8.jpg)
1: Gather Inputs
Who are evaluators?Need to learn about domain, its
practices
Get the prototype to be studiedMay vary from mock-ups and
storyboards to a working system
![Page 9: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/9.jpg)
How many experts?
Nielsen found thatabout 5 evaluations found 75% of the problems
Above that you get more, but at decreasing efficiency
![Page 10: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/10.jpg)
2: Evaluate System
Reviewers evaluate system based on high-level heuristics.
Where to get heuristics?http://www.useit.com/papers/heuristic/ http://www.asktog.com/basics/firstPrinciples.html
![Page 11: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/11.jpg)
Heuristics
use simple and natural dialog
speak user’s language
minimize memory load
be consistent provide feedback
provide clearly marked exits
provide shortcuts provide good error
messages prevent errors
![Page 12: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/12.jpg)
Neilsen’s Heuristics
visibility of system status
aesthetic and minimalist design
user control and freedom
consistency and standards
error prevention
recognition rather than recall
flexibility and efficiency of use
recognition, diagnosis and recovery from errors
help and documentation
match between system and real world
![Page 13: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/13.jpg)
Groupware heuristics
Provide the means for intentional and appropriate verbal communication
Provide the means for intentional and appropriate gestural communication
Provide consequential communication of an individual’s embodiment
Provide consequential communication of shared artifacts (i.e. artifact feedthrough)
Provide Protection Manage the transitions between tightly and loosely-coupled
collaboration Support people with the coordination of their actions Facilitate finding collaborators and establishing contact
Baker, Greenberg, and Gutwin, CSCW 2002
![Page 14: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/14.jpg)
Ambient heuristics
Useful and relevant information “Peripherality” of display Match between design of ambient display
and environments Sufficient information design Consistent and intuitive mapping Easy transition to more in-depth information Visibility of state Aesthetic and Pleasing Design
Mankoff, et al, CHI 2003
![Page 15: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/15.jpg)
Process
Perform two or more passes through system inspectingFlow from screen to screenEach screen
Evaluate against heuristics Find “problems”
Subjective (if you think it is, it is)Don’t dwell on whether it is or isn’t
![Page 16: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/16.jpg)
3: Debriefing
Organize all problems found by different reviewersAt this point, decide what are and
aren’t problemsGroup, structureDocument and record them
![Page 17: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/17.jpg)
4: Severity Rating
Based on frequency impact persistence market impact
Rating scale 0: not a problem 1: cosmetic issue, only fixed if extra time 2: minor usability problem, low priority 3: major usability problem, high priority 4: usability catastrophe, must be fixed
![Page 18: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/18.jpg)
Advantages
Few ethical issues to consider Inexpensive, quick
Getting someone practiced in method and knowledgeable of domain is valuable
![Page 19: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/19.jpg)
Challenges
Very subjective assessment of problemsDepends of expertise of reviewers
Why are these the right heuristics?Others have been suggested
How to determine what is a true usability problemSome recent papers suggest that many
identified “problems” really aren’t
![Page 20: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/20.jpg)
Let’s practice: PAL
![Page 21: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/21.jpg)
Heuristics
use simple and natural dialog
speak user’s language
minimize memory load
be consistent provide feedback
provide clearly marked exits
provide shortcuts provide good error
messages prevent errors
![Page 22: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/22.jpg)
Your turn:
Internet radio player
Use Nielsen’s heuristics (p 408) List all problems In a group, summarize and rate We’ll talk about the most serious
![Page 23: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/23.jpg)
Neilsen’s Heuristics
visibility of system status
aesthetic and minimalist design
user control and freedom
consistency and standards
error prevention
recognition rather than recall
flexibility and efficiency of use
recognition, diagnosis and recovery from errors
help and documentation
match between system and real world
![Page 24: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/24.jpg)
Next time
Heuristic evaluation of your own prototypes
Bring to classYour materials – sketches,
storyboards, working prototype, etc.Set of heuristics you want them to
use, print them out
![Page 25: Heuristic Evaluation](https://reader036.vdocuments.us/reader036/viewer/2022081519/56812ab0550346895d8e754c/html5/thumbnails/25.jpg)
Next time
Designate one person to explain prototype, answer questions to other group
Evaluate: group# + 1 (and 5 will evaluation for group 1)
Collect, organize and rate severity of problems, include in your part 4 writeup.