![Page 1: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/1.jpg)
TRENDS
www.usableinterface.com
Kyle Soucy, Founding Principal follow me: UsableInterface
MaineUXJuly 22, 2009
in
Usability
Testing>
![Page 2: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/2.jpg)
Think Aloud Techniques
![Page 3: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/3.jpg)
Think Aloud Techniques
Concurrent (CTA) Retrospective (RTA)
Vs.
![Page 4: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/4.jpg)
![Page 5: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/5.jpg)
Variation of RTA...
Show the participant their video after they’re done testing.
![Page 6: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/6.jpg)
Usability “Labs”
![Page 7: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/7.jpg)
Image source: facit digital
Source: Kent State University
Vs.
![Page 8: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/8.jpg)
Ideal “Lab-Less” Set Up
![Page 9: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/9.jpg)
Vs.
Remote vs. In-person Testing
![Page 10: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/10.jpg)
Remote Testing Pros & Cons
Participants stay in their native environment.
Accessible to a larger & more diverse pool of participants.
Recruiting is easier. Less no shows & easier last minute replacements.
Opportunity to gather ethnographic data.
Cost & time savings. No travel & lab rental fees.
Easier for observers to “attend” a session.
Risk of compromising data because the participant is using a foreign PC is removed.
Pros:Can’t see the user’s facial expressions.
Can’t see if the user is using peripheral devices.
Dependent on an Internet connection.
Can only recruit participants with a high-speed Internet connection.
Cons:
![Page 11: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/11.jpg)
Remote Testing Paper Prototypes
(Yes, it is possible!)
![Page 12: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/12.jpg)
Remote Testing Tools
• UserVue
• GoToMeeting
• LiveLook
• Adobe Connect
• Silverback
• Many more...
![Page 13: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/13.jpg)
Remote Testing Tips
• Disable IM programs, Outlook meeting reminders, or anything else that may be distracting
• Use a phone recording controller.
• Use as few tools as possible
• Back up, back up, back up!
![Page 14: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/14.jpg)
Automated Testing (Unmoderated Remote Testing)
![Page 15: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/15.jpg)
![Page 16: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/16.jpg)
What You Can Learn
• Analytic data
• Task completion rates
• Number of clicks/clickstream
• Time on task
• Satisfaction ratings
• In-context feedback
![Page 17: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/17.jpg)
When to Conduct Automated Testing?
Best used to compliment your qualitative research.
Not a replacement for moderated testing or research.
![Page 18: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/18.jpg)
Automated Testing Tools
• Keynote WebEffective $$$
• UserZoom $$
• Treejack & Chalkmark $
• Loop11 (private beta)
• UserTesting.com $
![Page 19: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/19.jpg)
Treejack
![Page 20: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/20.jpg)
![Page 21: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/21.jpg)
Chalkmark
![Page 22: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/22.jpg)
Chalkmark Results
![Page 23: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/23.jpg)
Loop11 Results
![Page 24: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/24.jpg)
Web Analytic Video Tools
• BlueFly
• ClickTale
• TeaLeaf
![Page 25: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/25.jpg)
Pre-defined Tasks vs.
Interview-based Tasks
![Page 26: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/26.jpg)
Improv Testing Process
1. Interview participant about how they use the product.
2. Use the answers given in the interview to create tasks on the fly.
When in doubt just ask, “what was the last thing you did when you used this product? Can you show me?”
![Page 27: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/27.jpg)
![Page 28: Trends In Usability Testing - IA Summit 2010 & Maine IxDA](https://reader036.vdocuments.us/reader036/viewer/2022070304/54c732514a79590c6e8b46a1/html5/thumbnails/28.jpg)
Questions?
www.usableinterface.com