Transcript
Page 1: Rapid turnaround usability testing: not just a pipe dream

RAPID-TURNAROUNDUSABILITY TESTING:

IA Summit 2010Holly Phillips & Kyle Soucy

NOT JUSTA PIPE DREAM

Page 2: Rapid turnaround usability testing: not just a pipe dream

Over the last two years, we’veconducted 88 usability teststogether while doing rapiddesign iterations and…

we’ve never met before now!

Page 3: Rapid turnaround usability testing: not just a pipe dream

Q. How do you getmore customer inputinto your designswithout the time andexpense oftraditional usabilitytesting?

Page 4: Rapid turnaround usability testing: not just a pipe dream

A. Rapid-turnaroundUsability Testing

Page 5: Rapid turnaround usability testing: not just a pipe dream

RITE Usability Testing

Test Test TestRevise

Prototyp

e Revise

Prototyp

e

Page 6: Rapid turnaround usability testing: not just a pipe dream

How do you makedesign decisionsbased on only testing1 person?

Page 7: Rapid turnaround usability testing: not just a pipe dream

Process Overview

Define Scope Define Tasks Prototype

Conduct Testing

Debrief

Report/Present Findings

Revise Prototype

2 week iteration

Page 8: Rapid turnaround usability testing: not just a pipe dream

Key to Success…

Attendance of productdecision makers during testing!

Page 9: Rapid turnaround usability testing: not just a pipe dream

A different way to think aboutusability testing…

Page 10: Rapid turnaround usability testing: not just a pipe dream

Where’s the “rapid” in the process?

Define Scope Define Tasks Prototype

3 DAYS!

Conduct Testing

Debrief

Report/Present Findings

Revise Prototype

2 week iteration

Page 11: Rapid turnaround usability testing: not just a pipe dream

Benefits

• Team stays on the same page -- no working ina vacuum!

• Rapid feedback from end users

• Produces rapid findings and recommendations

• Team consensus on product changes

• Saves time and money

• Ingrains usability testing into the design anddevelopment process

Page 12: Rapid turnaround usability testing: not just a pipe dream

Interview-based Tasks

Page 13: Rapid turnaround usability testing: not just a pipe dream

Script

Page 14: Rapid turnaround usability testing: not just a pipe dream

“Improv Testing” Process

1. Interview participant about how they use theproduct.

2. Use the answers given in the interview tocreate tasks on the fly.

When in doubt just ask, “what was the last thing you didwhen you used this product? Can you show me?”

Page 15: Rapid turnaround usability testing: not just a pipe dream

Benefits

• Learn users true intent

• Gain the insight and feedback that truly matters

• No need to conduct an in-depth task analysis

• The unexpected -- enjoy the ride toenlightenment!

Page 16: Rapid turnaround usability testing: not just a pipe dream

Observer Debriefing

Page 17: Rapid turnaround usability testing: not just a pipe dream

Why debrief?

photo by agit8

Page 18: Rapid turnaround usability testing: not just a pipe dream
Page 19: Rapid turnaround usability testing: not just a pipe dream

How to debrief

• Do nothing• Informal discussion• Affinity diagramming.

Page 20: Rapid turnaround usability testing: not just a pipe dream

• Structured• Quote/Observation• Implication:  H2, W4, Wif• Round-robin or lead + additions• After every 3-6 respondents.

Page 21: Rapid turnaround usability testing: not just a pipe dream

GeneralizationsJumping to solutionsI'm right you're wrong.

photo by subboard.com

Benefits

Page 22: Rapid turnaround usability testing: not just a pipe dream

GeneralizationsJumping to solutionsI'm right you're wrong

photo by subboard.com

Different perspectiveootb thinkingImmediate "transcript" and importance.

Benefits

Page 23: Rapid turnaround usability testing: not just a pipe dream

http://www.apw.cnyric.org/teacherpage3.cfm?teacher=438

Page 24: Rapid turnaround usability testing: not just a pipe dream

Report Findings

• fast-turnaround• no surprises• recommendations, not just problem• speeds up start of next round of designs.

Page 25: Rapid turnaround usability testing: not just a pipe dream

Gotchas!

Page 26: Rapid turnaround usability testing: not just a pipe dream

• Not getting the team involved

• Not finding a moderator comfortable withinterview-based tasks

• Not sticking to the structure in the debrief.

Gotchas!

Page 27: Rapid turnaround usability testing: not just a pipe dream

photo by nike

Go for it.

Page 28: Rapid turnaround usability testing: not just a pipe dream

Thank You!


Top Related