progress ux - research methods workshop - 11/2013
DESCRIPTION
TRANSCRIPT
!1
User Research and Usability Methods workshop
Jon-Eric Steinbomer, Director of Research Jessica Sears Steinbomer, Principal
| © 2013 Progress UX LLC!2
!
9-10 Research Methods!10-10:30 Recruiting Participants!coffee <br>!10:45-11:15 Study Plans & Moderator Guides!11:15-12:00 Moderate!!12:00-1:00 Lunch & Presenting Research
Our Agenda
| © 2013 Progress UX LLC
UX Research
!3
| © 2013 Progress UX LLC!4
| © 2013 Progress UX LLC!5
!
What people do!!
How people use!!
Small sample size - usually 8-12 people per study!....but great depth
UX Research
| © 2013 Progress UX LLC!6
• Test early - with prototypes whenever possible.!
• Evidence is more important than deliverables.!
• Iterate on the design during the research phase.!
• Collaboration with design & development.!
• Focus on behaviors rather opinions.
Key UX Research Principals
“Individuals and interactions over processes and tools” -Agile Manifesto
| © 2013 Progress UX LLC
Methods
!7
| © 2013 Progress UX LLC!8
!
Study Planning!Recruiting!Study Sessions!Analysis and Reporting!
Structure Common to All Methods
| © 2013 Progress UX LLC!9
!
• What are the goals?!• What are the research questions?!• Who are the users?!• Which context is appropriate?!• Which research method is
appropriate?!
Study Planning
| © 2013 Progress UX LLC!10
!
• Research Goals!• Research Questions!• Participants!• Method!• Measures!• Specific Tasks and Questions!
Study Plans Contain
| © 2013 Progress UX LLC!11
!
• Usability Lab!• Remote !• On Location (ethnography)
Contexts
| © 2013 Progress UX LLC!12
Usability Lab
Behind the glass Moderator communicates through microphone “voice of God”
| © 2013 Progress UX LLC!13
Silverback ($69.95)
Usability Lab Software
Morae ($1,995)
| © 2013 Progress UX LLC!14
!
• Participant Comfort!• Limit Distraction!• Just you and the participant!• Chat with observers/note-takers
Lab Best Practices
| © 2013 Progress UX LLC!15
Remote Research
Researchers
ParticipantObservers
Participant
Participant Participant
Participant
Participant
Participant
Participant
Participant
Observers
| © 2013 Progress UX LLC!16
Ethnographic “bonus”Participants are more comfortable as they speak to us using their own OS, browser, resolution, etc.
| © 2013 Progress UX LLC!17
Tools
| © 2013 Progress UX LLC
Remote Case Study
!18
| © 2013 Progress UX LLC!19
• Too many abandonsSweepstakes entry form
18
| © 2013 Progress UX LLC!20
Live Intercept
18
| © 2013 Progress UX LLC!2118
Recommendations sample• Top-down design
• Validation before human verify
• Better error feedback
| © 2013 Progress UX LLC!2218
Remote UX Research Best Practices
• Mind the time zones.!• One moderator per session.!• If time allows, start broad, then narrow down to your
subject (website, prototype, product).!• Have a backup plan for the screen-share. !• Test the screen share before the session.
| © 2013 Progress UX LLC!2318
Ethnography - Best Practices!
• Limit the number of interviewers - 2 people if possible!
• Be nimble!• Mind the background
noise!• Note the environmental
factors!• Take lots of pictures and
video
| © 2013 Progress UX LLC
Mobile Research
!24
| © 2013 Progress UX LLC!2518
Mobile app/Hardware Research
| © 2013 Progress UX LLC
Prototypes
!26
| © 2013 Progress UX LLC!27
Low-Fidelity Paper-based prototype
Mid-fidelity Balsamiq prototype
Full-Fidelity “clickable” prototype
Gesture prototype testing (Kinect)
| © 2013 Progress UX LLC!2818
Prototype Testing Best Practices
• Flexibility when moderating is key!• Prototype should be easily modified!• Comfort with things breaking !• Make participant aware it’s a
prototype!
| © 2013 Progress UX LLC
Moderating
!29
| © 2013 Progress UX LLC!3018
Best Practices
• Participant comfort!• It’s not about you (empathy)!• Place your participant as the expert!• Use their words!• Emphasize there is no right or wrong!• Don’t assume - ask!
| © 2013 Progress UX LLC!3118
Best Practices, cont.
• Avoid asking leading questions or “questioning with the target”!
• Resist rescuing !• Let the participant lead as much as
possible!• Introduce the goals and structure of
the session up-front
| © 2013 Progress UX LLC!3218
Moderation Issues
• Taking notes while moderating - takes practice!• Time management!• Talkers - interrupting gracefully!• Non-Talkers!• “Bad” Participants!
!
| © 2013 Progress UX LLC
Recruiting Participants
!33
| © 2013 Progress UX LLC!34
• Personas
• Marketing data
• Call center data
• Sales staff
Identify who you want to speak with
| © 2013 Progress UX LLC!35
Forums
Social media
Ethnio - Live Intercept
Cast the net
| © 2013 Progress UX LLC!36
Recruiting - Ethnio Live Intercept
| © 2013 Progress UX LLC!37
• Screening SurveyCollect the data
| © 2013 Progress UX LLC!38
• Organization TipsScheduling
| © 2013 Progress UX LLC!39
• Initial Contact
• Scheduling specifics
• Confirm
• Double Check
Make the Call
| © 2013 Progress UX LLC!40
• No-shows- Oh No!
• Recruit reserve participants
• Make time in the schedule for reserves
• Mr. Wrong
Bloopers and Out-takes
| © 2013 Progress UX LLC
Study Plans and Moderator Guides
!41
| © 2013 Progress UX LLC!42
Your turn!