optimal ia - pro tips for remote user testing - san diego 2012

55
Optimal IA - Pro Tips for REMOTE USER TESTING Andrew Mayfield @andrewfantastic Optimal Workshop @optimalworkshop with by Friday, 6 April 12

Upload: optimalworkshop

Post on 12-May-2015

445 views

Category:

Design


1 download

DESCRIPTION

Optimal Workshop was invited to introduce our tools and provide some pro tips for Remote User Testing at the UX Speakeasy in early 2012.

TRANSCRIPT

Page 1: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Optimal IA - Pro Tips for

REMOTE USER TESTING

Andrew Mayfield@andrewfantastic

Optimal Workshop@optimalworkshopwith

by

Friday, 6 April 12

Page 2: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

QUESTIONSWELCOME

Friday, 6 April 12

Page 3: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

SAN DIEGO

NEW ZEALAND

SWITZERLAND

Friday, 6 April 12

Page 4: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Friday, 6 April 12

Page 5: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Friday, 6 April 12

Page 6: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

WHAT THEY DO

Friday, 6 April 12

Page 7: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

WHAT YOU GET

Friday, 6 April 12

Page 8: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Friday, 6 April 12

Page 9: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Friday, 6 April 12

Page 10: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

PARTICIPANTCENTRICANALYSIS

Friday, 6 April 12

Page 11: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

tip

MODERATE PILOTSwith

or

Friday, 6 April 12

Page 12: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Friday, 6 April 12

Page 13: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Friday, 6 April 12

Page 14: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Friday, 6 April 12

Page 15: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

SOONFriday, 6 April 12

Page 16: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

QUALvs

QUANTFriday, 6 April 12

Page 17: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

❤QUAL❤

QUANT

tip

Friday, 6 April 12

Page 18: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

tip

~40 CARDS

Friday, 6 April 12

Page 19: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

number of cards

part

icip

ant

com

plet

ion

rate

(%

)

0"

10"

20"

30"

40"

50"

60"

70"

80"

90"

100"

20" 30" 40" 50" 60" 70" 80" 90" 100" 110" 120"

Friday, 6 April 12

Page 20: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Friday, 6 April 12

Page 21: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Friday, 6 April 12

Page 22: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

73%COMPLETION RATE

OptimalSort

Friday, 6 April 12

Page 23: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

65% anon75% email80% other

COMPLETION RATE

OptimalSort

Friday, 6 April 12

Page 24: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

has_passwordOptimalSort

Friday, 6 April 12

Page 25: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

REQUIREall groups namedall cards sorted

OptimalSort

Friday, 6 April 12

Page 26: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

tip

SCREENwith

Friday, 6 April 12

Page 27: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

tip

INCENT

Friday, 6 April 12

Page 28: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

tip

FOCUS

Friday, 6 April 12

Page 29: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

tip

CLOSEDCARD SORTING?

Friday, 6 April 12

Page 30: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Friday, 6 April 12

Page 31: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Friday, 6 April 12

Page 32: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

tip

SPREADSHEETSare still ok with me

Friday, 6 April 12

Page 33: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Friday, 6 April 12

Page 34: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

tip

BENCHMARK!

Friday, 6 April 12

Page 35: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

tip

Find About Us

Friday, 6 April 12

Page 36: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Treejack

VisualisingTree TestResults

The Pietree

The task“Find the lowest cost home broadband solution.”

Went down the right path

Went down the wrong path

Went back up the tree

Chose this as the answer

Skipped question

Games

Account toolsMoving house

Upgrade my plan

Home

Cell Phones & Plans

Handsets

Monthly plans

Pay as you go plans

Internet on your cell phone

Accessories

Home PhoneHome phone plans

Add-ons

Internet

Home internet plans

3G Broadband

3G Broadband plans

Coverage map

Premium Services

NewsMusic

My Account

Help & Support

Frequently asked questions

Knowledge base

Moving house

Contact us

Most people who got here went back up the tree

Of the 54 people who got here, 48 correctly chose this answer

Of the 16 people who got here, 15 incorrectly chose this answer

65 people (46%) went the wrong way on first click

Nobody went here. Yay!

Friday, 6 April 12

Page 37: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

tip

EVIL ATTRACTORS

Friday, 6 April 12

Page 38: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Friday, 6 April 12

Page 39: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

tip

ITERATE

Friday, 6 April 12

Page 40: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

tip

CONSERVE THY

PARTICIPANTSFriday, 6 April 12

Page 41: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

tip

~9 TASKS

Friday, 6 April 12

Page 42: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Friday, 6 April 12

Page 43: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Friday, 6 April 12

Page 44: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Friday, 6 April 12

Page 45: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

this slide was stolen from Nate Bolt

Friday, 6 April 12

Page 46: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

tip

SEGMENT

Friday, 6 April 12

Page 47: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

CARDSORT

TREETEST

CLICKTEST

OPEN

CARDSORT

CLOSED

CLICKTEST

UXPROCESS!"w "#r $""%& r"%% '( )

TreejackOptimalSortOptimalSortChalkmark Chalkmark

Friday, 6 April 12

Page 48: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

BUY-INFriday, 6 April 12

Page 49: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

itsourresear.ch

20% offMKFLYERS

Friday, 6 April 12

Page 50: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

THANK YOU,YOU’RE AWESOME.

Friday, 6 April 12

Page 51: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Quantifying the effectiveness of an IA is

HARD WORK

PROBLEM

Friday, 6 April 12

Page 52: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Peter Morville’sUX HONEYCOMB

useful&

valuable&

credible&

usable&

findable&

desirable&

accessible&

Friday, 6 April 12

Page 53: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

useful&

valuable&

credible&

usable&

findable&

desirable&

accessible&

Peter Morville’sUX HONEYCOMB

Friday, 6 April 12

Page 54: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Organisa(on*

Labelling*

Search*

Naviga(on*

CONTENT

Friday, 6 April 12

Page 55: Optimal IA - Pro tips for Remote User Testing - San Diego 2012

Organisa(on*

Labelling*

Search*

Naviga(on*

CONTENT

Friday, 6 April 12