Quantifying UXThe lab versus the real world

How did I end up here?

2003-2010 Tilburg University

Design of Business Communication

2000-2010Design, communication, research, and consulting

2009-now

cc adactio

!"#$%&#"'$!()%#*+,+!-

‘Plus-minus method for text evaluation’

+ -

</commercial>

eighties

Observing users.

Pen & paper

Stopwatch.

Nothing changed?

How do we observe behavior?

1995 Web ‘analytics’

2005 Google Analytics

2007 Clicktale, CrazyEgg, Kampyle

2009 Remote Usability Year

2009 UserTesting

2009 FeedbackArmy

2009 UserZoom

2009 OpenHallway

2009 Userfly

2009 OptimalSort

2009 ChalkMark

2009 Treejack

2009 Userlytics

2009 Loop11

2009 Websort

2009 Ethnio

2009 TrymyUI

2009 Usabilla

More?

Great overview: http://remoteusability.com

Quantitative

QualitativeC

onc

rete

Co

nceptual

Quantitative

QualitativeC

onc

rete

Co

nceptual

Google Analytics

Clicktale

CrazyEgg

UserTesting

TryMyUI

Websort

Treejack

Chalkmark

Usabilla

Loop11

Userlytics

Userfly

OpenHallway

Kampyle

Optimalsort

Source: Nate Bolt, Bolt | Peters / Ethnio - http://boltpeters.com

Source: Nate Bolt, Bolt | Peters / Ethnio - http://boltpeters.com

Behavior vs Attitude

Behavior vs Attitude

Behavior vs Attitude

Source: the narrow minded usability consultant.

efficiencyeffectiveness

Usability

efficiencyeffectiveness

Usability

satisfaction

efficiencyeffectiveness satisfaction

behavior = objective

efficiencyeffectiveness satisfaction

behavior = objective attitude = subjective

Valuable Credible

DesirableFindable Accessible

Usable

User Experience

Valuable Credible

DesirableFindable Accessible

Usable

User Experience

‘self reported data’ hoax

Some background: http://www.creative-wisdom.com/teaching/WBI/memory.shtml

Soft data

Hard data

Hardcore

Behavior:Conversion rates, task performance, time on

task, bounce rate, error rates, click-through rate, shares, bookmarks, etc

Shell

Attitude:Satisfaction, ratings, credibility, sentiment

analysis, feedback, trust, like / dislike, etc

Soft

So, what’s next?

Booming.

Build your toolbox.

Mobile?

The most touch friendly survey!"#$%&#"'$!()%#*+,+!-

Commercial break

Data.

Data.

Data.

Dashboards

Paul VeugenUsabilla.com

Thanks for your attention!

E-mail: paul@usabilla.comTwitter: @pveugenWebsite: usabilla.com

!"#$%&#"'$!()%#*+,+!-