Measuring UX of apps on large scale
Jan Moons
Co-founder UXprobe
E-mail: [email protected]: @moonsjan / @uxprobeLinkedIn: be.linkedin.com/in/janmoons
age of apps
“easy” to build and distribute apps
“not worth using” — June 5, 2013
★☆☆☆☆
“awesome” — Sept 16, 2014
★★★★★
UCD toolbox with tools and methods
design
UCD process
Research Design Evaluation Build
agile developmentlean business IDEA
build
MVP
measure
DATA
learn
lean startupfeedback loop
IDEA
build
MVP
measure
DATA
learn
enough users?right users?
measuringuser experienceon large scale
web analytics
standard metrics
• Page views• Time on page• Bounce rates• Exits• Etc.
user flow
Why do users drop off here?
conversion goals
too high-level to make design decisions
successful completion
Drop off end of
task OK
abandoned with error
Tweet too long error
abandoned because…
What about the rest?
web analytics is about what not why
contextualizeusers’ behaviors
“Please add URL shortener”
“It doesn’t work”
“I have no clue how much characters I can type”
★☆☆☆☆
★★☆☆☆
★★★☆☆
“how do I attach a picture, like from the
camera?”
in-app feedback& micro-surveys
import / export data
track survey pages and events
satisfaction servicesare hard to integrate
UXprobe measures user experience on large scale
UX metrics• Feedback & satisfaction
• Task success• Time on task• Errors
• Feature usage
scaled up UX metrics
drill down to details
improve functionality
simplify and improve
feedback µ-surveys
not just a rating
behavior and satisfaction
Tweet too long
error
Actionable
feedback
UX analytics complementusability testing & web analytics
make users happybuild successful apps
[email protected]@uxprobe
vote UXprobe:www.beloftevollestarte
r.be