uxprobe: measuring the user experience of apps on large scale

Measuring UX of apps on large scale

Jan Moons

Co-founder UXprobe

E-mail: jan@uxpro.beTwitter: @moonsjan / @uxprobeLinkedIn: be.linkedin.com/in/janmoons

age of apps

“easy” to build and distribute apps

“not worth using” — June 5, 2013

★☆☆☆☆

“awesome” — Sept 16, 2014

★★★★★

UCD toolbox with tools and methods

design

UCD process

Research Design Evaluation Build

agile developmentlean business IDEA

build

MVP

measure

DATA

learn

lean startupfeedback loop

IDEA

build

MVP

measure

DATA

learn

enough users?right users?

measuringuser experienceon large scale

web analytics

standard metrics

• Page views• Time on page• Bounce rates• Exits• Etc.

user flow

Why do users drop off here?

conversion goals

too high-level to make design decisions

successful completion

Drop off end of

task OK

abandoned with error

Tweet too long error

abandoned because…

What about the rest?

web analytics is about what not why

contextualizeusers’ behaviors

“Please add URL shortener”

“It doesn’t work”

“I have no clue how much characters I can type”

★☆☆☆☆

★★☆☆☆

★★★☆☆

“how do I attach a picture, like from the

camera?”

in-app feedback& micro-surveys

import / export data

track survey pages and events

satisfaction servicesare hard to integrate

UXprobe measures user experience on large scale

UX metrics• Feedback & satisfaction

• Task success• Time on task• Errors

• Feature usage

scaled up UX metrics

drill down to details

improve functionality

simplify and improve

feedback &micro-surveys

not just a rating

behavior and satisfaction

Tweet too long

error

Actionable

feedback

UX analytics complementusability testing & web analytics

make users happybuild successful apps

uxpro.beinfo@uxpro.be@uxprobe

vote UXprobe:www.beloftevollestarte

r.be