opticon 2015-10 secrets to building an amazing mobile testing roadmap
TRANSCRIPT
#opticon2015
10 secrets to building an amazing mobile testing roadmap Esben Rasmussen Full time A/B test on iOS, Sr. iOS dev
Jeppe Dyrby Full time A/B test on web, Sr. Frontend
@bobslaede @esbenr42
history
Team lead
Backend dev
Frontend dev Mobile dev
Intern
Biz-dev manager Product owner
the tenzing team
1. put together a great team
Esben Jeppe
Tenzing Norgay
2. come up with a great team name
3. motivate your team
NPS & Finances
/u/tylersburden
the test public persona
variation #1 as a male variation #2 as a female
the test public persona
variation #1 as a dialog in the end
variation #2 as an inline
message during product
selection
4. define your testing roadmap
public persona
simplify category picker
change headings
add graph
create button
on receipt
try wizard flow free samples
“how to” create good ad
4. define your testing roadmap
public persona
simplify category picker
change headings
add graph
create button
on receipt
try wizard flow free samples
“how to” create good ad
4. define your testing roadmap
Effort
UX
/ N
PS
4. define your testing roadmap
5. have a test strategy
positions sizes colors
wording graphics
features flows
5. have a test strategy
6. visualize your workflow Theme 1: Sell Your
Item
Theme 2: Value
Proposition
Hypothesis: By showing a message
to the user when inserting an ad, she
will buy one of our products
Method: Show urgency message with
friendly persona, when the bundle
section is in view
Measure: E-commerce tracking, and
optimizely events for selection of
bundles when submitting.
a hypothesis for the board
7. implement your test
8. measure the outcome
Bermuda triangle of tracking
9. learn
public persona
this was a bit too much
this little guy was all that was
needed
public persona
female dominated category: children’s clothes male dominated category: cars
male female
public persona
got implemented
everybody likes this fellow guys selling cars did not like this lady
10. make the decision clean + implement
redefine and rerun
didn’t work, move on
buttons with prices upsell buttons
original runner up winner
got implemented
11. turn it up to eleven
#opticon2015
Thank you!
Esben Rasmussen Full time A/B test on iOS, Sr. iOS dev
Jeppe Dyrby Full time A/B test on web, Sr. Frontend
@bobslaede @esbenr42