![Page 1: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/1.jpg)
A Crash Course in A/B Testing on Mobile Websites
#optimizemobile | 20 November, 2014
Friday, November 22, 13
![Page 2: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/2.jpg)
A Crash Course in A/B Testing on Mobile Websites
#optimizemobile
#optimizemobile
Friday, November 22, 13
![Page 3: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/3.jpg)
EXCLUSIVE WEBINAR GIVEAWAYWin a free signed copy of A/B Testing!
#optimizemobile
How to EnterTweet what you’ve learned today, and tag it with#optimizemobile
Friday, November 22, 13
![Page 4: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/4.jpg)
Agenda1. How the right mobile strategy can
accelerate your marketing ROI
2. A/B test ideas for mobile web design principles
3. How to use mobile A/B testing to drive conversions through the roof
4. Results from real mobile A/B tests
5. Q&A with Ben and Khattaab
Friday, November 22, 13
![Page 5: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/5.jpg)
How the right mobile strategy can accelerate your marketing ROI
Friday, November 22, 13
![Page 6: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/6.jpg)
#optimizemobile
Friday, November 22, 13
![Page 7: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/7.jpg)
What does it mean to be mobile?
•mobile website?•mobile app?•both?
#optimizemobile
Friday, November 22, 13
![Page 8: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/8.jpg)
Mobile websites matter. What’s the next step?
#optimizemobile
Friday, November 22, 13
![Page 9: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/9.jpg)
Deliver the mobile web experience that your users deserve.
Build Buy or
#optimizemobile
Friday, November 22, 13
![Page 10: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/10.jpg)
Separate mobile (and tablet) sitesYour visitor is redirected to the right version of your website, based on what device they’re using.
www.website.com
t.website.com
m.website.com
#optimizemobile
Friday, November 22, 13
![Page 11: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/11.jpg)
Responsive web design
Always at www.website.com
Your website automatically adapts its content and layout to fit your visitor’s screen size or device.
#optimizemobile
Friday, November 22, 13
![Page 12: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/12.jpg)
What content should your mobile website have? We have some (test) ideas...
#optimizemobile
Friday, November 22, 13
![Page 13: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/13.jpg)
Shop Search About Support Contact Q&A Links Gallery
Mobile users want to complete tasks and find information.
#optimizemobile
lhw.com
Friday, November 22, 13
![Page 14: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/14.jpg)
Device-Specific Presentation(not device-specific content)
#optimizemobile
youtube.com m.youtube.com
Friday, November 22, 13
![Page 15: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/15.jpg)
How do you define your mobile website goals?
#optimizemobile
Friday, November 22, 13
![Page 16: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/16.jpg)
Checkout Flows
Test | Exit routes, process flow, security messaging
Goal | More purchases or greater average order values
#optimizemobile
“Begin Checkout”bose.com
“Secure Checkout”ctshirts.com
Friday, November 22, 13
![Page 17: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/17.jpg)
Store Locators
Main Menulululemon.com
Top Navigationperfumania.com
Goal | Drive in-store purchases#optimizemobile
Friday, November 22, 13
![Page 18: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/18.jpg)
Layouts for Ad and Content Engagement
Fixed Banner Adm.huffpost.com
Banner Adwired.com
#optimizemobile
Friday, November 22, 13
![Page 19: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/19.jpg)
Cross-Channel Attribution
Image source: Google#optimizemobile
Friday, November 22, 13
![Page 20: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/20.jpg)
A/B test ideas for mobile web design principles
Friday, November 22, 13
![Page 21: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/21.jpg)
Is your mobile website fast to load and fast to respond to gestures?
#optimizemobile
Friday, November 22, 13
![Page 22: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/22.jpg)
Hitting the Mobile Navigation Sweet Spot
#optimizemobile
Friday, November 22, 13
![Page 23: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/23.jpg)
Test | Breadcrumb and CTA placement, zoom activation, collapsed or exposed detail
Goal | Drive engagement with content that compels CTA conversion
#optimizemobile
Above the Foldm.rei.com
Below the Foldm.rei.com
Friday, November 22, 13
![Page 24: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/24.jpg)
What gets more page views?•Buttons•Back button
What gets more clicks?•Sticky button•Above the fold
#optimizemobile
ideeli.comgarmin.com
Friday, November 22, 13
![Page 25: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/25.jpg)
Image source: ClickTale
Users scroll more on touch screens.
#optimizemobile
Friday, November 22, 13
![Page 26: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/26.jpg)
What compels you to scroll?•Lists•Grids•Text-heavy
blocks•Images
#optimizemobile
huffingtonpost.comnytimes.com
Friday, November 22, 13
![Page 27: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/27.jpg)
#optimizemobile
Friday, November 22, 13
![Page 28: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/28.jpg)
Test | Search functionality
Goal | Inform search prominence
#optimizemobile
bonobos.com
Friday, November 22, 13
![Page 29: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/29.jpg)
What leads to more searches?•Auto-complete•Form fields•Position on the
page
#optimizemobile
christies.com lhw.com
Friday, November 22, 13
![Page 30: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/30.jpg)
Simplification of Elements
#optimizemobile
youtube.com m.youtube.com
Friday, November 22, 13
![Page 31: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/31.jpg)
m.rei.com m.stubhub.com
Test | Simplify category page elements like filtering and sorting
Goal | Identify best presentation on initial page load
#optimizemobile
Friday, November 22, 13
![Page 32: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/32.jpg)
What makes it easier to find what you’re looking for?•Default order•Sorting options•Filtering
options
#optimizemobile
stelladot.com ideeli.com
Friday, November 22, 13
![Page 33: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/33.jpg)
Menu Location and Patterns
Fly-out menugarmin.com
#optimizemobile
Friday, November 22, 13
![Page 34: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/34.jpg)
Test | Menu location and patterns
Goal | Evaluate how integrated menu experience should feel (full screen vs. layered on content)
#optimizemobile
m.rei.com
Friday, November 22, 13
![Page 35: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/35.jpg)
Blocksideeli.com
Buttonsm.timhortons.com
Blindsamazon.com
Menu Location and Patterns
#optimizemobile
Friday, November 22, 13
![Page 36: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/36.jpg)
How to use A/B testing to drive conversions through the roof
Friday, November 22, 13
![Page 37: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/37.jpg)
Visual EditorToggle between <divs>HTML + CSS + JS edits
Code EditorManual inputs
#optimizemobile
Friday, November 22, 13
![Page 38: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/38.jpg)
• Clicks + Page Views + Custom Events (Specified with JS)
• Goals may/not directly impact end conversion#optimizemobile
Friday, November 22, 13
![Page 39: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/39.jpg)
• Positive/negative targeting conditions• Cookie, referral source, campaign id, custom tags,
location#optimizemobile
Friday, November 22, 13
![Page 40: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/40.jpg)
1. Test with a hypothesis.2. Sequence your testing.3. Test broad UX themes.4. Set goals with indirect impact.
Best Testing Practices
Friday, November 22, 13
![Page 41: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/41.jpg)
Results from a real mobile A/B test
Friday, November 22, 13
![Page 42: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/42.jpg)
Case Study |
Test | Add paid featured listings to mobile search results
Goal | Validate value of desktop functionality on mobile
Variation A Variation B
#optimizemobile
Friday, November 22, 13
![Page 43: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/43.jpg)
Case Study |
Result | +1.6% lift in new leads generated
Variation B Wins!
#optimizemobile
Friday, November 22, 13
![Page 44: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/44.jpg)
#optimizemobile
EXCLUSIVE WEBINAR GIVEAWAYWin a free signed copy of A/B Testing!
How to EnterTweet what you’ve learned today, and tag it with#optimizemobile
Friday, November 22, 13
![Page 45: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/45.jpg)
GET A FREE MOBILE ASSESSMENT
visit mobify.com/go/mobile-assessment for full details
#optimizemobile
Friday, November 22, 13
![Page 46: A Crash Course in A/B Testing on Mobile Websites](https://reader036.vdocuments.us/reader036/viewer/2022081602/54c633694a7959c9458b456b/html5/thumbnails/46.jpg)
A Crash Course in A/B Testing on Mobile Websites
#optimizemobile
Any Questions for Ben and Khattaab?
Friday, November 22, 13