Transcript
Page 1: A Crash Course in A/B Testing on Mobile Websites

A Crash Course in A/B Testing on Mobile Websites

#optimizemobile | 20 November, 2014

Friday, November 22, 13

Page 2: A Crash Course in A/B Testing on Mobile Websites

A Crash Course in A/B Testing on Mobile Websites

#optimizemobile

#optimizemobile

Friday, November 22, 13

Page 3: A Crash Course in A/B Testing on Mobile Websites

EXCLUSIVE WEBINAR GIVEAWAYWin a free signed copy of A/B Testing!

#optimizemobile

How to EnterTweet what you’ve learned today, and tag it with#optimizemobile

Friday, November 22, 13

Page 4: A Crash Course in A/B Testing on Mobile Websites

Agenda1. How the right mobile strategy can

accelerate your marketing ROI

2. A/B test ideas for mobile web design principles

3. How to use mobile A/B testing to drive conversions through the roof

4. Results from real mobile A/B tests

5. Q&A with Ben and Khattaab

Friday, November 22, 13

Page 5: A Crash Course in A/B Testing on Mobile Websites

How the right mobile strategy can accelerate your marketing ROI

Friday, November 22, 13

Page 6: A Crash Course in A/B Testing on Mobile Websites

#optimizemobile

Friday, November 22, 13

Page 7: A Crash Course in A/B Testing on Mobile Websites

What does it mean to be mobile?

•mobile website?•mobile app?•both?

#optimizemobile

Friday, November 22, 13

Page 8: A Crash Course in A/B Testing on Mobile Websites

Mobile websites matter. What’s the next step?

#optimizemobile

Friday, November 22, 13

Page 9: A Crash Course in A/B Testing on Mobile Websites

Deliver the mobile web experience that your users deserve.

Build Buy or

#optimizemobile

Friday, November 22, 13

Page 10: A Crash Course in A/B Testing on Mobile Websites

Separate mobile (and tablet) sitesYour visitor is redirected to the right version of your website, based on what device they’re using.

www.website.com

t.website.com

m.website.com

#optimizemobile

Friday, November 22, 13

Page 11: A Crash Course in A/B Testing on Mobile Websites

Responsive web design

Always at www.website.com

Your website automatically adapts its content and layout to fit your visitor’s screen size or device.

#optimizemobile

Friday, November 22, 13

Page 12: A Crash Course in A/B Testing on Mobile Websites

What content should your mobile website have? We have some (test) ideas...

#optimizemobile

Friday, November 22, 13

Page 13: A Crash Course in A/B Testing on Mobile Websites

Shop Search About Support Contact Q&A Links Gallery

Mobile users want to complete tasks and find information.

#optimizemobile

lhw.com

Friday, November 22, 13

Page 14: A Crash Course in A/B Testing on Mobile Websites

Device-Specific Presentation(not device-specific content)

#optimizemobile

youtube.com m.youtube.com

Friday, November 22, 13

Page 15: A Crash Course in A/B Testing on Mobile Websites

How do you define your mobile website goals?

#optimizemobile

Friday, November 22, 13

Page 16: A Crash Course in A/B Testing on Mobile Websites

Checkout Flows

Test | Exit routes, process flow, security messaging

Goal | More purchases or greater average order values

#optimizemobile

“Begin Checkout”bose.com

“Secure Checkout”ctshirts.com

Friday, November 22, 13

Page 17: A Crash Course in A/B Testing on Mobile Websites

Store Locators

Main Menulululemon.com

Top Navigationperfumania.com

Goal | Drive in-store purchases#optimizemobile

Friday, November 22, 13

Page 18: A Crash Course in A/B Testing on Mobile Websites

Layouts for Ad and Content Engagement

Fixed Banner Adm.huffpost.com

Banner Adwired.com

#optimizemobile

Friday, November 22, 13

Page 19: A Crash Course in A/B Testing on Mobile Websites

Cross-Channel Attribution

Image source: Google#optimizemobile

Friday, November 22, 13

Page 20: A Crash Course in A/B Testing on Mobile Websites

A/B test ideas for mobile web design principles

Friday, November 22, 13

Page 21: A Crash Course in A/B Testing on Mobile Websites

Is your mobile website fast to load and fast to respond to gestures?

#optimizemobile

Friday, November 22, 13

Page 22: A Crash Course in A/B Testing on Mobile Websites

Hitting the Mobile Navigation Sweet Spot

#optimizemobile

Friday, November 22, 13

Page 23: A Crash Course in A/B Testing on Mobile Websites

Test | Breadcrumb and CTA placement, zoom activation, collapsed or exposed detail

Goal | Drive engagement with content that compels CTA conversion

#optimizemobile

Above the Foldm.rei.com

Below the Foldm.rei.com

Friday, November 22, 13

Page 24: A Crash Course in A/B Testing on Mobile Websites

What gets more page views?•Buttons•Back button

What gets more clicks?•Sticky button•Above the fold

#optimizemobile

ideeli.comgarmin.com

Friday, November 22, 13

Page 25: A Crash Course in A/B Testing on Mobile Websites

Image source: ClickTale

Users scroll more on touch screens.

#optimizemobile

Friday, November 22, 13

Page 26: A Crash Course in A/B Testing on Mobile Websites

What compels you to scroll?•Lists•Grids•Text-heavy

blocks•Images

#optimizemobile

huffingtonpost.comnytimes.com

Friday, November 22, 13

Page 27: A Crash Course in A/B Testing on Mobile Websites

#optimizemobile

Friday, November 22, 13

Page 28: A Crash Course in A/B Testing on Mobile Websites

Test | Search functionality

Goal | Inform search prominence

#optimizemobile

bonobos.com

Friday, November 22, 13

Page 29: A Crash Course in A/B Testing on Mobile Websites

What leads to more searches?•Auto-complete•Form fields•Position on the

page

#optimizemobile

christies.com lhw.com

Friday, November 22, 13

Page 30: A Crash Course in A/B Testing on Mobile Websites

Simplification of Elements

#optimizemobile

youtube.com m.youtube.com

Friday, November 22, 13

Page 31: A Crash Course in A/B Testing on Mobile Websites

m.rei.com m.stubhub.com

Test | Simplify category page elements like filtering and sorting

Goal | Identify best presentation on initial page load

#optimizemobile

Friday, November 22, 13

Page 32: A Crash Course in A/B Testing on Mobile Websites

What makes it easier to find what you’re looking for?•Default order•Sorting options•Filtering

options

#optimizemobile

stelladot.com ideeli.com

Friday, November 22, 13

Page 33: A Crash Course in A/B Testing on Mobile Websites

Menu Location and Patterns

Fly-out menugarmin.com

#optimizemobile

Friday, November 22, 13

Page 34: A Crash Course in A/B Testing on Mobile Websites

Test | Menu location and patterns

Goal | Evaluate how integrated menu experience should feel (full screen vs. layered on content)

#optimizemobile

m.rei.com

Friday, November 22, 13

Page 35: A Crash Course in A/B Testing on Mobile Websites

Blocksideeli.com

Buttonsm.timhortons.com

Blindsamazon.com

Menu Location and Patterns

#optimizemobile

Friday, November 22, 13

Page 36: A Crash Course in A/B Testing on Mobile Websites

How to use A/B testing to drive conversions through the roof

Friday, November 22, 13

Page 37: A Crash Course in A/B Testing on Mobile Websites

Visual EditorToggle between <divs>HTML + CSS + JS edits

Code EditorManual inputs

#optimizemobile

Friday, November 22, 13

Page 38: A Crash Course in A/B Testing on Mobile Websites

• Clicks + Page Views + Custom Events (Specified with JS)

• Goals may/not directly impact end conversion#optimizemobile

Friday, November 22, 13

Page 39: A Crash Course in A/B Testing on Mobile Websites

• Positive/negative targeting conditions• Cookie, referral source, campaign id, custom tags,

location#optimizemobile

Friday, November 22, 13

Page 40: A Crash Course in A/B Testing on Mobile Websites

1. Test with a hypothesis.2. Sequence your testing.3. Test broad UX themes.4. Set goals with indirect impact.

Best Testing Practices

Friday, November 22, 13

Page 41: A Crash Course in A/B Testing on Mobile Websites

Results from a real mobile A/B test

Friday, November 22, 13

Page 42: A Crash Course in A/B Testing on Mobile Websites

Case Study |

Test | Add paid featured listings to mobile search results

Goal | Validate value of desktop functionality on mobile

Variation A Variation B

#optimizemobile

Friday, November 22, 13

Page 43: A Crash Course in A/B Testing on Mobile Websites

Case Study |

Result | +1.6% lift in new leads generated

Variation B Wins!

#optimizemobile

Friday, November 22, 13

Page 44: A Crash Course in A/B Testing on Mobile Websites

#optimizemobile

EXCLUSIVE WEBINAR GIVEAWAYWin a free signed copy of A/B Testing!

How to EnterTweet what you’ve learned today, and tag it with#optimizemobile

Friday, November 22, 13

Page 45: A Crash Course in A/B Testing on Mobile Websites

GET A FREE MOBILE ASSESSMENT

visit mobify.com/go/mobile-assessment for full details

#optimizemobile

Friday, November 22, 13

Page 46: A Crash Course in A/B Testing on Mobile Websites

A Crash Course in A/B Testing on Mobile Websites

#optimizemobile

Any Questions for Ben and Khattaab?

Friday, November 22, 13


Top Related