convert smarter, not harder - a/b split testing

84
Saturday, February 23, 13

Upload: luke-summerfield

Post on 15-May-2015

313 views

Category:

Business


3 download

DESCRIPTION

If you could double the number of conversions you’re getting on your Joomla site without gaining any additional traffic, would you be interested? Split testing can mean the difference between a website’s success and failure, yet why are so few website owners doing it? Join me as we explore one of the most overlooked aspects of website design and internet marketing. We will dig deep in the methodology and strategies behind leveraging A/B split testing to skyrocket lead conversion, boost the user experience and take your website to the next level.

TRANSCRIPT

Page 1: Convert Smarter, Not Harder - A/B Split Testing

Saturday, February 23, 13

Page 2: Convert Smarter, Not Harder - A/B Split Testing

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 3: Convert Smarter, Not Harder - A/B Split Testing

NOT HARDER.

#JDNC13 @SavvyPanda

CONVERT SMARTER,

Saturday, February 23, 13

Page 4: Convert Smarter, Not Harder - A/B Split Testing

NOT HARDER.Split Testing in Joomla.

#JDNC13 @SavvyPanda

CONVERT SMARTER,

Saturday, February 23, 13

Page 5: Convert Smarter, Not Harder - A/B Split Testing

LUKE SUMMERFIELD@SavvyPanda

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 6: Convert Smarter, Not Harder - A/B Split Testing

HUBSPOT INBOUND MARKETING CERT.

GOOGLE ADWORDS/ANALYTICS CERT.

HOOTSUITE CERT.#JDNC13 @SavvyPanda

Saturday, February 23, 13

Page 7: Convert Smarter, Not Harder - A/B Split Testing

HUBSPOT INBOUND MARKETING CERT.

GOOGLE ADWORDS/ANALYTICS CERT.

HOOTSUITE CERT.#JDNC13 @SavvyPanda

Saturday, February 23, 13

Page 8: Convert Smarter, Not Harder - A/B Split Testing

#JDNC13@SAVVYPANDA

SLIDESHA.RE/13B2GOU

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 9: Convert Smarter, Not Harder - A/B Split Testing

The Bigger Picture Setting Up Your Test

Tools For Testing Interpret Results Steps for Action& Homework

What Is Split Testing?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 10: Convert Smarter, Not Harder - A/B Split Testing

?#JDNC13 @SavvyPanda

Saturday, February 23, 13

Page 11: Convert Smarter, Not Harder - A/B Split Testing

CROLEAN & AGILE

PRICING

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 12: Convert Smarter, Not Harder - A/B Split Testing

CONVERSION RATE OPTIMIZATION

CRO#JDNC13 @SavvyPanda

Saturday, February 23, 13

Page 13: Convert Smarter, Not Harder - A/B Split Testing

GOAL OF

INTERNETMARKETING?

#JDNC13 @SavvyPanda

?

Saturday, February 23, 13

Page 14: Convert Smarter, Not Harder - A/B Split Testing

GOAL OF

INTERNETMARKETING?

#JDNC13 @SavvyPanda

?

Saturday, February 23, 13

Page 15: Convert Smarter, Not Harder - A/B Split Testing

2-WAYS TO

INCREASELEADS?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 16: Convert Smarter, Not Harder - A/B Split Testing

INCREASETRAFFIC

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 17: Convert Smarter, Not Harder - A/B Split Testing

INCREASECONVERSIONS

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 18: Convert Smarter, Not Harder - A/B Split Testing

?#JDNC13 @SavvyPanda

Saturday, February 23, 13

Page 19: Convert Smarter, Not Harder - A/B Split Testing

via ebook: http://www.hubspot.com/an-introduction-to-ab-testing/#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 20: Convert Smarter, Not Harder - A/B Split Testing

E-COMMERCE

20-25%HIGHER

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 21: Convert Smarter, Not Harder - A/B Split Testing

LANDING PAGES.

30-40%HIGHER

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 22: Convert Smarter, Not Harder - A/B Split Testing

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 23: Convert Smarter, Not Harder - A/B Split Testing

CROLEAN & AGILE

PRICING

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 24: Convert Smarter, Not Harder - A/B Split Testing

OPTIMIZE YOUR

PRICING

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 25: Convert Smarter, Not Harder - A/B Split Testing

OPTIMIZEPRICING• Three tier pricing (current, bump, spike)

• Free shipping• Bundle pricing

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 26: Convert Smarter, Not Harder - A/B Split Testing

CROLEAN & AGILE

PRICING

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 27: Convert Smarter, Not Harder - A/B Split Testing

LEAN &AGILE

WEBSITE DESIGN

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 28: Convert Smarter, Not Harder - A/B Split Testing

CREATE AN

?#JDNC13 @SavvyPanda

Saturday, February 23, 13

Page 29: Convert Smarter, Not Harder - A/B Split Testing

HERE’S A SECRET...

#JDNC13 @SavvyPanda

YOU CAN’T

Saturday, February 23, 13

Page 30: Convert Smarter, Not Harder - A/B Split Testing

HERE’S A SECRET...

#JDNC13 @SavvyPanda

YOU CAN’T

Saturday, February 23, 13

Page 31: Convert Smarter, Not Harder - A/B Split Testing

CREATE AN

MVPminimum viable product

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 32: Convert Smarter, Not Harder - A/B Split Testing

MVP• Identify core features based on research & hypothesis

• Develop a base product• Gain users

#JDNC13 @SavvyPanda

Once your MVP is launched you can perform...

Saturday, February 23, 13

Page 33: Convert Smarter, Not Harder - A/B Split Testing

SPLIT TESTING ALLOWS FOR

VALIDATEDLEARNING

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 34: Convert Smarter, Not Harder - A/B Split Testing

VALIDATEDLEARNING• Make hypothesis• Perform scientific testing (split testing)

• Collect data• One month sprints

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 35: Convert Smarter, Not Harder - A/B Split Testing

PRESERVER OR

PIVOT#JDNC13 @SavvyPanda

Saturday, February 23, 13

Page 36: Convert Smarter, Not Harder - A/B Split Testing

PIVOT ORPRESERVER?• Was hypothesis confirmed• What worked, what didn’t

• Deploy globally-or-• Pivot & refocus

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 37: Convert Smarter, Not Harder - A/B Split Testing

FOR

EXAMPLE

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 38: Convert Smarter, Not Harder - A/B Split Testing

The Bigger Picture Setting Up Your Test

Tools For Testing Interpret Results Steps for Action& Homework

What Is Split Testing?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 39: Convert Smarter, Not Harder - A/B Split Testing

WHAT IS

SPLITTESTING?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 40: Convert Smarter, Not Harder - A/B Split Testing

A/B TESTING

MULTIVARIATE

AND

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 41: Convert Smarter, Not Harder - A/B Split Testing

A/B TESTING• Two identical items• Testing only one variable• Champion vs Challenger

Goal = find optimal variations

Variation B

Variation A

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 42: Convert Smarter, Not Harder - A/B Split Testing

MULTIVARIATE•Test multiple variables simultaneously

•Running multiple A/B tests at the same time

•Must receive large traffic

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 43: Convert Smarter, Not Harder - A/B Split Testing

REMEMBER...

SPLIT TESTUNTIL YOU HAVE ADVOCATES.

PROTIP!

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 44: Convert Smarter, Not Harder - A/B Split Testing

WHAT

ITEMSCAN YOU TEST?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 45: Convert Smarter, Not Harder - A/B Split Testing

EVERYTHING!•Call To Actions•Landing Pages•Emails•Layouts•Pricing•Promotional Offers

... AND THE LIST GOES ON... (but the kitchen sink)

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 46: Convert Smarter, Not Harder - A/B Split Testing

WHAT

ELEMENTSCAN YOU TEST?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 47: Convert Smarter, Not Harder - A/B Split Testing

LANDING PAGE

•Offers•Copy•Form Fields•Layout•Image•Long vs Short

via ebook: http://www.hubspot.com/an-introduction-to-ab-testing/#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 48: Convert Smarter, Not Harder - A/B Split Testing

CALL TO ACTIONS

•Placement•Size•Color•Copy•Image•Benefit

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 49: Convert Smarter, Not Harder - A/B Split Testing

EMAIL

•Format•Timing•Sender•Subject Lines•Offer•Target Group

via ebook: http://www.hubspot.com/an-introduction-to-ab-testing/#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 50: Convert Smarter, Not Harder - A/B Split Testing

WILL IT HURT

SEO?#JDNC13 @SavvyPanda

Saturday, February 23, 13

Page 51: Convert Smarter, Not Harder - A/B Split Testing

DUPLICATE CONTENT?

goo.gl/r45Xj

Google’s Recommendations

PRO TIPSUse Rel=Canonical or No-Index

on the A/B variations

If redirect, use a 302 (not 301)

bit.ly/P0gCR1

Matt Cutts: “nope.”

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 52: Convert Smarter, Not Harder - A/B Split Testing

The Bigger Picture Setting Up Your Test

Tools For Testing Interpret Results Steps for Action& Homework

What Is Split Testing?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 53: Convert Smarter, Not Harder - A/B Split Testing

KEY CONSIDERATIONS FOR

A/BTESTING

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 54: Convert Smarter, Not Harder - A/B Split Testing

RUN ONE TEST AT A

TIME• Don’t overload • Prioritize & add on calendar• Stay focused• Create a 1 month “sprint” (busier site can do 1 week)

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 55: Convert Smarter, Not Harder - A/B Split Testing

TEST ONE VARIABLE AT

A TIME• Prioritize what to test• Allows you to track variable

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 56: Convert Smarter, Not Harder - A/B Split Testing

CHALLENGER VS CHAMPION

• Pit them against each other• Better perform = Champion

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 57: Convert Smarter, Not Harder - A/B Split Testing

CHALLENGER VS CHAMPION

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 58: Convert Smarter, Not Harder - A/B Split Testing

TEST BOTH BIG AND SMALL

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 59: Convert Smarter, Not Harder - A/B Split Testing

SMALL MAKES DIFFERENCE

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 60: Convert Smarter, Not Harder - A/B Split Testing

TEST THE ENTIRE FUNNEL

Customer

Advocate

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 61: Convert Smarter, Not Harder - A/B Split Testing

COLLECT ENOUGH

DATA 95% confidence rating

=Statistical Significance

http://super.hubspot.com/calculator/

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 62: Convert Smarter, Not Harder - A/B Split Testing

The Bigger Picture Setting Up Your Test

Tools For Testing Interpret Results Steps for Action& Homework

What Is Split Testing?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 63: Convert Smarter, Not Harder - A/B Split Testing

JOOMLA

3RD PARTY

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 64: Convert Smarter, Not Harder - A/B Split Testing

JOOMLA

J!CONVERT

#JDNC13 @SavvyPanda

• For Website• Virtuemart

FREE!

http://www.convert.com/features/

Add in JS to siteto make it work

Video:

Saturday, February 23, 13

Page 65: Convert Smarter, Not Harder - A/B Split Testing

JOOMLA

J!CONVERT

#JDNC13 @SavvyPanda

• Page Type - the view variable from the Joomla component in use on the page• Category ID - for Joomla com_content, the category id will be returned• Category Name - for Joomla com_content, the category name will be returned• Customer ID - Customer id number (when customer is logged in)• Custom Variable 1 - Joomla component name• Custom Variable 2 - User group id (if logged in)• Custom Variable 3 - for Joomla com_content, the article id will be returned• Custom Variable 4 - Joomla! Itemid number (menu id)

J!Convert - Plugin:• Page Type - VirtueMart product view, category view, checkout, cart or purchase

completion page• Category ID - VirtueMart category id number• Category Name - VirtueMart category name• Product SKU - VirtueMart product SKU• Product Name - VirtueMart product title• Product Price - VirtueMart base product price• Customer ID - Customer id number (when customer is logged in)

Convert - Virtuemart Plugin:

FREE!

Saturday, February 23, 13

Page 66: Convert Smarter, Not Harder - A/B Split Testing

JOOMLA

VISUAL WEB OPTIMIZER

#JDNC13 @SavvyPanda

By: Analytics for JoomlaMakes easier to add JS into your website

http://youtu.be/9pEU9MleWIIhttp://youtu.be/0S0IrbwpfzE

OPTIMIZLEY

Saturday, February 23, 13

Page 67: Convert Smarter, Not Harder - A/B Split Testing

JOOMLA

PRESS9 A/B TESTER

#JDNC13 @SavvyPanda

Easy JS Add innote: Joomla 1.5 Only :’-(

Saturday, February 23, 13

Page 68: Convert Smarter, Not Harder - A/B Split Testing

3RDPARTY

GOOGLE WEBOPTIMIZER

#JDNC13 @SavvyPanda

• Integrates with Adwords & Analytics

• Gives you a JS code to insert in head of the page you’re testing

FREE!

Saturday, February 23, 13

Page 69: Convert Smarter, Not Harder - A/B Split Testing

3RDPARTY

GOOGLE WEB OPTIMIZER

#JDNC13 @SavvyPanda

FREE!

Saturday, February 23, 13

Page 70: Convert Smarter, Not Harder - A/B Split Testing

The Bigger Picture Setting Up Your Test

Tools For Testing Interpret Results Steps for Action& Homework

What Is Split Testing?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 71: Convert Smarter, Not Harder - A/B Split Testing

EXAMINERESULTS

•What metrics were effected?•Did it match my hypothesis?•Were there any errors?

#JDNC13 @SavvyPanda

Iterate & Do Again!

Saturday, February 23, 13

Page 72: Convert Smarter, Not Harder - A/B Split Testing

THERE IS NO BAD TEST. AS LONG AS YOUR

LEARNING

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 73: Convert Smarter, Not Harder - A/B Split Testing

WHAT IF YOU STILL HAVE

BADRESULTS?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 74: Convert Smarter, Not Harder - A/B Split Testing

LET’SIMPROVETHE CTA!

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 75: Convert Smarter, Not Harder - A/B Split Testing

#JDNC @SavvyPanda#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 76: Convert Smarter, Not Harder - A/B Split Testing

CRO IS ALL ABOUT INFLUENCING

CONVERSIONDECISION

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 77: Convert Smarter, Not Harder - A/B Split Testing

#JDNC @SavvyPanda http://www.slideshare.net/randfish/big-picture-cro

Saturday, February 23, 13

Page 78: Convert Smarter, Not Harder - A/B Split Testing

#JDNC @SavvyPandaSaturday, February 23, 13

Page 79: Convert Smarter, Not Harder - A/B Split Testing

IS IT THE RIGHT PRODUCT FOR THE RIGHT PEOPLE?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 80: Convert Smarter, Not Harder - A/B Split Testing

The Bigger Picture Setting Up Your Test

Tools For Testing Interpret Results Steps for Action& Homework

What Is Split Testing?

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 81: Convert Smarter, Not Harder - A/B Split Testing

ACTION STEPS

1. DO MORE RESEARCH!SavvyPanda.com/BLOG

2. Perform your first test!

3. Ask Questions: SavvyPanda.com/ASK

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 82: Convert Smarter, Not Harder - A/B Split Testing

THANKS!

#JDNC13 @SavvyPandaSaturday, February 23, 13

Page 83: Convert Smarter, Not Harder - A/B Split Testing

QUESTIONS?LUKE SUMMERFIELD

#JDNC13@SAVVYPANDA

SLIDESHA.RE/13B2GOU

#JDNC @SavvyPandaSaturday, February 23, 13

Page 84: Convert Smarter, Not Harder - A/B Split Testing

http://www.flickr.com/photos/drachmann/327122302/sizes/l/in/photostream/http://www.flickr.com/photos/psit/4822614779/sizes/l/in/photostream/

http://www.flickr.com/photos/62337512@N00/2615993927/sizes/l/in/photostream/http://www.flickr.com/photos/ricardodiaz/3208220314/sizes/l/in/photostream/

http://www.flickr.com/photos/ter-burg/2381624640/sizes/l/in/photostream/http://www.flickr.com/photos/8113246@N02/4406950341/sizes/o/in/photostream/

http://www.flickr.com/photos/vintagedept/6358537847/sizes/l/in/photostream/http://www.flickr.com/photos/pennstatelive/6789813838/sizes/z/in/photostream/

http://www.flickr.com/photos/ianhaycox/128474639/sizes/m/in/photostream/http://www.robcottingham.ca/cartoon/archive/its-not-cheating-if/

http://www.flickr.com/photos/tonichu/458809478/sizes/z/in/photostream/http://www.flickr.com/photos/sonrisaelectrica/3695743740/sizes/l/in/photostream/

http://www.flickr.com/photos/clover_1/2259985318/sizes/l/in/photostream/http://www.flickr.com/photos/kalavinka/4617897952/sizes/z/in/photostream/

http://www.flickr.com/photos/aylaujp/543529949/sizes/z/in/photostream/http://www.flickr.com/photos/audiolucistore/7403731050/sizes/l/in/photostream/http://www.flickr.com/photos/marcosreis07/2997405848/sizes/l/in/photostream/http://www.flickr.com/photos/buckofive/6311309849/sizes/o/in/photostream/

PHOTO CREDITS:

#JDNC13 @SavvyPandaSaturday, February 23, 13