evaluating your email blasts with ab split testing
DESCRIPTION
What day of the week results in better open rates? What time of day works best for donation campaigns? What about advocacy campaigns? What subject line works best? Answer these questions and more by conducting A/B Split testing. Use the best practices outlined in this workshop to get the most out of this powerful Salsa tool.TRANSCRIPT
![Page 1: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/1.jpg)
![Page 2: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/2.jpg)
EVALUATING YOUR EMAIL BLASTS WITH A/B TESTING
Jason Zanon, Senior Support Specialist
![Page 3: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/3.jpg)
By the conclusion of this training, you will be able to:
• Understand the purpose and primary uses of A/B split testing
• Set up A/B split tests in Salsa• Evaluate the metrics A/B split tests
generate
Learning Objectives
![Page 4: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/4.jpg)
Photo (cc) Yair-haklai at http://tinyurl.com/ccov4aq
Will more people respond to my call to action if I send it
earlier in the morning?
Would a new donate
button perform better?
Which subject line will get recipients to open the message?
![Page 5: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/5.jpg)
A/B TestingSplit Testing
Bucket Testing
![Page 6: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/6.jpg)
![Page 7: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/7.jpg)
How does A/B testing work?
Compare opens, clicks, conversions
![Page 8: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/8.jpg)
The strongest test goes to the full list
![Page 9: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/9.jpg)
A/B Testing: The Salsa Ingredients
Creative Commons image from jordanmit09 http://tinyurl.com/prc3ty9
![Page 10: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/10.jpg)
A/B Testing: The Salsa Ingredients
(This slide fulfills my quota of dubiously overstretched Salsa metaphors.)
![Page 11: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/11.jpg)
A/B Testing: The Salsa Ingredients
Creative Commons image from jordanmit09 http://tinyurl.com/prc3ty9
![Page 12: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/12.jpg)
Steps to A/B Testing in Salsa
• Create and target a main blast just like any email, as the framework for your A/B test
• Split off two test panels targeted to percentages of your main blast’s target pool
• Send those test panels, edited to reflect the desired variation(s) in content
• Send the main blast, with content of the “winning” test version
![Page 13: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/13.jpg)
• Create and target a main blast just like any email, as the framework for your A/B test
• Split off two test panels targeted to percentages of your main blast’s target pool
• Send those test panels, edited to reflect the desired variation(s) in content
• Send the main blast, with content of the “winning” test version
Steps to A/B Testing in Salsa
![Page 14: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/14.jpg)
Begin with a normal, everyday email blast
![Page 15: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/15.jpg)
Steps to A/B Testing in Salsa
• Create and target a main blast just like any email, as the framework for your A/B test
• Split off two test panels targeted to percentages of your main blast’s target pool
• Send those test panels, edited to reflect the desired variation(s) in content
• Send the main blast, with content of the “winning” test version
![Page 16: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/16.jpg)
Use the “A/B Split Test Blasts” button in the very last step …
![Page 17: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/17.jpg)
… then set the percentage sizes of the recipient pool who’ll get test blasts …
![Page 18: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/18.jpg)
… and proceed to introduce the test variable by editing the two test copies.
blast
![Page 19: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/19.jpg)
Steps to A/B Testing in Salsa
• Create and target a main blast just like any email, as the framework for your A/B test
• Split off two test panels targeted to percentages of your main blast’s target pool
• Send those test panels, edited to reflect the desired variation(s) in content
• Send the main blast, with content of the “winning” test version
![Page 20: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/20.jpg)
Submit each test blast
![Page 21: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/21.jpg)
Compare!
![Page 22: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/22.jpg)
Compare!
![Page 23: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/23.jpg)
Steps to A/B Testing in Salsa
• Create and target a main blast just like any email, as the framework for your A/B test
• Split off two test panels targeted to percentages of your main blast’s target pool
• Send those test panels, edited to reflect the desired variation(s) in content
• Send the main blast, with content of the “winning” test version
![Page 24: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/24.jpg)
Swap into the main blast the content of the top test
![Page 25: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/25.jpg)
• Isolate one variable per test• Subject line• Personalization• Salutation• From Name• Day of week, time of day• Images and design elements• Wording/presentation of action buttons and links
• Consider statistical significance• Re-test things you “know”: it’s an ever-changing
environment
A few tips …
![Page 26: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/26.jpg)
CONTACT INFO
Read, learn, discuss – help.salsalabs.com
Training & Learning Team – [email protected]
Salsa Support – [email protected]
![Page 27: Evaluating your email blasts with ab split testing](https://reader036.vdocuments.us/reader036/viewer/2022062703/554ed72cb4c905d1158b4721/html5/thumbnails/27.jpg)
THANK YOU!