website testing & optimization framework & results
TRANSCRIPT
![Page 1: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/1.jpg)
Sumo Logic Framework & Journey of Website Testing/Optimization
Saad Hameed & Jithesh AmbalapadMarketing, Operations, Analytics & technology team
![Page 2: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/2.jpg)
LinkedIn: http://j.mp/SaadHameedTwitter: @SaadVirtus https://twitter.com/SaadVirtus
![Page 4: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/4.jpg)
○Improve Navigation (IA)
○Align Messaging
○Improve Bounce Rate
Website Journey Phase 1: Create Baseline of Web Visitor Engagement
![Page 5: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/5.jpg)
○ Build taxonomy & foundational tools to measure & optimize
• Google Tag Manager
• Google Analytics
• User Testing
• Optimizely
• CrazyEgg
○ Website Redesign & Continuous Improvement
• Major revamp of our website UI/UX
• Updated Content/Messaging
The How of Improving Baseline Engagement for Website
![Page 6: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/6.jpg)
Sumologic.com Site Pre-Phase 1 (Aug 2015)
https://web.archive.org/web/20160405124254/https://www.sumologic.com/
![Page 7: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/7.jpg)
Sumologic.com Post-Phase 1 Refreshes:
May 2016
https://web.archive.org/web/20150814044927/https://www.sumologic.com/
![Page 8: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/8.jpg)
• Results
○ Continued refreshes improved Bounce Rates from 65% to 40%
○ Improved free conversions + 10%
○ Improved Alexa Ranking (15% Improvement)
Nov 2015 May 2016
Results From The Phase 1 Refresh
![Page 9: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/9.jpg)
○Ongoing major initiative to optimize for engagement and conversion
○Started with detailing a testing framework
○Framework and testing is geared towards
• Improving Conversion
• Improving Engagement
Journey Phase 2: Web Optimization to Improve Conversions
![Page 10: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/10.jpg)
Improve Conversions & Engagement: • Platinum (Free/Trial, Contact Us, Click to chat)• Gold (Platinum + Gated content resources)• Silver (Gold + Non-Gated content resources)
Define the different elements that we would need to test and have a categorization (A/B Testing taxonomy)
Detailing out test stories, execute the tests, measure, & communicate
Why?Why to test
What?What do we need
to test
How?Process to test
The Why, What, and How of Web Optimization & Testing
![Page 11: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/11.jpg)
Information Architecture Content
● Components○ Main Navigation○ Utility Navigation○ Footer
● Attributes○ Size○ Position○ Verbiage
Images Content Modules Call to ActionsOffers
● Components○ Spotlight○ Logos○ Icons○ Product
● Attributes○ Size○ Position○ Image types
(Human /Product)
● Components○ Company Pitch ○ Product Pitch○ Product Validators○ Product Demos ○ Product Benefit ○ Customer Testimonial○ Customer Logos ○ Pricing
● Attributes○ Tone○ Voice○ Size○ Position
● Components○ Gated○ Non-Gated
● Attributes○ Title○ Type (Blog, Podcast,
video, PDF, etc.)○ Perceived Value of
offer ○ Relevance to phase
in buyer lifecycle
● Components○ Free CTA○ Video CTA○ Download
● Attributes○ Size○ Position ○ Action/Verbiage○ Color ○ Font○ Image
Web Optimization & Testing Framework
![Page 12: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/12.jpg)
Information Architecture
● Components○ Main Navigation○ Utility Navigation○ Footer
● Attributes○ Size○ Position○ Verbiage
Size Position VerbiageMain Nav Large or Small Change Position Nav Item VerbiageUtility Nav Large or Small Top or Next to Main Item VerbiageFooter Fat footer or Thin Footer Left or Center Item Verbiage
How to Leverage the Framework? Example:
![Page 13: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/13.jpg)
• Definition and detailing of “What” becomes the essence of testing ideas
• Map the ideas based on Impact to business & Ease of implementation
• Prioritize and execute ideas • Document & take action on Results
Creating a Funnel for Web Optimization & Testing Experiments
![Page 14: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/14.jpg)
Ease of Implementation
Bus
ines
s Im
pact
● New Offers● Nav position● Related content
position
● Offers A/B testing with Audience data
● Contact us position
● Footer Link sizes● Media download
positioning
● Positioning of Share button
● Link out positioning for external references
● Position of Mobile nav
● Enable/Disable link to product demo
● Elevator pitch message
● Hide/enable related links
● Multivariate Testing with customer quotes
● Spotlight size
● Demo Multi page● CTA positioning● Nav element
positioning
● Free CTA● Nav text verbiage● Login position
High
Medium
Low
Low (Hard)
Medium High (easy)
THIS IS A SAMPLE
NOT ACTUAL IDEAS
How to Prioritize the Web Optimization & Testing Experiments?
![Page 15: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/15.jpg)
Example of Web Experiment Test Click and Conversion rate when button verbiage is changed
![Page 16: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/16.jpg)
Example of Web Experiment
![Page 17: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/17.jpg)
Web Experiment Results
![Page 18: Website testing & optimization framework & results](https://reader034.vdocuments.us/reader034/viewer/2022051404/589fd0391a28abf06d8b4e41/html5/thumbnails/18.jpg)
The How (Process) of Web Optimization & Testing