create a/b tests with the google tag manager
DESCRIPTION
A Google Tag Manager recipe: how to set up a/b tests, and analyze the resultsTRANSCRIPT
SET UP (AND
ANALYZE) YOUR
A/B TESTS LIKE A
BOSS
USING THE GOOGLE TAG MANAGER
JULES STUIFBERGEN – CONVERSION HOTEL 2014
TOPICS FOR THIS
SESSION
• Two ground rules
• The added value of commercial tools
• What type of A/B tests am I talking about
• Can we replicate this functionality (using GTM)
• For free
• For kicks
• Because we can!
• Let’s find out!
A/B TESTING RULE 1:
RANDOMNESS
Visitors enter your experimentation zone
They’re assigned to a
variation (A or B)
randomly.
Then, they’re part of your
experiment.
A/B TESTING RULE 2:
CONDITIONS STAY THE SAME
Visitors are in the same condition, always.
Condition A
Condition B
THE ADDED VALUE OF
COMMERCIAL TOOLS
Optimizely VWO
THESE TOOLS DO 2
THINGS REALLY WELL
Fancy GUIUGLY code
WHAT TYPE OF TESTS
AM I TALKING ABOUT
• Same URL / page group
• Content manipulation with Javascript / jQuery
Meet jQuery. A big fat
Javascript library
LET’S REPLICATE THE
LOGIC
Pseudo code for a visitor entering the experiment
1. Does the visitor have a valid cookie?
1. Yes: set the condition variable w/ cookie value
2. No: Roll a dice and assign condition A or B
2. Store the condition in the cookie
3. Load the code for A or B
1. Javascript / jQuery code
2. Google Analytics code
READY TO CODE
YOUR TAG?
DETAILS: CONFIG
This code allows
endless amount of
variations.
One cookie per test
DETAILS:
ASSIGNMENT
In words:
If the cookie value is not in the
list of the variation names:
Pick a random variation.
DETAILS: COOKIE
Set the cookie, always.
This makes sure the cookie is renewed for 90 days
(code stolen from the interweb)
DETAILS: THE FUN
STUFF
This is where the
GTM magic begins.
abtest macros for
category, action and
label (from datalayer)
DETAILS: THE FUN
STUFF
This is where the
GTM magic begins.
Built-in event macro,
to trigger the action
RULE NR. 1
Fires on all abtest
events
MEASURE LIKE A
BOSS
RULE NR. 2 (AND 3..)
Fires variation
code
CODE LIKE A BOSS
OR.. CHEAT LIKE A
BOSS
Steal (and clean)
optimizely’s code using
the “edit code”
functionality
START YOUR
EXPERIMENT
This goes in a Tag
Activated by a
Rule
DEBUG YOUR
CONTAINER VERSION
LIKE A BOSS
WELCOME VISITORS..
http://datadatadata.nl/ch2014.html
AND ANALYZE THE
RESULTS
Use Google Analytics User
Segments on Events
YOU WIN!
THANK YOU
Jules Stuifbergen
@zjuul