lean experiments for agile teams
TRANSCRIPT
LEAN EXPERIMENTS
@alissadesigns
FOR
AGILE TEAMS
@alissadesigns
HEAD OF DESIGN PLANGRID
ALISSA BRIGGS
@alissadesigns
@alissadesigns
@alissadesigns
@alissadesigns
@alissadesigns
@alissadesigns
WHY EXPERIMENT?
@alissadesigns
@alissadesigns
@alissadesigns
@alissadesigns
@alissadesigns
@alissadesigns
1. RUN GOOD EXPERIMENTS
2. TURN DATA INTO DECISIONS
3. EXPERIMENT EVERYWHERE
HOW TO
RUN GOOD EXPERIMENTS
1
@alissadesigns
@alissadesigns
START WITH A CHALLENGE
EXPERIMENT GRID
@alissadesigns
@alissadesigns
1. IDEA
Hire someone who’s job is to keep the coffee
pot fullPut a note
on the coffee pot
Webcam monitors for
coffee offenders
@alissadesigns
Smart coffee pot that tweets when
empty
2. ASSUMPTIONS
What assumptions have we made about customers & their world?
@alissadesigns
2. ASSUMPTIONS
@alissadesigns
People will refill the coffee pot after seeing the note.
3. HYPOTHESES
If we do _________,
then __% of people
will _____________
@alissadesigns
3. HYPOTHESES
If I put a note on the coffee pot,
then 75% of people
will refill the coffee pot when it’s empty.
@alissadesigns
4. EXPERIMENT
Cheapest + fastest way to validate our hypothesis
@alissadesigns
CONCIERGE
WIZARD OF OZ
IMPOSTER JUDO
DRY WALLET
VIDEO TRAILER
A/B TEST
More at alissabriggs.com/experiment-grid
CHANNEL TEST
BLOG POST
HIGH HURDLE
@alissadesigns
4. EXPERIMENT
Put a note on the coffee pot.
DESCRIPTION
% of people who refill the coffee pot after finishing it
METRICS
@alissadesigns
Put note on coffee pot
People will refill the coffee pot after seeing the note.
If I put a note on the coffee pot, then 75% of people will refill the coffee pot when it’s empty.
Put a note on the coffee pot.
% who refill coffee pot
TURN DATA INTO DECISIONS
2
@alissadesigns
LET’S MEASURE
@alissadesigns
@alissadesigns
% w
ho re
fille
d co
ffee
0
25
50
75
100
Day 1 Day 2 Day 3 Day 4 Day 5
COFFEE EXPERIMENT DATA
Put note on coffee pot
People will refill the coffee pot after seeing the note.
If I put a note on the coffee pot, then 75% of people will refill the coffee pot when it’s empty.
Put a note on the coffee pot.
% who refill coffee pot
% who refilled dropped below 75% after day 2
BE HONEST
@alissadesigns
ASK “WHY?”
BE HONEST
@alissadesigns
MAKE A DECISION
ASK “WHY?”
BE HONEST
@alissadesigns
Put note on coffee pot
People will refill the coffee pot after seeing the note.
If I put a note on the coffee pot, then 75% of people will refill the coffee pot when it’s empty.
Put a note on the coffee pot.
% who refill coffee pot
% who refilled dropped below 75% after day 2
interview users & iterate
Put non-snarky note on coffee pot
People will refill the coffee pot if there’s a non-snarky note.
If I put a non-snarky note on the coffee pot, then 75% of people will refill the coffee pot when it’s empty.
Put a non-snarky note on the coffee pot.
% who refill coffee pot
@alissadesigns
AGILE
@alissadesigns
EXPERIMENTS
+
From: http://www.itinfo.am/eng/agile-project-management/
Align on goal
Experiment #1
Experiment #2
Experiment #3
Experiment #4
Experiment #n
Lean Experiment
From: http://www.itinfo.am/eng/agile-project-management/
@alissadesigns
GOAL: INCREASE FIRST SESSION DURATION
SPRINT 1 SPRINT 2 SPRINT 3
+ Measure sample project + Measure video demo
Sample Project Video Demo Setup Wizard
@alissadesigns
EXPERIMENTS
BETTER DECISIONS=
EXPERIMENT EVERYWHERE
3
@alissadesigns
@alissadesigns
START WITH A CHALLENGE
@alissadesigns
HOW MIGHT WE GET DESIGN INVOLVED
EARLIER?
@alissadesigns
@alissadesigns
@alissadesigns
EXPERIMENT EVERYWHERE
1. RUN GOOD EXPERIMENTS
2. TURN DATA INTO DECISIONS
3. EXPERIMENT EVERYWHERE
EXPERIMENT YOUR WAY TO SUCCESS
@alissadesigns
EXPERIMENT WITH
EXPERIMENTS
@alissadesigns
@alissadesigns
alissabriggs.com/experiment-grid
EXPERIMENT GRID
plangrid.com/jobs
EXPERIMENT WITH US
@alissadesigns