using your growth model to drive smarter high tempo testing

29
Testing with a Growth Model Using a Growth Model for more Eective High Tempo Testing

Upload: sean-ellis

Post on 06-Jan-2017

18.323 views

Category:

Marketing


0 download

TRANSCRIPT

Page 1: Using Your Growth Model to Drive Smarter High Tempo Testing

Testing with a Growth Model

Using a Growth Model for more Effective High Tempo Testing

Page 2: Using Your Growth Model to Drive Smarter High Tempo Testing

Testing Drives Growth

Twitter boosts testing tempo 20X GH boosts testing tempo 10X

Page 3: Using Your Growth Model to Drive Smarter High Tempo Testing

High Tempo Testing Process

Analyze

Ideas Prioritize

Test

Page 4: Using Your Growth Model to Drive Smarter High Tempo Testing

Analyze Growth Model First

Analyze

Ideas Prioritize

Test

Page 5: Using Your Growth Model to Drive Smarter High Tempo Testing

Establish a North Star Metric

•  Provides lens for measuring sustainable growth

•  Should be correlated with value delivered to customers

•  Examples: Airbnb nights booked, Facebook DAUs

Page 6: Using Your Growth Model to Drive Smarter High Tempo Testing

Understand Your Growth Model

Relationship between variables that move your North Star Metric

•  Acquisitio - Sources and motivation to try

•  Ac - Aha moment

•  - “Must have” experience

•  - User-get-user loops

Acquisition

Activation

Retention

Referral

Page 7: Using Your Growth Model to Drive Smarter High Tempo Testing

Build Your Growth Model

?

(Aha Moment) ?

?

(North Star Metric)

?

Acquisition

Activation

Retention

Referral

Revenue ?

*simplified

(Core Benefit)

Page 8: Using Your Growth Model to Drive Smarter High Tempo Testing

LinkedIn Example Growth Model*

SEO Int’l expansion Invites

(Aha Moment) Create profile, 4+ connections

Stay connected with work people

(North Star Metric)

Profile connections

Acquisition

Activation

Retention

Referral

Revenue Invites

*simplified

(Core Benefit)

Page 9: Using Your Growth Model to Drive Smarter High Tempo Testing

What’s Your “Aha Moment”?

•  Elements of an “aha moment”

–  First taste of core benefit

–  Achievable on first visit

–  Significantly increases likelihood of revisit

•  If NO “aha moment” reached on 1st visit, unlikely to ever see prospect again

Page 10: Using Your Growth Model to Drive Smarter High Tempo Testing

Growth Model for GrowthHackers*

Invites

(invites)

Unique growth insights from

testing

(North Star Metric)

Card hops

SlideShare Acquisition

Activation

Retention

Referral

Revenue

Twitter

Sharing a great idea

(Aha Moment)

*simplified

(Core Benefit)

Page 11: Using Your Growth Model to Drive Smarter High Tempo Testing

Analyze to Find Leverage in Model

(invites)

Unique growth insights from

testing Card hops

Acquisition

Activation

Retention

Referral Sharing a great idea

(Aha Moment)

Invites SlideShare

Twitter

(North Star Metric)

Revenue

(Core Benefit)

Page 12: Using Your Growth Model to Drive Smarter High Tempo Testing

“Activation” Growth Objective

Page 13: Using Your Growth Model to Drive Smarter High Tempo Testing

Deeper Understanding of Problem

No ideas added yet

Page 14: Using Your Growth Model to Drive Smarter High Tempo Testing

High Tempo Testing Process

Analyze

Ideas Prioritize

Test

Page 15: Using Your Growth Model to Drive Smarter High Tempo Testing

Generate Ideas in Leverage Area

Majority of new ideas should be in leverage area

Activation

Page 16: Using Your Growth Model to Drive Smarter High Tempo Testing

Formalize ideas in Experiment Doc

•  Include hypothesis, research, target lever

ICE Score 1 - 10

I - Impact

C - Confidence

E - Ease

Page 17: Using Your Growth Model to Drive Smarter High Tempo Testing

High Tempo Testing Process

Analyze

Ideas Prioritize

Test

Page 18: Using Your Growth Model to Drive Smarter High Tempo Testing

Team Members Nominate Ideas

Filter to focus area Sort by ICE score

Page 19: Using Your Growth Model to Drive Smarter High Tempo Testing

Quick Team Nomination Pitches

Page 20: Using Your Growth Model to Drive Smarter High Tempo Testing

High Tempo Testing Process

Analyze

Ideas Prioritize

Test

Page 21: Using Your Growth Model to Drive Smarter High Tempo Testing

Launch and Manage Testing

Page 22: Using Your Growth Model to Drive Smarter High Tempo Testing

Integrate Your Testing Tools

Page 23: Using Your Growth Model to Drive Smarter High Tempo Testing

Analyze Results

Analyze

Ideas Prioritize

Test

Page 24: Using Your Growth Model to Drive Smarter High Tempo Testing

Analyze Results

Page 25: Using Your Growth Model to Drive Smarter High Tempo Testing

Organize Learning

Page 26: Using Your Growth Model to Drive Smarter High Tempo Testing

Repeat Process

Analyze

Ideas Prioritize

Test

Page 27: Using Your Growth Model to Drive Smarter High Tempo Testing

Monitor Key Testing Inputs

Page 28: Using Your Growth Model to Drive Smarter High Tempo Testing

Weekly Growth Meeting Agenda

15 min: KPI review & update focus area

10 min: Review last week’s testing sprint

15 min: Key lessons learned from analyzed tests

15 min: Select next tests via nominations

5 min: Check growth of idea backlog

Page 29: Using Your Growth Model to Drive Smarter High Tempo Testing

Manage High Tempo Testing

1) Team Ideation 2) Prioritize Testing 3) Capture Learning

Try GrowthHackers Projects Free Projects.GrowthHackers.com

GrowthHackers Projects