![Page 1: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/1.jpg)
Designing Effective Experiments for
Product Decisions
Grace NgCo-founder, Javelin.comcreators of QuickMVP@uxceo
![Page 2: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/2.jpg)
"Business has only two functions - marketing and innovation."
- Peter Drucker
![Page 3: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/3.jpg)
Build
![Page 4: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/4.jpg)
MEASUREMETRICS
LEARNPIVOT/PERSEVERE
BUILDEXPERIMENTHypothe
size Test
Analyze
@uxceo
LEARN MEASURE
BUILD
![Page 5: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/5.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
Method & SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
>OV�PZ�`V\Y�J\Z[VTLY&�)L�HZ�ZWLJPÄJ�HZ�WVZZPISL�� � � � � � � � � � � Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
Project Name: Team Leader Name:
GET OUT OF THE BUILDING!
© 2014 Javelin. You are free to use it and earn money with it as an entrepreneur, consultant, or executive, as long as you are not a software company (the latter need to license it from us).Download Experiment Board and watch case studies at www.javelin.com
Experiment BoardJavelin
@uxceo [email protected]@uxceo http://bit.ly/xB0D
![Page 6: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/6.jpg)
Step 1
Define Your Hypothesis
@uxceo
![Page 7: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/7.jpg)
Who is your customer?Must be specific to be easily testable!
@uxceo
![Page 9: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/9.jpg)
ProblemINCORRECT:“People are not buying enough cameras” is not a problem someone has
CORRECT:“The outdoor adventurer hates the bulkiness”“The amateur photographer doesn’t think his skills are good enough to invest in a DSLR ”
Different customers, different problems
@uxceo [email protected]@uxceo
![Page 10: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/10.jpg)
Problem Hypothesis
I believe [my customer] has a problem [achieving this goal]
@uxceo [email protected]@uxceo
![Page 11: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/11.jpg)
Solution
Do not define until the problem is validated
Why? Because every problem has multiple solutions
@uxceo [email protected]@uxceo
![Page 12: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/12.jpg)
Discover@uxceo
![Page 13: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/13.jpg)
What is the solution?What will solve your customer’s problem?
@uxceo
![Page 14: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/14.jpg)
Solution Hypothesis
@uxceo [email protected]
I believe [my solution] will result in [my customer] taking [specific action]
@uxceo
Solution Hypothesis
![Page 16: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/16.jpg)
What must we LEARN?
What are the Core Assumptions of our business?
Assumption: A behavior, mentality, or action that needs to happen in order for hypothesis to be true.
@uxceo [email protected]@uxceo
![Page 17: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/17.jpg)
What must we TEST?
Prioritize: Which Assumption is the Riskiest?
The one that is most unknown, and crucial to the business
@uxceo [email protected]@uxceo
What must we TEST?
![Page 18: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/18.jpg)
Minimum Viable Product Use the least amount of effort to get
the most amount of customer feedback
@uxceo [email protected]@uxceo
![Page 19: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/19.jpg)
What do we BUILD to test?
1. Exploration: test validity of problem2. Pitch: test value of your solution3. Concierge: test customer
satisfaction or behavior
@uxceo [email protected]@uxceo
What must we BUILD?
![Page 20: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/20.jpg)
How to MEASURE success?
Minimum Success Criteria : What’s the weakest outcome you need to see in order to move forward?
@uxceo [email protected]@uxceo
![Page 21: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/21.jpg)
1. Cost• Project Cost• Opportunity Cost
2. Existing metrics• Business KPI• Specific user behavior
How to MEASURE success?
@uxceo [email protected]@uxceo
How to MEASURE success?
![Page 23: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/23.jpg)
@uxceo
![Page 25: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/25.jpg)
Invalidated?
PIVOT!
@uxceo
![Page 26: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/26.jpg)
Validated?
PERSEVERE!
@uxceo
![Page 27: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/27.jpg)
Keep Testing@uxceo
![Page 28: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/28.jpg)
Case Study@uxceo
![Page 29: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/29.jpg)
@uxceo
Founders UX Help
![Page 30: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/30.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
![Page 31: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/31.jpg)
Exploration Interviews@uxceo
![Page 32: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/32.jpg)
Effective Interviews1. I’m doing some research around...
2. Have you ever [experienced problem]?
3. Tell me about that time, what happened?
4. What did you do to resolve it?
5. How satisfied were you with the outcome?
6. If unsatisfied, how else have you tried to solve it?
@uxceo [email protected]@uxceo
Effective Interviews
![Page 33: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/33.jpg)
Collect Data
• Level of pain/frustration• Frequency of encounter with pain• Existing behavior to solve problem• Time/money spent searching for a
solution
@uxceo [email protected]@uxceo
Collect Data
![Page 34: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/34.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
No reliable source
Interview:6/10
9/12Persevere
Friends. Classes.
Paid UX designers hourly for help
@uxceo
![Page 35: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/35.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
@uxceo
![Page 36: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/36.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
@uxceo
![Page 39: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/39.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
No reliable source
Interview:6/10
Pay for virtual UX feedback
Pitch:8/10
10/10Test
2nd side of market
Don’t mind virtual at all.
Price is cheap
9/12Persevere
Friends. Classes.
Paid UX designers
for help
@uxceo
![Page 40: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/40.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
UX Designers
Getting clients forquick UX
consulting
@uxceo
![Page 41: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/41.jpg)
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
UX Designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Will consult virtually
Pitch:8/10
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
UX Designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Will consult virtually
Pitch:8/10
@uxceo
![Page 42: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/42.jpg)
Seriously?@uxceo
![Page 43: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/43.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
No reliable source
Interview:6/10
Pay for virtual UX feedback
Pitch:8/10
10/10Test
2nd side of market
Don’t mind virtual at all.
Price is cheap
Will consult virtually
Pitch:8/10
0/10Pivot!
9/12Persevere
Friends. Classes.
Paid UX designers
for help
@uxceo
![Page 44: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/44.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
No reliable source
Interview:6/10
Pay for virtual UX feedback
Pitch:8/10
10/10Test
2nd side of market
Don’t mind virtual at all.
Price is cheap
Will consult virtually
Pitch:8/10
0/10Pivot!
No! 5 yrs exp.
Established
9/12Persevere
Friends. Classes.
Paid UX designers
for help
@uxceo
![Page 45: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/45.jpg)
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
UX Designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Will consult virtually
Pitch:8/10
Recent grad UX
designers
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
UX Designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Will consult virtually
Pitch:8/10
Recent grad UX
designers
Getting clients forquick UX
consulting
@uxceo
![Page 46: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/46.jpg)
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
UX Designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Will consult virtually
Pitch:8/10
Recent grad UX
designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Give quick online
feedback
Pitch:60%
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
UX Designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Will consult virtually
Pitch:8/10
Recent grad UX
designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Give quick online
feedback
Pitch:60%
@uxceo
![Page 48: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/48.jpg)
@uxceo @nycuxpa #ngnycuxpa
Google Ads@uxceo
![Page 49: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/49.jpg)
No Backend@uxceo
![Page 51: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/51.jpg)
3 Data Points@uxceo @nycuxpa #ngnycuxpa@uxceo
3 Data Points@uxceo
![Page 52: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/52.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
No reliable source
Interview:6/10
8/10Persevere
Friends. Classes.
2 paid UX designers
for help
Pay for virtual UX feedback
Pitch:8/10
10/10Test
2nd side of market
Don’t mind virtual at all.
Price is cheap
Will consult virtually
Pitch:8/10
0/10Pivot!
No! 5 yrs exp.
Established
Give quick online
feedback
Pitch:60%
37/184 emails
Persevere
Started referring friends
@uxceo
![Page 53: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/53.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
UX Designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Will consult virtually
Pitch:8/10
Recent grad UX
designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Give quick online
feedback
Pitch:60%
Online platform is sufficient
Concierge:60%
satisfied
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
@uxceo
![Page 54: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/54.jpg)
Concierge
Customer Submits RequestUX Designer gets email and submits feedback
@uxceo [email protected]
Concierge@uxceo
![Page 55: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/55.jpg)
Manually
Customer Submits RequestUX Designer gets email and submits feedback
@uxceo [email protected]
Manually@uxceo
![Page 56: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/56.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
No reliable source
Interview:6/10
8/10Persevere
Friends. Classes.
2 paid UX designers
for help
Pay for virtual UX feedback
Pitch:8/10
10/10Test
2nd side of market
Don’t mind virtual at all.
Price is cheap
Will consult virtually
Pitch:8/10
0/10Pivot!
No! 5 yrs exp.
Established
Give quick online
feedback
Pitch:60%
37/184 emails
Persevere
Started referring friends
Online platform is sufficient
Concierge:60%
satisfied
20%Iterate
Wanted more
function-ality
@uxceo
![Page 57: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/57.jpg)
@uxceo
High PainLow Pain
Low Frequency
High Frequency
Focus
![Page 58: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/58.jpg)
@lissijean@uxceo
![Page 59: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/59.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
OpenSkyShoppers
Thinkcurators
notauthentic
@uxceo
![Page 60: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/60.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
CMSBlock
OpenSkyShoppers
Thinkcurators
notauthentic
@uxceo
![Page 61: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/61.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Shopperswill buy
@uxceo
CMSBlock
OpenSkyShoppers
Thinkcurators
notauthentic
![Page 62: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/62.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Concierge:Purchaseup 20%
@uxceo
Shopperswill buy
CMSBlock
OpenSkyShoppers
Thinkcurators
notauthentic
![Page 63: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/63.jpg)
@lissijean@uxceo
![Page 64: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/64.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
@uxceo
$0 inRevenue
No CT
Shopperswill buy
from CMS
Concierge:Purchaseup 20%
![Page 65: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/65.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
@uxceo
Shoppers don’tlooks at the home feed,
onlyemails
$0 inRevenue
No CT
Shopperswill buy
from CMS
Concierge:Purchaseup 20%
![Page 66: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/66.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
@uxceo
Concierge:Purchaseup 20%
Shopperswill buy
from CMS
CMSBlock
OpenSkyShoppers
Thinkcurators
notauthentic
![Page 67: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/67.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
OpenskyShoppers
Not seeingcurator
messages
@uxceo
Concierge:Purchaseup 20%
Shopperswill buy
from CMS
CMSBlock
OpenSkyShoppers
Thinkcurators
notauthentic
![Page 68: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/68.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
OpenskyShoppers
Not seeingcurator
messages
@uxceo
Concierge:Purchaseup 20%
Shopperswill buy
from CMS
CMSBlock
OpenSkyShoppers
Thinkcurators
notauthentic
Emailmessages
![Page 69: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/69.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
OpenskyShoppers
Not seeingcurator
messages
@uxceo
Concierge:Purchaseup 20%
Shopperswill buy
from CMS
CMSBlock
OpenSkyShoppers
Thinkcurators
notauthentic
Emailmessages
Shopperswill buy
![Page 70: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/70.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
OpenskyShoppers
Not seeingcurator
messages
@uxceo
Concierge:Purchaseup 20%
Shopperswill buy
from CMS
CMSBlock
OpenSkyShoppers
Thinkcurators
notauthentic
Emailmessages
Shopperswill buy
Concierge:Purchaseup 20%
![Page 71: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/71.jpg)
@uxceo
![Page 72: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/72.jpg)
Success!2x Open Rate3x Purchases
@uxceo
![Page 73: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/73.jpg)
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Shoppers don’tlooks at the home feed,
onlyemails
$0 inRevenue
No CT
Shopperswill buy
from CMS
Concierge:Purchaseup 20%
Shopperswill buy
Concierge:Purchaseup 20%
300%on
purchases
Shoppers like videos,
photos, from curator in
@uxceo
![Page 74: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/74.jpg)
Guess?@uxceo
![Page 75: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/75.jpg)
-$77,000
8 Weeks + 5 People
@uxceo
![Page 76: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/76.jpg)
+$10,000
2 Weeks + 2 People
@uxceo
![Page 77: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/77.jpg)
1. Form your hypothesis
2. Identify your riskiest assumption
3. Decide how you’ll test it
4. Define success
5. Analyze results and try again@uxceo
![Page 78: Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product Decisions](https://reader034.vdocuments.us/reader034/viewer/2022051816/54454b29afaf9f10098b45c2/html5/thumbnails/78.jpg)
Thanks!Download resources at
Javelin.com
@uxceo