introduction to primary market research

Post on 17-Nov-2014

103 Views

Category:

Business

1 Downloads

Preview:

Click to see full reader

DESCRIPTION

This talk is targeted towards a technical audience (e.g. engineers and scientists) who are encountering primary market research (PMR) for the first time in their quest to build a great product that solves real life problems. In this talk, we first explore why PMR is important, then we use a real life product example to look at how different research methodologies can be used to answer questions and validate hypotheses at different stages of the product development process. We close the talk by offering some tips and tricks to help people get started with PMR.

TRANSCRIPT

© 2014 ConceptSpring1

Introduction to Primary Market Research

Elaine Chen

© 2014 ConceptSpring2

Why do primary market research?

© 2014 ConceptSpring3 Can you imagine the needs/wants of Katie, a college student?

© 2014 ConceptSpring4 How about Melanie, Dir of Operations for a major trucking company?

© 2014 ConceptSpring5 …or Jorge, master dental lab tech specializing in dentures?

© 2014 ConceptSpring6 …or Josephine, a mom of 3 with no access to clean water?

© 2014 ConceptSpring7

© 2014 ConceptSpring8

Some quantitative examples –

via the story of a showerhead

© 2014 ConceptSpring9

Showerhead landscape – circa 1996

Price$2 $200+

Experience

Basic

Premium

© 2014 ConceptSpring10

Showerhead landscape – circa 1996

Price$2 $200+

Experience

Basic

Premium

© 2014 ConceptSpring11 Our charter: figure out what constitutes a “great shower”

© 2014 ConceptSpring12

How do we go about defining a

“great shower experience”?

© 2014 ConceptSpring13 Engineering data collection: measure shower temp, pressure etc

© 2014 ConceptSpring14 Immersion: take showers and pay close attention

© 2014 ConceptSpring15 Longitudinal studies: keep a diary on product usage over several days

© 2014 ConceptSpring16 Interviews: open ended conversations with buyers and users

© 2014 ConceptSpring17 Observation: watch others take showers

© 2014 ConceptSpring18

Showerhead project summary

• Broad and non-specific problem statement: • “Define a great shower experience”

• Highly specific and technical outcome required: • “Build us a showerhead that delivers this experience, and

gets us back into the lead”

• How we bridged the gap: 1. Define the question to ask / hypothesis to test2. Choose the best PMR methodology to answer those

questions / validate those hypotheses

© 2014 ConceptSpring19

Picking the right methodologies

Question posed Research methodology chosen Qualitative or quantitative?

Who buys showerheads?

Detailed interviews Qualitative

What makes a great shower experience?

Detailed interviewsImmersion

Qualitative

What is the detailed use case?

ImmersionObservation

Qualitative

What are the technical specs?

Usability studies in the instrumented shower Qualitative +Quantitative

© 2014 ConceptSpring20

Picking the right methodologies

Question posed Research methodology chosen Qualitative or quantitative?

Who buys showerheads?

Detailed interviews Qualitative

What makes a great shower experience?

Detailed interviewsImmersion

Qualitative

What is the detailed use case?

ImmersionObservation

Qualitative

What are the technical specs?

Usability studies in the instrumented shower Qualitative +Quantitative

We are in discovery mode for this project…

© 2014 ConceptSpring21

Picking the right methodologies

Question to pose Research methodology chosen Qualitative or quantitative?

Who buys showerheads?

Detailed interviews Qualitative

What makes a great shower experience?

Detailed interviewsImmersion

Qualitative

What is the detailed use case?

ImmersionObservation

Qualitative

QualitativeWhat are the technical specs?

Usability studies in the instrumented shower Qualitative +Quantitative

…and the best techniques to use are qualitative methodologies

© 2014 ConceptSpring22

Common methodologiesQualitative (<30 samples)• Detailed interview• Observation / shadowing• Immersion• Longitudinal diary study• Photo essay• Usability benchmark• Focus groups• … etc

Quantitative (>1000 samples)• Surveys

• On line surveys• Conjoint analysis• Pricing studies

• Monadic

• Multiple monadic

• Van Westendorp

• … etc

• Customer satisfaction: NPS, P/M fit

• Web testing• A/B split, Multivariate• Web analytics• … etc

Here is an overview of common research methodologies

© 2014 ConceptSpring23

Shower projectQualitative (<30 samples)• Detailed interview• Observation / shadowing• Immersion• Longitudinal diary study• Photo essay• Usability benchmark• Focus groups• … etc

Quantitative (>1000 samples)• Surveys

• On line surveys• Conjoint analysis• Pricing studies

• Monadic

• Multiple monadic

• Van Westendorp

• … etc

• Customer satisfaction: NPS, P/M fit

• Web testing• A/B split, Multivariate• Web analytics• … etc

For the shower project, qualititative is the way to go

© 2014 ConceptSpring24

Qualitative, then quantitative

A qualitative pass can help you design a great quantitative program

© 2014 ConceptSpring25

“This is a fine piece of research--thoughtfully designed, deeply instrumented, and genuinely interesting in asking and answering important questions. And it is especially gratifying to note the result: this is the highest priced showerhead at Lowe's now, but still their best seller. It is a solid example of what breakthrough design should do: create premium value for enterprises, while giving customers something they love and think is worth the money.”

Larry Keeley, IDSA, President, Doblin, Inc.

Image credit: continuuminnovation.com

End result: the new showerhead took back the #1 position

© 2014 ConceptSpring26

Some quantitative examples

© 2014 ConceptSpring27Image credit: groupquality.comOn-line surveys are good for statistically meaningful results

© 2014 ConceptSpring28

Image credit: netpromotersystem.com

Net Promoter Score and similar surveys can quantify customer satisfaction

© 2014 ConceptSpring29

Photo credit: 5circles.com

Pricing studies like the Van Westendorp method quantify price elasticity

© 2014 ConceptSpring30

PMR recap

• There are many techniques you can use in primary market research – you have a choice. Pick the tool that best suits your needs.

• Before you begin, clearly state your hypotheses. What questions are you trying to ask? Depending on the question, you can choose the right methodology.

• PMR combined with traditional engineering R&D bridges the gap between market needs and engineering specification. It helps you build the right thing for the right people.

© 2014 ConceptSpring31

How to run a great research project

© 2014 ConceptSpring32

What, How, Who

• Define the WHAT:• Clearly articulate hypotheses to be tested – these form the

core of your goals and objectives

• Define the HOW:• Pick a methodology• Develop content for the methodology (e.g. discussion guide;

survey design; etc)• Develop a project plan (including who-does-what-when)

• Define the WHO:• Define the profile of the subject• Develop a subject recruitment questionnaire

© 2014 ConceptSpring33

Customer / Problem Related Hypotheses

33

© 2014 ConceptSpring34

Product / Solution related hypotheses

© 2014 ConceptSpring35

Business Model Hypotheses

35

Emails sent

Click through

Signed up for trial

Began using product

Converted to paid subscriber

Free Beta

500

40%

80%

100%

N/A

30 day trial to paid subscription

5000

14%

1 subscriber

© 2014 ConceptSpring36

Example recruitment questionnaire

• What is your age, gender and profession? (terminate once age/gender quota has been filled for the matching segment)

• What is your household income? (terminate if <$xxk)

• Are you interested in learning more about your sleep? (terminate if not)

• Are you currently encountering sleep problems? (terminate if not)

• Are you currently under the care of a doctor for your sleep issues? (terminate if true)

• How many nights in an average week are you encountering sleep issues? (select between 2-5)

• Please describe the sleep issues you are currently encountering (check all that apply). (cannot fall asleep; multiple awakenings; cannot go back to sleep after awakening; snoring spouse; etc)

• Do you currently share your bed? (partner, child, pet) If so: how many nights in an average week is your sleep affected by your bed partner(s)?

© 2014 ConceptSpring37

Example discussion guide• Welcome / ice breakers

• Introductions / purpose of visit

• Sleep - description• Tell me the story of sleep in this house.

Who all sleeps here? Where do they sleep?

• Tell me what happens in each 24h cycle for you as it applies to sleep.

• Sleep locations: where are all the places you personally sleep in the course of a year? Travel? Second home? Etc

• What does the word “Sleep” mean to you?

• What is the gold standard for sleep?

• House tour: can you show me all the places that you and your family members / housemates sleep in this house?

• Sleep – problems, attitudes, perceptions– Tell me about your sleep problems (what,

where, when, how long ago did it start)

– What have you done so far to address your sleep problems?

– What does the phrase “a good night’s sleep” mean to you?

– What comes to mind if I mention “A bathroom scale for sleep”?

• Technology profile– What cell phone do you use? What about

laptops? Other electronics products?

• Action attitude– When you need to learn about something,

where do you go for information?

© 2014 ConceptSpring38

To record or not to record?(I do – pros outweigh cons)

© 2014 ConceptSpring39

On technique

© 2014 ConceptSpring40Don’t sell - it’s not a sales call

© 2014 ConceptSpring41Keep your eyes and ears open

© 2014 ConceptSpring42Have an open mind

© 2014 ConceptSpring43

Technique cheat sheet for detailed interviews

• Clearly state hypotheses to test• Establish rapport before you begin• Ask short, open ended questions. “Tell me the story

of…”, “say more…”, “Why?” “Why not?”• Let the subject lead the conversation• Use active listening techniques: “I think I heard you

say xxx. Is that right?”• Talk very little. Success = they talk 95% of the time,

you talk 5% of the time (most of which is during set up and wrap up)

43

© 2014 ConceptSpring44

Technique cheat sheet for on-line surveys

• Clearly define goals and objectives• Ask effective questions to meet research goals• Decide on length of survey (how many minutes?)• Use skip logic judiciously to shorten completion time• Be smart about answer formats• Closed ended: radio buttons, checkboxes, • Open ended: text boxes

• Carefully consider which q’s should be required• Demographics and contact info at the end, please• Carrots!

44

© 2014 ConceptSpring45

Getting started with primary market research

• Articulate 3-5 hypotheses to be tested• Define characteristics of research subjects• Make a list of 30 people to call• Ask for 10-15 minutes of their time• Talk to them face to face if possible, via video Skype

if not• Interpret results, adjust hypotheses• Rinse and repeat

© 2014 ConceptSpring46

Summary

• Primary market research is a science and an art • Primary market research is learnable• Primary market research saves you time & $ - do it!• Plan your research before talking to anybody• Talk to humans face to face if possible

© 2014 ConceptSpring47

© 2014 ConceptSpring48@chenelaine blog.conceptspring.com

Thank you

top related