research rebooted: market research is broken, how lean can help fix it #leandaywest
TRANSCRIPT
![Page 1: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/1.jpg)
Research RebootedWhy Most Market Research Is Broken,
And How Lean Can Help Fix It
![Page 2: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/2.jpg)
what’s wrong with research?
![Page 3: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/3.jpg)
the value is broken.
![Page 4: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/4.jpg)
$30,000,000,000+
![Page 5: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/5.jpg)
time.it’s in a box. and it slips.
![Page 6: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/6.jpg)
information request
research RFP
study design
recruitment
fielding
Analysis
Brand/product team
research & insights
research company
recruiter/panel
moderators
research company
![Page 7: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/7.jpg)
The CEO’s Kids
“I keep a lot of kids around me and ask them questions and peek around the corner when they think I'm not listening. My master plan was I had a lot of kids. I have six kids. Three girls that are six, a 15-year-old, 18-year-old and 22-year-old. I have the perfect research team in my house."
http://acupofteawithphd.wordpress.com/2013/06/19/live-from-cannes-cannes-lions-2013-so-farpart-4-its-diddy/
![Page 8: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/8.jpg)
the design is broken.
![Page 9: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/9.jpg)
The fear of small numbersManagers worry about the signal-to-noise ratio.
The smaller the sample, the more we worry about noise (wrong people, inaccuracies or untruths, groupthink, etc.)
So they compensate with bigger sample sizes.
But more numbers make more noise.
![Page 10: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/10.jpg)
over targeting leads us astray
“[M]ost companies with a practiced discipline of listening to their best customers and identifying new products that promise greater profitability and growth are rarely able to build a case for investing in disruptive technologies until it is too late.”
- Clay Christensen, The Innovator’s Dilemma
![Page 11: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/11.jpg)
research is often designed to confirm biases.when it doesn’t, it’s painful.
![Page 12: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/12.jpg)
our customer or our design target?
![Page 13: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/13.jpg)
research ignores switchers, rejectors, fringe & new users
“Generally, disruptive technologies underperform established products in mainstream markets. But they have other features that a few fringe (and generally new) customers value.”
- Clay Christensen, The Innovator’s Dilemma
![Page 14: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/14.jpg)
the process is broken.
![Page 15: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/15.jpg)
garbage in, garbage out
“The research manager’s job is to manage the hell out of the research.”
- Michelle Crawford
![Page 16: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/16.jpg)
quant über alles
![Page 17: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/17.jpg)
packing 10 lbs into a 5 lb bag
30 minute surveys
2 hour focus groups
10 page discussion guides
Too many questions, too much data, not enough understanding
![Page 18: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/18.jpg)
stockpiling data
![Page 19: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/19.jpg)
trapping insight in powerpoint decks
![Page 20: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/20.jpg)
It's really hard to design products by focus groups. A lot of times,
people don't know what they want until you show it to them.
- Steve Jobs
![Page 21: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/21.jpg)
![Page 22: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/22.jpg)
you ≠ steve jobs.
![Page 23: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/23.jpg)
research ≠ designResearch is the process by which we
understand problems.
Design is the process by which we solve problems.
![Page 24: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/24.jpg)
how lean can help fix research.
![Page 25: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/25.jpg)
what is a lean company for?
1. To specify customer value.
2. To identify & implement the actions that create that value.
3. To remove anything that doesn’t create value.
4. To analyze the results (and repeat).
![Page 26: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/26.jpg)
why does feedback & customer pull matter?
Feedback and testing (a.k.a., research) help teams settle questions and make decisions based on evidence not preferences.
Continuous feedback helps teams see progress.
![Page 27: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/27.jpg)
Go and see.This is the new intimacy.
![Page 28: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/28.jpg)
how do we do lean research?
![Page 29: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/29.jpg)
the owner has to change
![Page 30: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/30.jpg)
empower the research manager
We have to transform the research manager from a project manager into a Scrum master.
Their role is to remove obstacles to progress, and to facilitate communication.
Their responsibility to the team is to facilitate hypothesis testing, and to create opportunities to challenge assumptions.
![Page 31: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/31.jpg)
validation
![Page 32: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/32.jpg)
the tools have to change
![Page 33: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/33.jpg)
use right-sized tools
![Page 34: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/34.jpg)
Use the tools closest to hand
![Page 35: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/35.jpg)
![Page 36: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/36.jpg)
Talk to people where it’s relevant or convenient
i.e., NOT HERE
![Page 37: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/37.jpg)
talk to them here.
![Page 38: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/38.jpg)
the whole team can do this.
http://giffconstable.com/2010/07/12-tips-for-early-customer-development-interviews/
![Page 39: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/39.jpg)
the flow has to change
![Page 40: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/40.jpg)
Do less, more oftenLean research is about continuous
customer, partner & team feedback.
![Page 41: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/41.jpg)
set people up for success
![Page 42: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/42.jpg)
the output has to change.
![Page 43: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/43.jpg)
data doesn’t “tell” you what to do.
![Page 44: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/44.jpg)
![Page 45: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/45.jpg)
nothing beats a conversation.
To make research meaningful to the whole team, the whole team needs:
Investment
Access
Accountability
![Page 46: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/46.jpg)
forget the horse’s mouth
Don’t count on users to make your decisions for you - that’s not their job.
Don’t let the report be the end of your learning process - it’s just a way to memorialize what you’ve learned and provide a reference when you encounter similar issues again.
![Page 47: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/47.jpg)
information should be reusable, not disposable.
![Page 48: Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leandaywest](https://reader031.vdocuments.us/reader031/viewer/2022022415/54244b488d7f72b0288b46b9/html5/thumbnails/48.jpg)
watch this space.and thanks, this was fun.