contextual surveys - going asynchronous for more context (by bas de luij)
TRANSCRIPT
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
Contextual Surveys
going asynchronous for more context
Bas de Luij
@basdeluy
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
At InSites Consulting we
believe that market research
should shift
• From validation to collaboration
• From asking questions to observing,
facilitating, and joining conversations
• From ad hoc and post hoc to always-on
and in-the-moment
• From rational thinking to emotional
sensing
Our vision
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
How can we live up to
this vision in quant
surveys?
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
Are surveys a dead end
approach?
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
Are surveys a dead end
approach?
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
Rethink and take it step
by step
• How can we inspire both clients and
participants in more engaging surveys?
• How can we tell a lively story about
customers? And bring rich context next to
numbers and graphs?
• How can we can make people generate
information?
Our challenge
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
Fusing methods, stretching boundaries
Fusion
Using the „goods‟ of qualitative
This means:
- Stretching the boundaries of quantitative
research by adding (ethnographic) tasks next
to questions
- photo, video, explore their environment
- Stretching the boundaries of our profession by
adding co-research elements
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
platform within a survey
no moderation, but automation ethnographic tasks next to questions
co-researcher tasks
Interview a peer
explore your environment
make pictures
enables participants to
come back over time to complete in later stage
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
4th of July project
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
Your 4th of July party
Upload 6 pictures of you drinking and or eating at the party. And describe your decision on what you are drinking or eating at that moment with as much detail as possible: - Why this food/drink? - Why this moment? How did/do you feel? - Why this brand? - What are your thoughts when eating/drinking? Good luck!
Example task
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
ForwaR&D lab test
Investigate the borders of task-based research in surveys
Investigate to what extent participants are capable and
willing of taking up a researcher‟s role in surveys
Add-on
Find proof for contextual surveys being a good qualitative
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
ForwaR&D lab test
Investigate the borders of task-based research in surveys
Panel members are quite willing to
participate in this type of survey.
38% (n=201)
62%
Yes
N
o
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
ForwaR&D lab test
Investigate the borders of task-based research in surveys
Contextual respondents show a drop in
their responses.
30% completed >80% of tasks
70% completed <80% of tasks
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
ForwaR&D lab test
Investigate the borders of task-based research in surveys
Leading to over
700 photos
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
ForwaR&D lab test
Investigate the borders of task-based research in surveys
Photo quality differs quite a lot.
~500 high quality/high relevance
~200low relevance/“google images”
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
Investigate the borders of task-based research in surveys
This type of research adds a new
dimension to “straight lining”.
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
ForwaR&D lab test
Participants found it hard to complete the
co-research tasks (interview someons at
the party)
- Don‟t like to interrupt party people
- Found it hard to convince people to
take part
- Didn‟t like the idea of putting pictures
online
Investigate to what extent participants are capable and
willing of taking up a researcher‟s role in surveys
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
ForwaR&D lab test
Add-on
Find proof for contextual surveys being a good qualitative
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
ForwaR&D lab test
Add-on
Find proof for contextual surveys being a good qualitative
consumer story dashboard
to slice, dice, deep zoom into content
fun, engaging, interactive experience
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
60%
80% Of Americans who celebrate the 4th of July attend/organize a backyard barbeque.
4th of July (survey only)
Is (very) likely to consume beer during
this barbecue
Typical food at their party
Hamburgers 26%
Hot dogs 22%
Ribs 6%
Potato salad 6%
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
4th of July (+contextual)
Unpretentious, relaxed, casual, food mostly home-
made, using all American brands.
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
ForwaR&D lab test
The high quality responses truly enrich our
data.
Pictures, personal stories and visual material
bring our respondents to live.
The consumer story dashboard allows us and
clients to immerse into their stories
Add-on
Find proof for contextual surveys being a good qualitative
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
Forward lab test
“Very cool and different survey”
“I think this survey was pretty fun! :)”
“good survey, i like this format.”
“Interesting survey...wouldn't mind
doing another in the near future”
“I like this survey, it was fun”
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
To conclude…
1. High potential
2. Added value for clients
Deliver ‘best’ of both worlds
3. Learn more, improve
more
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
Q & A
Ray Poynter
VCU, Vision Critical
Bas de Luij
InSites Consulting
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
Thank you
@basdeluy
Bas de Luij
Bas de Luij, InSites Consulting, Netherlands NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
Thank you
@basdeluy
Bas de Luij