dr peter martin city university of london podejście mieszane (mixed mode) – możliwości i...
TRANSCRIPT
![Page 1: Dr PETER MARTIN CITY UNIVERSITY of LONDON Podejście mieszane (mixed mode) – możliwości i ograniczenia VI KONFERENCJA EWALUACYJNA WARSZAWA, 13-14.12.2010](https://reader038.vdocuments.us/reader038/viewer/2022110303/5517141c550346f5558b5581/html5/thumbnails/1.jpg)
dr PETER MARTINCITY UNIVERSITY of LONDON
Podejście mieszane (mixed mode) – możliwości i ograniczenia
VI KONFERENCJA EWALUACYJNAWARSZAWA, 13-14.12.2010
![Page 2: Dr PETER MARTIN CITY UNIVERSITY of LONDON Podejście mieszane (mixed mode) – możliwości i ograniczenia VI KONFERENCJA EWALUACYJNA WARSZAWA, 13-14.12.2010](https://reader038.vdocuments.us/reader038/viewer/2022110303/5517141c550346f5558b5581/html5/thumbnails/2.jpg)
www.europeansocialsurvey.org
Overview
Why Mixed Modes?
Varieties of Mixed Mode Surveys
Mixed Mode Designs: Sequential versus Concurrent Designs
Limitations: Measurement errors, and how to reduce them
Conclusion
![Page 3: Dr PETER MARTIN CITY UNIVERSITY of LONDON Podejście mieszane (mixed mode) – możliwości i ograniczenia VI KONFERENCJA EWALUACYJNA WARSZAWA, 13-14.12.2010](https://reader038.vdocuments.us/reader038/viewer/2022110303/5517141c550346f5558b5581/html5/thumbnails/3.jpg)
www.europeansocialsurvey.org
Survey Modes and their characteristics
![Page 4: Dr PETER MARTIN CITY UNIVERSITY of LONDON Podejście mieszane (mixed mode) – możliwości i ograniczenia VI KONFERENCJA EWALUACYJNA WARSZAWA, 13-14.12.2010](https://reader038.vdocuments.us/reader038/viewer/2022110303/5517141c550346f5558b5581/html5/thumbnails/4.jpg)
www.europeansocialsurvey.org
Varieties of Mixed-Mode Surveys
“Mixed mode survey systems”• Modes of contact with respondent• Modes of data collection
Mixed mode data collection• Mixing modes within an interview: same respondent, different
modes• Mixing modes across interviews: different modes for different
respondents
This is what I am talking about.
![Page 5: Dr PETER MARTIN CITY UNIVERSITY of LONDON Podejście mieszane (mixed mode) – możliwości i ograniczenia VI KONFERENCJA EWALUACYJNA WARSZAWA, 13-14.12.2010](https://reader038.vdocuments.us/reader038/viewer/2022110303/5517141c550346f5558b5581/html5/thumbnails/5.jpg)
www.europeansocialsurvey.org
Mixed Mode Survey Designs: sequential
Idea: Offer the cheapest mode first, the next cheapest second, and the most expensive mode last
Example: American Community Survey
1. Postal questionnaires
2. Telephone interviews
3. Face-to-face interviews
![Page 6: Dr PETER MARTIN CITY UNIVERSITY of LONDON Podejście mieszane (mixed mode) – możliwości i ograniczenia VI KONFERENCJA EWALUACYJNA WARSZAWA, 13-14.12.2010](https://reader038.vdocuments.us/reader038/viewer/2022110303/5517141c550346f5558b5581/html5/thumbnails/6.jpg)
www.europeansocialsurvey.org
Mixed Mode Survey Designs: Concurrent
Idea: Give respondents a choice of mode
But: there is no evidence that freedom of choice increases the motivation to participate!
![Page 7: Dr PETER MARTIN CITY UNIVERSITY of LONDON Podejście mieszane (mixed mode) – możliwości i ograniczenia VI KONFERENCJA EWALUACYJNA WARSZAWA, 13-14.12.2010](https://reader038.vdocuments.us/reader038/viewer/2022110303/5517141c550346f5558b5581/html5/thumbnails/7.jpg)
www.europeansocialsurvey.org
Survey modes: implications for measurement effects
![Page 8: Dr PETER MARTIN CITY UNIVERSITY of LONDON Podejście mieszane (mixed mode) – możliwości i ograniczenia VI KONFERENCJA EWALUACYJNA WARSZAWA, 13-14.12.2010](https://reader038.vdocuments.us/reader038/viewer/2022110303/5517141c550346f5558b5581/html5/thumbnails/8.jpg)
www.europeansocialsurvey.org
Limitations of mixed mode surveys: Measurement effects
Sensory Channel: Hearing: recency effects Sight: primacy effects
Privacy and trust: social desirability bias
Respondent motivation and task difficulty Satisficing
![Page 9: Dr PETER MARTIN CITY UNIVERSITY of LONDON Podejście mieszane (mixed mode) – możliwości i ograniczenia VI KONFERENCJA EWALUACYJNA WARSZAWA, 13-14.12.2010](https://reader038.vdocuments.us/reader038/viewer/2022110303/5517141c550346f5558b5581/html5/thumbnails/9.jpg)
www.europeansocialsurvey.org
Measurement effects: primacy and recency.
A “long list” question
![Page 10: Dr PETER MARTIN CITY UNIVERSITY of LONDON Podejście mieszane (mixed mode) – możliwości i ograniczenia VI KONFERENCJA EWALUACYJNA WARSZAWA, 13-14.12.2010](https://reader038.vdocuments.us/reader038/viewer/2022110303/5517141c550346f5558b5581/html5/thumbnails/10.jpg)
www.europeansocialsurvey.org
Social desirability biasLarge bias (poor quality)
Small bias (good quality)
Telephone Interviews
Face-to-face Interviews
Self-completion questionnaires (post or web)
![Page 11: Dr PETER MARTIN CITY UNIVERSITY of LONDON Podejście mieszane (mixed mode) – możliwości i ograniczenia VI KONFERENCJA EWALUACYJNA WARSZAWA, 13-14.12.2010](https://reader038.vdocuments.us/reader038/viewer/2022110303/5517141c550346f5558b5581/html5/thumbnails/11.jpg)
www.europeansocialsurvey.org
Questionnaire design: unified mode & mode-specific design
(after Dillman et al., 2009, p. 326)
![Page 12: Dr PETER MARTIN CITY UNIVERSITY of LONDON Podejście mieszane (mixed mode) – możliwości i ograniczenia VI KONFERENCJA EWALUACYJNA WARSZAWA, 13-14.12.2010](https://reader038.vdocuments.us/reader038/viewer/2022110303/5517141c550346f5558b5581/html5/thumbnails/12.jpg)
www.europeansocialsurvey.org
Conclusions
Mixing modes can save costs and yield high response rates
But it is not an “easy solution”: mixed mode studies must be carefully designed. A mixed mode survey must have:
A good plan for following up non-respondents (to encourage high response rates)
Careful question and questionnaire design (to reduce measurement effects)
![Page 13: Dr PETER MARTIN CITY UNIVERSITY of LONDON Podejście mieszane (mixed mode) – możliwości i ograniczenia VI KONFERENCJA EWALUACYJNA WARSZAWA, 13-14.12.2010](https://reader038.vdocuments.us/reader038/viewer/2022110303/5517141c550346f5558b5581/html5/thumbnails/13.jpg)
www.europeansocialsurvey.org
Peter MartinCentre for Comparative Social Surveys, London
Thank you !