Covering the general population by Internet

interviewing

Marcel Das

19-04-23

1

MESS Project

• core element: LISS panel

• other key elements:

- core study

- experimental modules

- new forms of data collection

- links with administrative data

- special groups

19-04-23

2

Core element: LISS panel

Online panel of 5,000 households 8,000 individuals (>= 16 years)

Questionnaires each month, 30 min.

Incentive 15 euro an hour (average)

For scientific use, at no cost

19-04-23

3

LISS panel Online interviews as method, but:

Probability sample drawn from address sampling frame of Statistics Netherlands

Includes households without Internet access (less than 15%): CentERdata provides equipment

Contacted by letter, telephone or visit19-04-23

4

simPC

Very small and silent

Only the most frequently used functions

Automatic maintenance, safety

Simple operation and readable screens

Installation and support19-04-23

5

19-04-23

6

Internet interviews

letter and brochure

short interview

simPC and adsl

households with Internet

households without Internet

confirmation

panel question

Recruitment

19-04-23

7

Internet interviews

letter and brochure

short interview

simPC and adsl

confirmation

panel question

Primary response

target: 80%

Secondary response

target: 60%

Tertiary response

target: 53%

Response

Recruitment

experiment

19-04-23

8

Experimental design CATI CAPI N

Special letter

Standard letter

Special letter

Standard letter

Prepaid incentive

Introduce panel in letter 0 euro 10 euro 200

Introduce panel after interview

20 euro 50 euro 300

Promised incentive

Introduce panel in letter

0 euro 10 euro 400

Introduce panel after interview

50 euro 20 euro 300

N 200 200 400 400 1200

CATI = Computer Assisted Telephone InterviewingCAPI = Computer Assisted Personal Interviewing

Set up main recruitment

• Combination CATI – CAPI, follow up CAPI

• Prepaid 10 euro incentive

• Promised extra 10 euro incentive for starting

• Attention to design letter and brochure

19-04-23

9

Results

19-04-23

10

Pilot versus main response rates

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

primary secondary tertiary

response

pro

po

rtio

n o

f to

tal

Pilot

Main

Non-response patternsSimilar to those of other leading

scientific panels

Superior to commercial access and volunteer panels:

- no coverage problems

- no selfselection

19-04-23

11

Attention for difficult groups

Correction by oversampling in refreshment of 2009 (with Statistics Netherlands)

New immigrant panel (with Cross-cultural Psychology, Tilburg University and Statistics Netherlands)

19-04-23

12

Correction of bias by stratified refreshment

sample 2009

19-04-23

13

GroupPopulation

2007 %

April 2008Bias

April 2009Bias

Jan 2010 Bias

Age >=70 11.6 -5.4 -5.4 -2.8

Living alone 19.2 -5.4 -5.0 -2.4

Non-western immigrant

9.6 -5.1 -4.8 -3.7

Persons

New forms of data collection

19-04-23

14

Use of graphical or animated presentation

19-04-23

15

Biomarkerspilot study: blood cholesterol, saliva cortisol, and waist

circumference

19-04-23

16

More biomarker experiments...- accelerometers

- advanced scales (based on bioelectrical impedance)

link objective data with self-report data

high frequency measurement

19-04-23

17

Use of the LISS panel

19-04-23

18

Questionnaires

The “household box”

Experimental modules open to academic researchers at no cost

Core study

19-04-23

19

Experimental modules

Who can use the LISS panel:every researcher who wants to collect data for scientific, policy or societal relevant research

Scientific research: Academic researchers, irrespective of nationality, can use the LISS panel at no cost

Proposals can be submitted throughout the year

19-04-23

20

Proposals: Summary (May 2010)

19-04-23

21

Decision Board of Overseers Count

Undecided (in review or revision) 14

Accepted 49

Rejected 10

Total 73

Proposals: Examples

19-04-23

22

Proposal Affiliation(s) Perceptions of nutrigenomics Twente University (NL)

Mental health Radboud University, Nijmegen (NL); Emory University (USA)

Subjective well-being Max Planck Institute for Human Development, Berlin (Germany)

Computer crime victimization Leiden University (NL)

Volunteer work University of Duisburg / Mannheim (Germany)

Open-ended questions University of Michigan (US)

Identification of guilt sensitivity University of Laval (Canada)/Copenhagen (Denmark)

Available data Who can use the LISS data:every researcher who wants to use data for scientific, policy or societal relevant research

Use of data is free of charge (unless data are used for research funded by means of external sources)

Available data: longitudinal core study proposed studies

19-04-23

23

Longitudinal core study

Household and family Economic situation and housing Work and schooling Social integration and leisure Health Personality Religion and ethnicity Politics and values

19-04-23

24

LISS data

Disseminated through website / data archive: http://www.lissdata.nl

Database is based on an internationally used specification for describing social science data (DDI): one of the first implementations of DDI version 3

Search entry with keyword and on concept, topic, and study (relational)

Exchangeable with other data archives

19-04-23

25

October 2010 Publisher: Routledge / Taylor & Francis Group

19-04-23

27