learning objectives 1 copyright © 2002 south-western/thomson learning questionnaire design chapter...
TRANSCRIPT
Learning ObjectivesLearning Objectives
1
Copyright © 2002 South-Western/Thomson Learning
Questionnaire Design
CHAPTER
eleven
CHAPTER
eleven
Learning ObjectivesLearning Objectives
2
Learning Objectives
1. To understand the role of the questionnaire in the data collection process.
2. To become familiar with the criteria for a good questionnaire.
3. To learn the process for questionnaire design.
4. To become knowledgeable about the three basic forms of questions.
Learning ObjectivesLearning Objectives
3
Learning Objectives
5. To learn the necessary procedures for successful implementation of a survey.
6. To understand how software and the Internet are impacting questionnaire design.
7. To understand the impact of the questionnaire on data collection costs.
Learning ObjectivesLearning Objectives
4
Questionnaire Defined
A set of questions designed to generate the data necessary for accomplishing the objectives of the research project. (interview schedule or control device)
The Critical Link
Positioned between the survey objectives and the respondent’s information.
Translates the objectives into specific questions to solicit information.
(See next figure.)
To understand the role of the questionnaire in the data collection process.
The Role of a Questionnaire
Learning ObjectivesLearning Objectives
5
Figure 11.1 The Questionnaire’s Pivotal Role in the Research Process
Questionnaire
DataAnalysis
Findings
Recommendations
ManagerialAction
Survey Objectives
RespondentInformation
Learning ObjectivesLearning Objectives
6
Does it Provide the Necessary Decision-Making Information?
If the questionnaire fails to provide insights, then discard or revise.
Does it Consider the Respondent?
• Topic
• Type of respondent
• The interviewing environment
• The questionnaire length
To become familiar with the criteria for a good questionnaire.
Criteria For a Good Questionnaire
Learning ObjectivesLearning Objectives
7
Does it meet Editing, Coding and Data Processing Requirements?
Making skip patterns
Code open-ended questions.
To become familiar with the criteria for a good questionnaire.
Criteria For a Good Questionnaire
Learning ObjectivesLearning Objectives
8
A Questionnaire Serves Many Masters• Accommodate research objectives• “Speak” to the respondent in an understandable
language• Convenient for interviewer• Easy to check• Translatable to findings
To become familiar with the criteria for a good questionnaire.
Criteria For a Good Questionnaire
Learning ObjectivesLearning Objectives
9
(1)Survey
Objectives
(2)Data
Collection Methods
(3)Question Response
Format
(4)Question Wording
(5)Flow and Layout
(6)Evaluate Layout
(7)Obtain
Approval
(8)Pretest and
Revise
Figure 11.2
(9)Final Copy
(10)Implementatio
n
The Questionnaire Design Process
Learning ObjectivesLearning Objectives
10
The Questionnaire Design Process:
Step One: Determine Survey Objectives, Resources, and Constraints
What data are needed?
Step Two: Determine the Data Collection Method
Internet, telephone, mail, self-administration
To learn the process for questionnaire design.
The Questionnaire Development Process
Learning ObjectivesLearning Objectives
11
The Questionnaire Design Process:
Step Three: Determine the Question Response Format
• Open-ended Questions
• Close-ended Questions
• Dichotomous Questions
• Multiple Choice Questions
• Scaled-Response Questions
Pros and Cons to all of these
To learn the process for questionnaire design.
The Questionnaire Development Process
Learning ObjectivesLearning Objectives
12
The Questionnaire Design Process:
Step Four: Decide the Question Wording
1. The wording must be clear.
2. Select words so as to avoid biasing the respondent.
3. Consider the ability of the respondent to answer the question.
4. Consider the willingness of the respondent to answer the question.
To learn the process for questionnaire design.
The Questionnaire Development Process
Learning ObjectivesLearning Objectives
13
What’s wrong with the following questions?
1. How do you like the flavor of this high-quality Maxwell House coffee?
2. What do you think of the taste and texture of this Sara Lee coffee cake?
3. We are conducting a study for Bulova watches. What do you think of the quality of Bulova watches?
4. How many days do you sleep until 8:00 a.m.?
To learn the process for questionnaire design.
The Questionnaire Development Process
Learning ObjectivesLearning Objectives
14
Step Five: Establish Questionnaire Flow and Layout
1. Use the screener questions to identify qualified respondents.
2. After obtaining a qualified respondent, begin with a question that obtains a respondent’s interest.
3. Ask general questions first.
4. Ask questions that require “work” (e.g., recall) in the middle of the questionnaire.
To learn the process for questionnaire design.
The Questionnaire Development Process
Learning ObjectivesLearning Objectives
15
Step Five (Continued): Establish Questionnaire Flow and Layout
5. Insert “prompters” at strategic points (e.g., “only a few questions to go)
6. Position sensitive, threatening, and demographic questions at the end.
7. Allow plenty of space of open-ended responses.
8. Put instructions in capital letters.
To learn the process for questionnaire design.
The Questionnaire Development Process
Learning ObjectivesLearning Objectives
16
The Questionnaire Design Process:
Step Six: Evaluate the Questionnaire and Layout
• Is the Question Necessary?
• Is the Questionnaire Too Long?
• Will the Questions Provide the Desired Information to Accomplish the Research Objective?
To learn the process for questionnaire design.
The Questionnaire Development Process
Learning ObjectivesLearning Objectives
17
The Questionnaire Design Process:
Step Seven: Obtain Approval of All Relevant Parties
Distribute copies to all parties with authority
Step Eight: Pretest (Trial) and Revise
Use the best interviewers
To learn the process for questionnaire design.
The Questionnaire Development Process
Learning ObjectivesLearning Objectives
18
The Questionnaire Design Process:
Step Nine: Prepare Final Questionnaire Copy
Precise typing, instructions, spacing, numbering, and pre-coding must be set up, monitored, and proofread.
Step Ten: Implementing the Survey
Supervisor’s Instructions
Call record sheet
To learn the process for questionnaire design.
The Questionnaire Development Process
Learning ObjectivesLearning Objectives
19
Field Management Companies
Provide questionnaire outsourcing services
Software for Questionnaire Development
Examples in text
How software and the Internet are influencing questionnaire design.
Software and the Internet on Questionnaire Development
Learning ObjectivesLearning Objectives
20
Understanding questionnaire costs:
• Adding screeners can add to costs
• Termination during an interview
• subject matter
• redundant or difficult
• questionnaire length
• changing the subject
Understanding the impact of the questionnaire on data collection costs.
Costs and Profitability
Learning ObjectivesLearning Objectives
21
Figure 11.3 Actual Respondent Termination Patterns in Three Categories
Mouthwash
Gum
Leisure
10
8
6
4
2
0
1 4.9 9.7 14.6 19.4 24.3
Minutes
Learning ObjectivesLearning Objectives
22
• The Role of a Questionnaire
• Criteria For a Good Questionnaire
• The Questionnaire Development Process
• Software and the Internet on Questionnaire Development
• Internet Self-Service Questionnaire Builders
• Costs and Profitability
SUMMARY
Learning ObjectivesLearning Objectives
23
The End
Copyright © 2002 South-Western/Thomson Learning