dr. michael r. hyman, nmsu questionnaire design. 2
Post on 21-Dec-2015
222 views
TRANSCRIPT
![Page 1: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/1.jpg)
Dr. Michael R. Hyman, NMSU
Questionnaire Design
![Page 2: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/2.jpg)
2
![Page 3: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/3.jpg)
3
A Good Questionnaire
• Appears as easy to compose as a good poem
• But, usually the result of long, painstaking work
![Page 4: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/4.jpg)
4
Developing a Questionnaire
• No hard and fast rules
• Only guidelines
![Page 5: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/5.jpg)
5
Major Decisions in Questionnaire Design
• What should be asked?
• How should each question be phrased?
• In what sequence should the questions be arranged?
• What questionnaire layout will best serve the research objectives?
• How should the questionnaire be pre-tested? Should it be revised?
![Page 6: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/6.jpg)
6
Screener and Filter Questions
![Page 7: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/7.jpg)
7
![Page 8: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/8.jpg)
8
![Page 9: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/9.jpg)
9
Filter Question
![Page 10: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/10.jpg)
10
Skip Patterns
![Page 11: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/11.jpg)
11
![Page 12: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/12.jpg)
12
Skip Patterns
![Page 13: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/13.jpg)
13
Use multiple visual elements to improve skip pattern compliance
![Page 14: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/14.jpg)
14
Questionnaire Organization
• Logical flow
• Usually go from general to specific
• Ask sensitive questions later
![Page 15: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/15.jpg)
15
Selecting the first question for a questionnaire
![Page 16: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/16.jpg)
16
![Page 17: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/17.jpg)
17
![Page 18: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/18.jpg)
18
Layout Considerations
• Use of booklets
• Color coding
• Question numbering
• Fitting questions on a page
• Instructions (skip and otherwise)
• Use of typeface and blank space
• Pre-coding
![Page 19: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/19.jpg)
19
Instructions
![Page 20: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/20.jpg)
20
Place instructions exactly where needed and not a separate section at the beginning of questionnaire
![Page 21: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/21.jpg)
21
Write special instructions as part of question, not as free-standing entities
![Page 22: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/22.jpg)
22
Poor information organization with unclear navigational path
![Page 23: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/23.jpg)
23
![Page 24: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/24.jpg)
24
Typeface and Blank Space
![Page 25: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/25.jpg)
25
Maintain simplicity, regularity, and a consistent figure/ground format to make respondent’s task easier
![Page 26: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/26.jpg)
26
Increase size and brightness of visual elements to emphasize order for reading questionnaire information
![Page 27: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/27.jpg)
27
Emphasize words and phrases in questions consistently, but sparingly
![Page 28: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/28.jpg)
28
Change spacing and similarity to identify appropriate groupings of visual elements
![Page 29: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/29.jpg)
29
Answer Format
![Page 30: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/30.jpg)
30
Answer categories may be placed to left or right of category tables
![Page 31: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/31.jpg)
31
Place items with the same response categories in an item-in-a-series format
![Page 32: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/32.jpg)
32
Consistently run scales in one direction (e.g., negative to positive) throughout the questionnaire to overcome separation of answer box from descriptor
![Page 33: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/33.jpg)
33
Eliminate check-all-that-apply question formats
![Page 34: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/34.jpg)
34
![Page 35: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/35.jpg)
35
Change mail and telephone questions into uni-mode format
![Page 36: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/36.jpg)
36
![Page 37: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/37.jpg)
37
1a. How many years have you been playing tennis on a regular basis? Number of years: __________
b. What is your level of play?
Novice . . . . . . . . . . . . . . . -1 Advanced . . . . . . . -4Lower Intermediate . . . . . -2 Expert . . . . . . . . . -5Upper Intermediate . . . . . -3 Teaching Pro . . . . -6
c. In the last 12 months, has your level of play improved, remained the same or decreased?
Improved. . . . . . . . . . . . . . -1 Decreased. . . . . . . -3Remained the same . . . . . -2
Pre-coded Questionnaire
![Page 38: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/38.jpg)
38
2a. Do you belong to a club with tennis facilities? Yes . . . . . . . -1No . . . . . . . -2
b. How many people in your household - including yourself - play tennis?Number who play tennis ___________
3a. Why do you play tennis? (Please “X” all that apply.)
To have fun . . . . . . . . . . -1To stay fit. . . . . . . . . . . . -2To be with friends. . . . . . -3To improve my game . . . -4To compete. . . . . . . . . . . -5To win. . . . . . . . . . . . . . . -6
b. In the past 12 months, have you purchased any tennis instructional books or video tapes? Yes . . . . . . . -1
No . . . . . . . -2
![Page 39: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/39.jpg)
39
Dear Passenger:
American Airlines is pleased to have you on board today.
To help us provide the best service possible, we need to know more about you and your opinions of our service. If you are over 11 years old, we would appreciate it if you would complete this questionnaire.
Your flight attendant will pick up your completed questionnaire shortly.
Thank you.
Pre-coded Questionnaire
![Page 40: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/40.jpg)
40
1. Please indicate: Flight number ___________ Date_____________
2a. At the city where you boarded this particular plane, did you make a connection from another flight?
Yes, from American . . . . 1Yes, from Other Airline . . 2No . . . . . . . . . . . . . . . . . . 3
b. Did you board this plane at the airport from which it just took off, or were you a through passenger for which that was an intermediate stop?
Boarded here . . . . . . . . . . 1Through passenger. . . . . . 2
3. How would you rate the overall service from American for this flight, all things considered, from your arrival at the airport terminal until now?
Excellent Good Fair PoorOverall Service . . . . . . . . . . 1 2 3 4
![Page 41: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/41.jpg)
41
4. Please rate each of the following with regard to this flight, if applicable.
Excellent Good Fair Poor
1 2 3 4Courtesy and Treatment from the: Skycap at airport . . . . . . . . . . . . . . Airport Ticket Counter Agent . . . . . Boarding Point (Gate) Agent . . . . . Flight Attendants . . . . . . . . . . . . . .Your Meal or Snack. . . . . . . . . . . . .Beverage Service . . . . . . . . . . . . . .Seat Comfort. . . . . . . . . . . . . . . . . . Carry-On Stowage Space. . . . . . . .Cabin Cleanliness . . . . . . . . . . . . . Video/Stereo Entertainment . . . . . .On-Time Departure . . . . . . . . . . . .
![Page 42: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/42.jpg)
42
Pre-coded Questionnaire
![Page 43: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/43.jpg)
43Pre-coded Questionnaire
![Page 44: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/44.jpg)
44
![Page 45: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/45.jpg)
45
Sample Questionnaire Layouts
![Page 46: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/46.jpg)
46
Bad Layout
![Page 47: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/47.jpg)
47
Better Layout
![Page 48: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/48.jpg)
48
![Page 49: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/49.jpg)
49
Page from a double-column formatted questionnaire on letter size paper
![Page 50: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/50.jpg)
50
Facing pages from a single column, full-page format using folded legal size paper
![Page 51: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/51.jpg)
51
Cover Letters
![Page 52: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/52.jpg)
52
Guidelines for Cover Letters
• Indicate bona fide survey
• Identify ‘sponsor’ early in process
• Describe survey’s purpose clearly and simply
• Indicate how prospective respondents selected
• Solicit prospective respondent’s help
![Page 53: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/53.jpg)
53
Cover Letter Appraisal Checklist
![Page 54: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/54.jpg)
54
Possible Cover Letter Appeals
![Page 55: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/55.jpg)
55
![Page 56: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/56.jpg)
56
Sample Letters for University-sponsored Survey
![Page 57: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/57.jpg)
57
![Page 58: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/58.jpg)
58
![Page 59: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/59.jpg)
59
![Page 60: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/60.jpg)
60
![Page 61: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/61.jpg)
61
![Page 62: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/62.jpg)
62
![Page 63: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/63.jpg)
63
![Page 64: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/64.jpg)
64
![Page 65: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/65.jpg)
65
Non-university Cover Letter
![Page 66: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/66.jpg)
66
Pre-testing is Important
![Page 67: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/67.jpg)
67
Pre-testing Decisions
• What items should be pre-tested?
• How should pre-test be conducted?
• Who should conduct pre-test?
• Who should be respondents in pre-test?
• How large should sample be for pre-test?
![Page 68: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/68.jpg)
68
Internet Surveys
![Page 69: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/69.jpg)
69
Layout for Internet Questionnaires
• Graphical User Interface (GUI)
• Paging layout going from screen to screen
• Scrolling layout gives the respondent the ability to scroll down
• Push buttons
• Status bar
![Page 70: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/70.jpg)
70
Common Question Displays on a Computer Screen
• Radio button
• Drop-down box
• Check box
• Open-ended boxes
![Page 71: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/71.jpg)
71
Welcome Screen
• Welcome Screen like a cover letter• It contains the name of the research company
and how to contact the organization if there is a problem or concern.
• "If you have any concerns or questions about this survey, or if you experience any technical difficulties, please contact (NAME OF RESEARCH ORGANIZATION).
![Page 72: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/72.jpg)
72
Welcome Screen Should Ask for Password and Give Instructions
• Please enter your personal password from your invitation.Then, press the "enter" key to begin the survey or simply click on the right arrow at the bottom of the page to begin the survey (after you have read the remaining instructions):
• During the survey, please do not use your browser's FORWARD and BACK buttons.
• Use the arrows on the lower right to move backward and forward through the survey.
![Page 73: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/73.jpg)
73
![Page 74: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/74.jpg)
74
![Page 75: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/75.jpg)
75
![Page 76: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/76.jpg)
76
![Page 77: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/77.jpg)
77
![Page 78: Dr. Michael R. Hyman, NMSU Questionnaire Design. 2](https://reader037.vdocuments.us/reader037/viewer/2022102808/56649d555503460f94a32cb0/html5/thumbnails/78.jpg)
78
Software that Makes Questionnaires Interactive
• Boolean skip and branching logic
– Hidden skip logic
• Variable piping software
• Error trapping - forced answering software
• Interactive help desks