survey design and implementation
DESCRIPTION
Survey Design and Implementation. Elizabeth C Wells Doctoral Candidate Ag & Extension Education http://www.msu.edu/~wellselz/. Why do people fill out surveys? What do you want to ask/measure? Accuracy/Survey Error Random Sampling Writing Questions Questionnaire Design - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/1.jpg)
Survey Design and Survey Design and ImplementationImplementation
Elizabeth C WellsElizabeth C Wells Doctoral Candidate Doctoral Candidate
Ag & Extension EducationAg & Extension Education
http://www.msu.edu/~wellselz/http://www.msu.edu/~wellselz/
![Page 2: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/2.jpg)
Why do people fill out surveys?
What do you want to ask/measure?
Accuracy/Survey Error
Random Sampling
Writing Questions
Questionnaire Design
Survey Implementation
Telephone, Interview and Internet Surveys
UCRIHS
![Page 3: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/3.jpg)
Why People Fill Out SurveysWhy People Fill Out Surveys
• Social Exchange Theory Theory of human behavior in which
actions of individuals are motivated by the return these actions are expected to bring.
Elements of reward, cost and trust
![Page 4: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/4.jpg)
Social Exchange TheorySocial Exchange Theory
• Rewards show positive regard say thank you ask for advice support group values give tangible rewards make the questionnaire interesting
![Page 5: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/5.jpg)
Social Exchange TheorySocial Exchange Theory
• Reduce Social Costsavoid subordinating languageavoid inconvenienceavoid embarrassmentmake it short and easyminimize requests for personal informationkeep requests consistent
![Page 6: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/6.jpg)
Social Exchange TheorySocial Exchange Theory
• Establish Trust provide token of appreciation in advance sponsorship by legitimate authority
make task appear important invoke other exchange
![Page 7: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/7.jpg)
Constructs and MeasurementConstructs and Measurement
• What do you want to know?• What are the variables?• How will you measure it? behavior, attitudes, feelings,
demographics
![Page 8: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/8.jpg)
Survey ErrorSurvey Error
• Sampling Error – Who are you sampling?• Coverage Error – Does your list include
everyone?• Measurement Error – Does everyone answer a
question the same way?• Non-response Error – Why did respondent not
answer: Instrument (whole questionnaire not returned) Item (question not answered)
![Page 9: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/9.jpg)
Non Response ErrorNon Response Error
• Only an issue if non responders would answer differently and change results
compare early to late respondentsdouble dip
![Page 10: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/10.jpg)
Random SamplingRandom Sampling
• How much sampling error can you tolerate?
• How large is the population?• How varied is the population?• How confident do you wish to be about
estimates made from the sample?
![Page 11: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/11.jpg)
Random Sampling - ChartRandom Sampling - ChartPop Size 50/50 split 80/20 split100 80 71200 132 111400 196 153600 234 175800 260 1881000 278 198
Sample size for a 95% confidence level
And a + 5% sampling error
![Page 12: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/12.jpg)
Random SamplingRandom Sampling
• http://www.randomizer.org
A www site that will generate random numbers which you can use for random selection of participants on a mailing list.
![Page 13: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/13.jpg)
Writing QuestionsWriting Questions
• Everyone will interpret the same way• Respondents are able to respond
accurately • Respondents are willing to answer
![Page 14: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/14.jpg)
Writing QuestionsWriting Questions
• Use simple words• Keep it short• Be specific• Do not talk down• Avoid bias• Avoid hypothetical questions• Use complete sentences
![Page 15: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/15.jpg)
Question CriteriaQuestion Criteria
• Does the question require an answer? If you fixed dinner last night, did you eat meat as part of
that meal?
• To what extent does the respondent have a ready made and accurate answer?
Are tall people more likely to be elected President?
• Can respondent accurately recall and report past behavior?
How much television did you watch last month?
![Page 16: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/16.jpg)
Question PrinciplesQuestion Principles
• Use simple words and phrases tired……………………………exhausted honest…………………………candid work……………………………employment most important………………..top priority free time……………………….leisure doctor………………………….physician your answers………………….your responses to this questionnaire
![Page 17: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/17.jpg)
Question PrinciplesQuestion Principles
• Avoid vague quantifiers How often did you attend religious services last year?
Never Rarely Occasionally Regularly
![Page 18: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/18.jpg)
Question PrinciplesQuestion Principles
How often did you attend religious services during the past year?
Not at all A few times About once a month
Two or three times a month About once a week More than once a week
![Page 19: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/19.jpg)
Question PrinciplesQuestion Principles
• Avoid bias by using both positive and negative sides in the question stem
“To what extent do you agree….”
vs
“To what extent do you agree or disagree with this statement…. “
![Page 20: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/20.jpg)
Question PrinciplesQuestion Principles
• Avoid double-barreled questions
16. Should the new school have a swimming pool that includes lanes for swimming laps and is not enclosed for winter use?
![Page 21: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/21.jpg)
Question PrinciplesQuestion Principles
• Avoid asking respondent to say yes in order to mean no.
5. Do you favor or oppose not allowing the state to approve a casino without approval from 60% of the voters?
Favor Oppose
![Page 22: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/22.jpg)
5. Do you favor or oppose requiring 60% approval by voters in order for a casino to be built.
Favor requiring 60% approval
Oppose requiring 60% approval
![Page 23: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/23.jpg)
Question PrinciplesQuestion Principles
• Use equal numbers of positive and negative categories for scalar questions AND distinguish undecided from neutral by placing at the end of the scale.
![Page 24: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/24.jpg)
To what extent do you agree or disagree with this statement: “Listening to classical music is good for a persons emotional health.”
Strongly agree
Somewhat agree
Neither agree nor disagree
Somewhat disagree
Strongly disagree
No opinion
![Page 25: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/25.jpg)
Question PrinciplesQuestion Principles
• Soften impact of potentially objectionable questions:
Have you ever shoplifted something from a store?
vs Have you ever taken something from a
store without paying for it?
![Page 26: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/26.jpg)
22. What was your total income from all sources in 2003?
______________ Total income for 2003
22. Which category best describes your total income from all sources in 2003?
$10,000. or less
$10,001. to $20,000.
$20,001. to $35,000.
$35,001. to $50,000.
$50,001. or above
![Page 27: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/27.jpg)
Question PrinciplesQuestion Principles
• Don’t combine numbers and words Doing so may impact respondents
perception of the scale.
1= strongly agree, 2 = agree, 3 = disagree, 4 = strongly disagree
![Page 28: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/28.jpg)
Question PrinciplesQuestion Principles
• Eliminate check-all-that-apply questions to reduce primacy and sufficiency effect.
People tend to check the first ones more than the last ones and sometimes check a few and feel that is enough to satisfy the researcher.
![Page 29: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/29.jpg)
Question PrinciplesQuestion Principles
Extension Agent Other Cattlemen Fertilizer and other
salesmen
59% selected Extension Agent
Other Cattlemen Fertilizer and other
salesmen Extension Agent
41% selected Extension Agent
![Page 30: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/30.jpg)
Questionnaire DesignQuestionnaire Design
• Paper and layout choice booklet format preferred
one column for legal size
two columns for full size avoid upper left staple design
avoid unusual size, shape or fold
![Page 31: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/31.jpg)
Order of QuestionsOrder of Questions
• A questionnaire is like a conversation. It evolves according to social norms. Constantly switching topics makes it appear as though the researcher is not listening to the respondents answers.
• Doing otherwise results in answers that are less thought out when you want them to focus!
![Page 32: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/32.jpg)
Order of QuestionsOrder of Questions
• What was your family income in 2003?• Do you like to play golf?• What is your opinion on Global Warming?• Are you married?• How often have you gone fishing this year?• How adequate is your current health care?• How old are you?• What is your political party preference?• What is your occupation?
![Page 33: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/33.jpg)
Question OrderQuestion Order
• Group alike questions together• Begin asking questions in the upper left
corner• Ask one question at a time• Use item-in-a-series format
![Page 34: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/34.jpg)
The First QuestionThe First Question
• Should clearly apply to everyone• Question should be easy• Question needs to be interesting• Connectedness between the question and
the purpose of the survey.
![Page 35: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/35.jpg)
Unacceptable First QuestionsUnacceptable First Questions
1. Please think about the things that make MSU Extension a pleasant place to work and write down the five most important aspects and rate them one to five in importance to you.
.
![Page 36: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/36.jpg)
Unacceptable First Questions Unacceptable First Questions
1. Please describe in your own words what you consider good about working for MSU Extension.
1. What year were you born?
_________year born
![Page 37: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/37.jpg)
Good First QuestionGood First Question
1. Thinking about MSU Extension, how would you rate it as a place to work?
Excellent Good
Fair Poor
![Page 38: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/38.jpg)
Graphic DesignGraphic Design
• Stimuli on page consists of two languages:
written wordsgraphic symbols and arrangements
![Page 39: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/39.jpg)
Graphic Design Graphic Design
• Desired navigational path• Create visual navigational guides• Develop additional guides for redirecting
during skip patterns• Be consistent through out your instrument
![Page 40: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/40.jpg)
Questionnaire DesignQuestionnaire Design
• Instructions need to be exactly where needed not at the beginning of the whole questionnaire.
• Use italics or bolding or underline to emphasize instructions and directions
![Page 41: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/41.jpg)
Questionnaire DesignQuestionnaire Design
• Pre-attentive processing is 210 degrees• Focused reading is 2 degrees or about 8
to 9 characters • Use font, size, contrast, underline, spacing
to lead the respondent through the questionnaire
![Page 42: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/42.jpg)
Start here:1. Which of the following is your main work activity?
Research Teaching Administration Other (Please Specify) _________________
![Page 43: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/43.jpg)
START HERE:
Which of the following is your main work activity?
Research
Teaching
Administration
Other (Please specify) ____________________
![Page 44: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/44.jpg)
Questionnaire FormatQuestionnaire Format
• For paper questionnaires the standard font is 12 pt Times New Roman – also consider a larger font for senior audiences
• For on-line questionnaires the standard font is 10 pt Ariel
![Page 45: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/45.jpg)
Questionnaire DesignQuestionnaire Design
• Use a square for your answer and ask for an “X” in the square.
[ ]
1
![Page 46: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/46.jpg)
Questionnaire DesignQuestionnaire Design
• Place instructions exactly where needed within the question
• Differentiate with font, bolding, underlining etc
![Page 47: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/47.jpg)
5. How many months have you worked at your current job?
_________Number of months
Please be as specific as possible in answering the next question, including any area of specialization. Example: Extension Agent – Agriculture. If you had more than one job, answer for the job for which you worked the most hours.
6. What kind of work do you do in your current job?
_________________________________ Kind of work
![Page 48: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/48.jpg)
5. How many months have you worked in your current job?
_____________________ Number of months
6. What kind of work do you do in your current job? Please be as specific as possible in answering. Include any are of specialization, for example: “Extension Agent – Agriculture”. If you had more than one job, answer for the job which you worked the most hours.
______________________________Kind of work
![Page 49: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/49.jpg)
Questionnaire DesignQuestionnaire Design
• Vertical alignment eases response task• Don’t double or triple bank answers
![Page 50: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/50.jpg)
1. Which one of the following best describes the 4-H project with the largest enrollment within your club?
market beef
lambs
hogs
dogs
cats
rabbits
goats
poultry
dairy
![Page 51: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/51.jpg)
1. Which one of the following best describes the 4-H project with the largest enrollment within your club?
beef
hogs
lambs
dogs
cats
rabbits
goats
poultry
dairy
![Page 52: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/52.jpg)
Questionnaire DesignQuestionnaire Design
• Major changes are needed for skip patterns• Skip patterns are difficult to follow• Skip patterns often lead to item non response
![Page 53: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/53.jpg)
12. Normally do you eat breakfast every day?
Yes (Go to 13)
No (Go to 18)
13. How many times a week do you drink orange juice with your breakfast?
__________ Times a week
![Page 54: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/54.jpg)
12. Normally do you eat breakfast every day?
No (Skip to 18)
Yes
13. (If Yes) How often do you drink orange juice with your breakfast?
____________ Times a week
![Page 55: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/55.jpg)
Questionnaire DesignQuestionnaire Design
• Demographic data questions Place at end of questionnaire but not on back page Only ask what is necessary
![Page 56: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/56.jpg)
Questionnaire DesignQuestionnaire Design
• Front cover needs to stand out Consider simple art work Include name of survey Include name and address for return
![Page 57: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/57.jpg)
Questionnaire DesignQuestionnaire Design
• Back cover needs to be simple with white space
Try not to ask specific questions May place open ended question here Give opportunity to add comments Conclude with a thank you
![Page 58: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/58.jpg)
ImplementationImplementation
• Respondent friendly questionnaire• Multiple contacts• Token pre-paid incentive• SASA for return• Personalized correspondence
![Page 59: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/59.jpg)
ImplementationImplementation
• Four contacts plus one “special” = 5 contacts Brief pre notice letter Questionnaire mailing with SASE Thank you postcard Replacement questionnaire Final contact with “special” mailing
![Page 60: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/60.jpg)
Implementation – Contact 1Implementation – Contact 1
• Pre-notice letter: Date at top Personalized letter What will happen What it is about Usefulness of survey Thank you
Real signature P.S. Token incentive
Mail out a few days to one week before mailing instrument
4-6% higher response rate
![Page 61: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/61.jpg)
Implementation – Contact 2Implementation – Contact 2
• Mail the questionnaire Include personalized cover letter Questionnaire Self addressed stamped envelope with
real stamp Enclose incentive Use first class postage – plain envelope
![Page 62: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/62.jpg)
Implementation – Cover LetterImplementation – Cover Letter
• Inside address• Request• Why you were selected• Usefulness of survey• Confidentiality• Token of appreciation• Willingness to answer questions• Thank you• Real signature in contrasting ink
![Page 63: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/63.jpg)
Implementation – Token IncentiveImplementation – Token Incentive
• Cash in advance $1. or $2. = 12% to 19% increase in response rate
• Less of an increase for larger amount later • Increasing incentive not cost effective• Non dollar incentive not as effective and may
be effective because of packaging
![Page 64: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/64.jpg)
Implementation – Contact 3 Implementation – Contact 3 • Postcard to all who
were mailed a questionnaire thanking them
• Serves to jog memory• Gives opportunity to
call for replacement if needed
Mail one week after questionnaire
Increase up to 13%
![Page 65: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/65.jpg)
Implementation – Contact 4Implementation – Contact 4• Replacement
questionnaire to those who have not yet responded.
• Letter reminding them of the survey and asking again for their assistance.
Sent only to non-respondents
Two to four weeks after 3rd
contact
![Page 66: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/66.jpg)
Implementation – Contact 5Implementation – Contact 5
• Special mailing to those who have not yet responded
• Use unique method of mailing – certified, priority etc
• May also telephone and fill out over the phone
Final contact is a week or more after 4th contact
![Page 67: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/67.jpg)
Tracking ResponsesTracking Responses
• Assign each questionnaire a number• Assign each name and address a number• Send respondents their individually numbered
questionnaire • Have assistant mark off numbers as they are
returned• Note surveys are confidential not anonymous• Keep completed questionnaires in secure
location
![Page 68: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/68.jpg)
Mixed Mode SurveysMixed Mode Surveys• Responses differ by mode: “Excellent Health” = 44% by personal interview
= 37% by telephone = 30% by mail social desirability acquiescence primacy vs recency effect
![Page 69: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/69.jpg)
Telephone SurveysTelephone Surveys
• Difficult to obtain phone numbers• Caller id and answering machines may
screen calls• Need well trained interviewers• Limited number of questions and answers
![Page 70: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/70.jpg)
Internet SurveysInternet Surveys
• Consider coverage error. Does your entire audience have and use the internet on a regular basis?
• E-mail addresses change often• Difficult to include incentive• Shorter less detailed questionnaire Survey Monkey
![Page 71: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/71.jpg)
Research EthicsResearch Ethics
Anonymous – No way to know who returned the survey
Confidential – Only researcher can connect the respondent with their answers. All answers remain confidential.
![Page 72: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/72.jpg)
Research EthicsResearch Ethics
• If you wish to publish results you MUST get approval from UCRIHS before you send out surveys.
University Committee on Research Involving Human Subject
![Page 73: Survey Design and Implementation](https://reader035.vdocuments.us/reader035/viewer/2022062305/56815c37550346895dca25ca/html5/thumbnails/73.jpg)
ReferencesReferences
Mail and Internet Surveys – The TailoredDesign Method by Don Dillman 2000