by: awatif ali alam professor [email protected]. how? overall method survey experiment case study...
TRANSCRIPT
By: Awatif Ali Alam
HOW?
Overall Method•Survey•Experiment•Case Study•Secondary Data
What?
•Concepts
•Variables•Measures
Who?•Population
•Sampling
Data Gathering
Analysis
Application
1. Define study objectives2. Identify information needs & study population(s)
3. Determine basic design/approach:
- a self-administered survey
- could be mailed or on-site survey
4. Questionnaire design
5. Choose sample (frame, size, sampling design)
6. Estimate time, costs, manpower needs, etc.
STEPS IN A SURVEY
Questionnaire Design
1. Preliminary Info Information needed Who are subjects Method of communication
2. Question Content
3. Question Wording
4. Response Format
5. Question Sequencing/Layout
Wording1. Will words be uniformly understood? Simple
language. Avoid technical phrases, jargon and abbreviations.
2. Does question adequately express the alternatives?3. Is the question misleading due to unstated assumption
or unseen implications.4. Is wording biased, emotional, or unfair?5. Will wording be offensive to respondents?6. Should you use more or less personalized wording?7. Ask in a more direct or more indirect way?
What Information?Demographic, Socioeconomic, Physical
•e.g. income, age, weight, hometown,…
Cognitive - Knowledge & beliefs
• e.g. Aware of a program, believe in global warming
Affective - attitudes, feelings, preferences
• Like or dislike program, satisfied, prefer this or that
Behaviors
•Swimming last year, repeat experience, stay longer in program?
1. Simple fill in the blank.
Obtaining a straightforward number or other easily understood response.
How old are you? (years).
In what county is your permanent residence? ( county)
How much money did you spend on this trip?
2. Open ended:
To avoid leading subject, to obtain wide range of responses in subject’s own
words, or when you don’t know kinds of responses to expect.
What is your primary reason for visiting the park today? _______________________________________.
3. Partially closed ended. List major response categories while leaving room for
others. Which of the following community recreation facilities do
you most frequently use? (check one).
neighborhood parks/playgrounds swimming pools community centers natural areas tennis courts other (please specify)
_________________
4. Checklists: Allow subjects to check multiple responses. Categories exhaustive & mutually exclusive
Which of the following winter recreation activities have you participated in during the past month?
(check all that apply)
Cross-country skiing Downhill skiing Snowmobiling Ice Skating Sledding
5. Likert Scales: Versatile format for measuring attitudes.
Please check the box that best represents your level of agreement or disagreement with each of the following statements about downhill skiing:
Strongly Strongly Agree Agree Neutral Disagree Disagree
Downhill skiing is...exciting dangerous expensive
Can replace “agree” with “importance” “satisfaction”, “interest” “preference” and other descriptors to fit the attitude you wish to measure.
6. Rank Ordering:
To measure preferences or priorities. Limit to short lists.
Rank the following states in terms of your interest as possible travel destinations for a summer vacation trip.
(Place a 1 beside the city you would most like to visit, place a 2 besides your second choice, and a 3 beside your third choice.)
______ Taief______ Abha______ Jeddah
7. Filter Question.To screen for eligibility or knowledge prior to asking other questions.
Did you stay overnight on your most recent trip?
NO YES
If Yes, How many nights did you spend away from home?
To next question
Sequencing & layout
1. Will this question influence responses to others?
2. Is question led up to in a natural way?
3. Placement to create interest, improve response rate.
4. Branching, skipping, and transitions on questionnaires.
1. Is this question necessary? useful?2. Are several questions needed on this subject? Avoid double
barreled questions.3. Do respondents have information to answer the question? Use
filter questions to screen. 4. Does question need to be more concrete, specific and related to
subject's personal experience? Is a time referent provided?5. Is question sufficiently general? Do you want recent behavior
or "typical behavior"?6. Do replies express general attitudes or specific ones?7. Is content loaded or biased8. Are subjects willing to answer?9. Can responses be compared with existing information?
Question Content
1.Observations: simple visual observation clinical examination, x ray, biochemical, etc.. 2.Interviews & self administered questionnaires:3.The use of documentary sources: clinical records, death certificates, (SECONDARY DATA) mortality statistics census, publications, etc.
1. Accuracy and relevance of information.
2. The need for personnel, skill, equipment, etc. in
relation to what is available, and the urgency with
which results are needed.
3. The probability that the method will provide a good coverage,
ie will supply the information about target subjects.
4.The investigator’s familiarity with a study procedure.
1.Attributes: refer to personal or demographic
characteristics. Some of the most frequently requested
attributes are age, sex, marital status, income, education, occupation,, etc.
2.Attitudes: questions are evaluative and reflect
respondent’s views about the desirability of something done in the past,
what they are currently doing, or what they plan to do in the future.
3.Beliefs: are assessments of what a person thinks is true
or false. These questions are designed to elicit people’s
perceptions of past, present, or future reality.4.Behavior: questions elicit people’s beliefs about their
behavior, and may be concerned with what they have.
1.Enables researcher to maintain uniformity in
information collected during health surveys .
2.Ensures completeness of health records from each
respondent .
3.Guarantees proper homework on the type of
information required for a meaningful research.
4.Tests “K” of the investigator about the research.
5.Allows the investigator to prepare “dummy” tables
for collected data.
1. The number of questions should be determined in relevance to the proposed objectives.2. Avoid irrelevant questions.3. The questions must be simple, short, contain one idea.4. Avoid sensitive questions or leave them to the end.5. Avoid leading questions.6. Arrange questions in an orderly manner .
7 .Questions relating to the same issue must be put in close proximity .
8. Avoid technical terms.9. Use local language of comm.
The questionnaire contains 2 main parts:The first part :
contains information for identifying the
respondent’s house no., address, record no.,etcThe second part :
contains the relevant questions to the study
objectives which may be subdivided such that
questions in any section deal with specific
themes.
1.CLOSE-ENDED with ordered choices: Answers
Choices are provided for these questions.
The respondent’s task is to find the most
appropriate place on an implied continuum for
his/her response.
e.g. Subject may be asked to indicate the degree of
agreement with choices 1.STRONGLY AGREE 2.AGREE 3.UNDECIDED 4. DISAGREE 5.Strongly Disagree
2.CLOSE-ENDED with unordered response choices :
Answer choices are provided
Respondents must choose from among discrete,
unordered categories by independently evaluating
each choice and selecting the one that best reflects
his/her situation.
e.g. Marital Status: 1. Single 2. Married
3. Widowed 4. Divorced
3. PARTIALLY CLOSE-ENDED:
These questions provide a compromise.
Although answer choices are provided,
respondents have the option of creating their
own responses. e.g. provide the option
“ OTHER (SPECIFY)”.
4.OPEN-ENDED QUESTIONS:
These questions have no answer choices from
which respondents select their response.
Respondents must “create” their own answers
and state them in their own words.
e.g. Why did you stop smoking?
1. Must have face validity.
2. Respondents can be expected to know the
answers.
3. Must be clear and unambiguous.
4. Must not be offensive.
5. Must be fair.
Close-ended questions:
- Provide greater interrater reliability.
- May be scored quickly.
- Provide greater uniformity and simplify the analysis.
“ HOWEVER”
-They may be open to interpretive error due to guessing &
they limit the variety and detail of responses.
Open-ended questions: - May be constructed more quickly. - Provide fewer stimulus cues for guessing. - Play an imp. role in exploratory surveys. - Provide interesting information which may be used to brighten up a dull report. “HOWEVER”
-They may produce difficulty in interpreting and
categorizing responses. - They may be more difficult to score
accurately.
Closed ended or Open ended questions? Which one to use?
It is sometimes advisable to use an open-ended question first, in a pretest, in order to collect free responses which can be used as a basis for constructing “closed” categories.
Describe the population◦ Demographics, knowledge, attitudes, behavior
Test for differences between subgroups◦ Are men different than women in sports participation?
(gender related to partic.) Test for relationships between variables
◦ Does boat ownership vary with income? Evaluate a program (specify criteria as part of objective)
◦ How satisfied are customers? What do they like or dislike about program?
◦ Estimate benefits (costs, impacts) of a program