questionnaire design and validation bwl 2012
TRANSCRIPT
-
8/18/2019 Questionnaire Design and Validation BWL 2012
1/17
BONY WIEM LESTARI
EPIDEMIOLOGY AND BIOSTATISTICS DEPARTMENT
2012
QUESTIONNAIRE DESIGN AND
VALIDATION
-
8/18/2019 Questionnaire Design and Validation BWL 2012
2/17
1. Distinguish between various stages inquestionnaire design.
2. Demonstrate appropriate techniques for
wording questions
3. Validity and Reliability of measurement tool
4. Identify appropriate delivery format ofcertain questionnaire
Learning Objectives:
-
8/18/2019 Questionnaire Design and Validation BWL 2012
3/17
What is
Questionnaire
?
A TOOL FOR COLLECTING
INFORMATION TO DESCRIBE,
COMPARE, EXPLAIN, KNOWLEDGE,
ATTITUDES, BEHAVIORS, AND/OR
DEMOGRAPHIC CHARACTERISTICS ON
A PARTICULAR TARGET GROUP
-
8/18/2019 Questionnaire Design and Validation BWL 2012
4/17
1. Self administered (mailed or personal contact)
2. In person (face-to-face) interviews
3. Telephone interviews
Questionnaire General Format:
-
8/18/2019 Questionnaire Design and Validation BWL 2012
5/17
Types of Questions:
1. Open-ended questions
• Permit free response which should be
recorded in the respondents’ own
words.
2. Closed questions
• Have a list of possible options or
answers from which the respondents
must choose.
-
8/18/2019 Questionnaire Design and Validation BWL 2012
6/17
Identify: (Self learning)
1. Advantages & disadvantages of open-ended
questions
2. Advantages & disadvantages of closed
questions
-
8/18/2019 Questionnaire Design and Validation BWL 2012
7/17
Steps in Designing A Questionnaire
1. Content Take your objectives and variables asa starting point
2. Formulating questions – Formulate one or more questions that will provide
the information needed for each variable
– Check whether each question measures one thing ata time
– Avoid leading questions
– Avoid words with double or vaguely definedmeanings or that emotionally laden
– Ask sensitive questions in a socially acceptable way
-
8/18/2019 Questionnaire Design and Validation BWL 2012
8/17
Steps in Designing A Questionnaire
3. Sequencing the questions – Design your interview schedule or questionnaire to
be ‘informant friendly’
– Use simple, everyday language
4. Formatting the questionnaire
5. Translation
If interviews will be conducted in one or more local
languages, the questionnaire should be translatedin order to standardise the way questions will beasked.
-
8/18/2019 Questionnaire Design and Validation BWL 2012
9/17
Conceptualization:
abstract construct – conceptual definition – operasionalization - indicator
Constructing
Testing
Analysis
Revising
Steps in Questionnaire Development:
(Cohen)
-
8/18/2019 Questionnaire Design and Validation BWL 2012
10/17
Questionnaire is a tool:
• The quality of a measurement: validity andreliability
Validity:
• the extent to which a test measures what it isintended to measure
•
Free of systematic error• Accuracy
-
8/18/2019 Questionnaire Design and Validation BWL 2012
11/17
Questionnaire is a tool:
Reliability:
• The degree to which a variable has nearly the samevalue when measured several times
• Free of random error (chance)• Precision
• Also called reproducibility, consistency
• Assessing precision (reproducibility of repeatedmeasurement):
– Within – between observer
– Within – between instruments
-
8/18/2019 Questionnaire Design and Validation BWL 2012
12/17
Reliability:
• Reliability coefficient ~ correlation
coefficient (0 – 1)
• A questionnaire is reliable when the
minimum reliability coefficient is 0.7
-
8/18/2019 Questionnaire Design and Validation BWL 2012
13/17
• Criterion validity (predictive and concurrent)
depending on whether the criterion refers to a
current or future assessment
• Construct validity
assembly evidence to support or refute acomplex scientific theory and to show under
what circumstances it holds true
Assessing Validity:
-
8/18/2019 Questionnaire Design and Validation BWL 2012
14/17
• Content validity
– refers to comprehensiveness
– how adequate the sampling of questions reflects
the aims of the index that were specified in the
conceptual definition of its scope
Assesing Validity:
-
8/18/2019 Questionnaire Design and Validation BWL 2012
15/17
FINAL REMARKS:
•
prior to using a questionnaire it has to be establishedthat the instrument is valid and reproducible in the
context (i.e. population, setting and study design) in
which it is going to be employed.
• conceptually comparable (conceptual equivalence)
• developing a new questionnaire is very time-
consuming
•
burden on respondents• practical aspects of the study
-
8/18/2019 Questionnaire Design and Validation BWL 2012
16/17
REFERENCES:
1. Measuring Health: A Guide to RatingScales and Questionnaire. Ian McDowell
and Claire Newell. 1996.
2. Psychological Testing: Design, Analysisand Use. Lisa Friedenberg. 1995.
3. Designing and Conducting Health System
Research Projects. KIT Publishers. WHO.
2003
-
8/18/2019 Questionnaire Design and Validation BWL 2012
17/17
What’s Your Message?THANK YOU