questionnaire development · 2017-07-31 · questionnaire development harald schomburg, senior...
TRANSCRIPT
Questionnaire Development
Harald Schomburg, Senior Consultant, Germany
Tracer Study Workshopin Tehran, Islamic Republic of Iran, 24th May 2017
www.qtafi.de
First Step: Collection of Used
Questionnaires
• See http://ingradnet.org/
• CHEERS 1999: http://www.ingradnet.org/quest/q_cheers_1999_master_en.pdf
• AAU 1996
• Standardinstrument 1995 (Schomburg)
• REFLEX 2005
• KOAB 2009
Do not try to reinvent the wheel!
15/05/2017
Ha
rald
Sch
om
bu
rg, Q
ue
stio
nn
aire D
eve
lop
me
nt
2
http://ingradnet.org/
15/05/2017
Ha
rald
Sch
om
bu
rg, Q
ue
stio
nn
aire D
eve
lop
me
nt
3
Examples of International Tested
Questionnaires
15/05/2017
Ha
rald
Sch
om
bu
rg, Q
ue
stio
nn
aire D
eve
lop
me
nt
4
Second Step: Adaptations and Testing
• Selection of subjects/topics according the own objectives
• Selection of questions and answers according the own objectives
• Adaptation of the questions/answers to local conditions (country, institution, study programme)
• Development of new question and answers
• Formatting of the questionnaire
• Printing the questionnaire
• Testing the questionnaire
• Revision of the questionnaire
• Final (paper) version of the questionnaire
15/05/2017
Ha
rald
Sch
om
bu
rg, Q
ue
stio
nn
aire D
eve
lop
me
nt
5
Example of Questions (1) – Standardization of
Styles
15/05/2017
Ha
rald
Sch
om
bu
rg, Q
ue
stio
nn
aire D
eve
lop
me
nt
6
Source: Harald Schomburg, Carrying out tracer studies. Appendix 2, Questionnaire Modules for a VET/HE Tracer Study.
Question number
Question text
Answers
Explanations
All answered are left aligned
Hidden Technical Information in the
Questionnaire
15/05/2017
Ha
rald
Sch
om
bu
rg, Q
ue
stio
nn
aire D
eve
lop
me
nt
7
• Every element (like a question) is a WORD table• Every element has sequence number (N001 …)• Every element has a type Identification like
SE – Section; EX = Explanation; CV = Categorical variable; OR = Ordinal variable; ME = Metric variable • Every question has a question identification number (like Q1)• The variable names are include in the question
Styles
Source: Harald Schomburg, Carrying out tracer studies. Appendix 2, Questionnaire Modules for a VET/HE Tracer Study.
Hidden Technical Information in the
Questionnaire
15/05/2017
Ha
rald
Sch
om
bu
rg, Q
ue
stio
nn
aire D
eve
lop
me
nt
8
• Every element (like a question) is a WORD table• Every element has sequence number (N001 …)• Every element has a type Identification like
SE – Section; EX = Explanation; CV = Categorical variable; OR = Ordinal variable; ME = Metric variable • Every question has a question identification number (like Q1)• The variable names are include in the question
Styles
Variable name
Question identification numberType of question
Subject/topic
Example of Questions (1) – Different Types
15/05/2017
Ha
rald
Sch
om
bu
rg, Q
ue
stio
nn
aire D
eve
lop
me
nt
9
Half-open question
Open question
Half-open question
CV - Categorical variable
Source: Harald Schomburg, Carrying out tracer studies. Appendix 2, Questionnaire Modules for a VET/HE Tracer Study.
Ordinal Question/Variables
15/05/2017
Ha
rald
Sch
om
bu
rg, Q
ue
stio
nn
aire D
eve
lop
me
nt
10
Five-point ordinal scale
Eight items = variables
Source: Harald Schomburg, Carrying out tracer studies. Appendix 2, Questionnaire Modules for a VET/HE Tracer Study.
Ordinal Question – with Variables
and Subject
15/05/2017
Ha
rald
Sch
om
bu
rg, Q
ue
stio
nn
aire D
eve
lop
me
nt
11
Source: Harald Schomburg, Carrying out tracer studies. Appendix 2, Questionnaire Modules for a VET/HE Tracer Study.
Metric Question (open)
15/05/2017
Ha
rald
Sch
om
bu
rg, Q
ue
stio
nn
aire D
eve
lop
me
nt
12
Source: Harald Schomburg, Carrying out tracer studies. Appendix 2, Questionnaire Modules for a VET/HE Tracer Study.
Closed Instead of Open Questions –
Reduction of Errors
15/05/2017
Ha
rald
Sch
om
bu
rg, Q
ue
stio
nn
aire D
eve
lop
me
nt
13
Source: Harald Schomburg, Carrying out tracer studies. Appendix 2, Questionnaire Modules for a VET/HE Tracer Study.
Example of Filtered Questions
15/05/2017
Ha
rald
Sch
om
bu
rg, Q
ue
stio
nn
aire D
eve
lop
me
nt
14
Source: Harald Schomburg, Carrying out tracer studies. Appendix 2, Questionnaire Modules for a VET/HE Tracer Study.
THANK YOU VERY MUCH
FOR YOUR ATTENTION
15/05/2017
Ha
rald
Sch
om
bu
rg, Q
ue
stio
nn
aire D
eve
lop
me
nt
15