research design and instrument development ensuring what you want is what you get

14
Research Design and Instrument Development Ensuring what you want is what you get

Upload: mercy-moody

Post on 17-Jan-2016

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Research Design and Instrument Development Ensuring what you want is what you get

Research Design and Instrument Development

Ensuring what you want is what you get

Page 2: Research Design and Instrument Development Ensuring what you want is what you get

Objectives

• to review some key research design issues

• to highlight key elements of instrument design

Page 3: Research Design and Instrument Development Ensuring what you want is what you get

Research Technique

• Technique is determined by objectives

• Ensure that the data collected is the right type and quality to answer the research question

Page 4: Research Design and Instrument Development Ensuring what you want is what you get

Research Techniques

• Experiments

• Surveys

• Secondary data

• Observation

Page 5: Research Design and Instrument Development Ensuring what you want is what you get

Selecting the Appropriate Survey Design

• Personal interviewing• Telephone interviewing

– Speed, cost, impersonal, representative sample– Greater tendency to get “no answer” and

“incomplete answers”– No longer than ten minutes; uniform administration

• Mail survey– No longer than six pages

• Electronic survey

Page 6: Research Design and Instrument Development Ensuring what you want is what you get

Personal Interviews

• Open-ended– ask for the facts of a matter as well as for

opinions about events or insights

• Focused– interviews may still be open-ended and

assume a conversational manner, but you’re likely following a set of questions

• Survey– structured questions

Page 7: Research Design and Instrument Development Ensuring what you want is what you get

General Design Considerations

• Time frame

• Explicit and consistent frame of reference

• Standardization (for comparability)

• Descriptive and/or evaluative data

Page 8: Research Design and Instrument Development Ensuring what you want is what you get

Designing Survey Instruments

• Collect only the data needed to address the research question

• Be clear about what concepts you want to collect data on and how you are going to ensure that this data is what you think it is

• Ask the “right” questions about the concepts in the study

Page 9: Research Design and Instrument Development Ensuring what you want is what you get

Major Decisions

• What should be asked?• How should each question be phrased?• In what sequence should the questions be

arranged?• What questionnaire layout will best serve the

research objectives?• How should the questionnaire be pretested?• Does the questionnaire need to be revised?

Page 10: Research Design and Instrument Development Ensuring what you want is what you get

Item Phrasing

• Dependent upon method of administration

• Nonpersonal administration requires items and instructions to be succinct

• All methods require items to be clearly stated, unambiguous, easily understood

Page 11: Research Design and Instrument Development Ensuring what you want is what you get

When Constructing Items, Ask:

• Is the item necessary?

• How will it be asked?

• Should it be open-or closed-ended?

• How should the item be worded?

Page 12: Research Design and Instrument Development Ensuring what you want is what you get

When Constructing Response Formats, Ask:

• What response alternatives should be used?

• In what order should alternatives be stated?

• How will “don’t know”, “no answer” and “neutral” responses be handled?

Page 13: Research Design and Instrument Development Ensuring what you want is what you get

Item Sequencing and Layout

• Are the instructions clear and easy to read?• Are instructions provided to explain the purpose of

the questions, with directions on how to complete the scales, if necessary?

• Does the questionnaire begin with simple and interesting questions?

• Are sensitive and classificatory items provided last?• The questionnaire has a good flow to it.• The questionnaire is well-laid out and aesthetically

appealing.

Page 14: Research Design and Instrument Development Ensuring what you want is what you get

Invitation to Participate

• Explicit invitation to participate• An acknowledgement that participation is

voluntary• A statement of the purpose of the project• A statement of the time demands involved in

participation• Contact information for the researcher (or

supervisor).