taking the b out of abd - chapter 3, lesson 2, pilot study3,+lesson+2+pilot+st… · title:...

1

CHAPTER 3: METHODOLOGYLESSON #2: PILOT STUDY

Copyright © 2014 Dr. Rich Schuttler

AGENDA

Wh t i Pil t St d ?• What is a Pilot Study?


2

AGENDA


• When is a Pilot Study Needed?


AGENDA



• Who is in a Pilot Study?


3

AGENDA




• How to Conduct a Pilot Study?


How to Conduct a Pilot Study?

AGENDA







• Examples from Prior Mentees

4

AGENDA








• Reflective Summary

What is a Pilot Study?

A method to ensureA method to ensure survey questions are developed to

obtain needed data.


5


A method to verifyA method to verify how long it will take

for survey participant to

complete.Copyright © 2014 Dr. Rich Schuttler


A method get expertA method get expert feedback on the

accuracy of tool to gain needed data.


6


A method to improveA method to improve reliability of survey

instrument.



Can meanCan mean

different things

t diff t l !to different people!


7


According to Mackey and Gass (2005), the function of a pilot

study is to assess, make revisions, and make definitive

determinations about the study.


What is a Pilot Study?The pilot study allows the

researcher the opportunity toresearcher the opportunity to determine if the research structure was appropriate, determine interviewing techniques, and g q ,reflect based on the pilot test experience (Seidman, 2006).


8

When is a Pilot Study Needed?This can be subjective – so I

will share my approach forwill share my approach….for dissertation research….


When is a Pilot Study Needed?This can be subjective – so I

will share my approach forwill share my approach….for dissertation research….

ALWAYS!ALWAYS!


9

When is a Pilot Study Needed?

For newly

created instruments



Validated InstrumentsValidated Instruments

With

Different PopulationsDifferent Populations


10


Other situations …


WHO IS IN A PILOT STUDY?

SurveySurvey

Population

QualifiedQualified


11


Depends on Research Method & Design




Qualitative•Qualitative


12




•Quantitative





•Quantitative

•Mixed Method•Mixed Method


13

What is a Pilot Study?In Proposal:

• Describes how the survey instrument will be tested for accuracy


What is Chapter 3?In Dissertation:

• Describes how the survey instrument was tested for accuracy


14

Examples Provided• All examples are from my prior mentees



• Most were approved on the first pass through reviews


15


• Most were approved on the first pass through reviews

• Each provided me written consent to use ptheir work in this manner to help others complete their programs. They own the copyright to their work. My copyright for this program.


Dr. Dustin Pawlak - 2011

A PHENOMENOLOGICAL STUDY:A PHENOMENOLOGICAL STUDY: THE INFLUENCE OF PROFESSIONAL ATHLETES’ UNETHICAL BEHAVIOR ON AMATEUR ATHLETES


16

Dr. Dustin Pawlak Example

The pilot study involved administering th i t i t l t fthe interview protocol to a few volunteers similar to the demographics of the research pool that the researcher will find at the selected college institution The pilotselected college institution. The pilot test made certain the questions achieved the information sought-after in this study.



The pilot tests assist in determining if th ti l i lthe questions were logical, understandable, and clear to the participants (Seidman, 2006). Pilot testing the interview protocol offered a chance to discover discrepanciesa chance to discover discrepancies and make adjustments prior to administering the actual study.


17


Neuman (2003) noted the fimportance of pilot testing as a

manner for the researcher to develop their system for receiving and recording data and g gto discover aspects of the study in need of improvement.


Dr. Joseph Hage - 2013

INFLUENCE OF RELIGION AND RELIGIOSITY ON LEADERSHIP PRACTICESIN THE WORKPLACE: AIN THE WORKPLACE: A QUANTITATIVE CORRELATION STUDY

18

Dr. Joseph Hage Example The survey instruments were validated and

the derivative translations were reviewedthe derivative translations were reviewed and certified by professional linguists. Pilot testing is recommended to reveal errors in the design or problems with the instruments (Cooper & Schindler, 2011). In international research, pilot testing is important to reduce cultural, language, and response bias (Harzing, Reiche, & Pudelko, 2011).


Dr. Joseph Hage Example To this end, an appropriate sample size is

needed. By applying the central limit theorem, a sample size of n=30 or greater will result in the means of the sample to be distributed around the population mean approximately in a normal distribution (Cooper & Schindler 2011;distribution (Cooper & Schindler, 2011; Weiers, 2005). In this study, a research pilot test was performed using the LPI and URPI survey instruments.


19

Dr. Joseph Hage Example

As shown in Table 9, the pilot test sample consisted of 20 Muslims and 13 Christians. Convenience sampling is an accepted technique to validateaccepted technique to validate survey instruments (Neuman, 2011).


Dr. Joseph Hage Example The pilot testing process comprised

t t ( ) lid ti thtwo stages: (a) validating the translated instruments, and (b) creating the RPI, which is a derivative survey of the URPI. The results from the pilot study are reported in thethe pilot study are reported in the next chapter.


20

Dr. Joseph Hage Example Table 9

Pilot Study Data Sampling (N=33)

Participants Ratio

Muslims 20 60.6%

Christians 13 39.4%Christians 13 39.4%

Total 33 100.0%


Reflective Summary

• What is a Pilot Study?






21

Education is a lot like life: The more you put into it,

the more you’ll get out of it!

Blog, Newsletter, &

Membership SiteCopyright © 2014 Dr. Rich Schuttler

taking the b out of abd - chapter 3, lesson 2, pilot study3,+lesson+2+pilot+st… · title:...

Documents