chap15 observational methods _ostrov & hart (in press).pdf

20
C H A P T E R 15  Observational Meth ods  Jamie M. Ostro v  and  Emily J. Hart Abstract Systematic observational methods require clearly dened codes, structured sampling and recordin g procedures,and are subject to rigorous psychometric analysis. We review best practices in each of these areas with attention to the application of these methods for addressing empirical questions that quantitative researchers may posit. Special focus is placed on the selection of appropriate observational methods and coding systems as well as on the analysis of reliability and validity. The use of technology to facilitate the collection and analysis of observational data is discussed. Ethical considerations and future directions are raised. Key Words:  Observation, observ er , time sampling , event sampling,participan t obse rvation, foca l participant sampling, semi-structur ed observations , scan sampling, interobserver reliability , Cohen’ s Kappa, observer drift, reactivity, remote audio -visual rec ording, computer -assisted observation al software Introduction Syst emat ic observ ationa l meth ods have been a common technique employed by psychologists stu dyi ng human and ani mal be hav ior since the inception of our eld, and yet best practices for the use of obs erv ati onal ins tru ments (see  T able 15.1) are often not known or adopted by researchers in our eld. As such, the quality of observational research varies widely, and thus, it is our goal in the present chapter to review and explicitly dene the standards of pra ctice for thi s imp ort ant met hod olog ica l too l in the psychological sciences. Bakeman and Gottman (1987) have previously dened observational meth- ods to include the  a priori  use of opera tional ly dened beh avi ora l cod es by obs erv ers who hav e achieved interobserver reliability. Importantly, the setting or context is not what denes a method as being systematic (P ellegrini, 2004). That is, system- atic observations may be conducted in the labora- tory, schools, workplace, public spaces and coded live or via recor dings/ transc ripts . Ther efore , hav- ing cle ar denit ions and sampli ng/r eco rd ing rul es as  well as reliable codes delineates informal, unsystem- atic observation from systematic observation. We also distinguish between the use of nonsystematic eld notes and other data collection techniques that are often used in qualitative studies by ethologists and educa tional pract itione rs in natura listi c contexts and only include a review and analysis of systematic observational methods (Pellegrini, Ostrov, Roseth, Solberg, & Dupuis, in press). Nonsystematic sampling techniques such as  Ad libitum  (i .e., ad li b) in wh ic h th ere are no  a  priori  systematic sampling or recording rules are often used by researchers as a part of pilot testing and help to inform the development of system- atic observ ationa l coding syste ms (P elle grini, 20 04). Thus, ad lib sampling approaches are important to understand the context and nature of the behav- iors under stu dy , but they will not be dis cussed 285

Upload: avril19

Post on 06-Jul-2018

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 1/19

Page 2: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 2/19

Page 3: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 3/19

Page 4: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 4/19

Page 5: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 5/19

Page 6: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 6/19

Page 7: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 7/19

Page 8: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 8/19

Page 9: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 9/19

Page 10: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 10/19

Page 11: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 11/19

Page 12: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 12/19

Page 13: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 13/19

Page 14: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 14/19

Page 15: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 15/19

Page 16: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 16/19

Page 17: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 17/19

Page 18: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 18/19

Page 19: Chap15 Observational Methods _Ostrov & Hart (in press).pdf

8/16/2019 Chap15 Observational Methods _Ostrov & Hart (in press).pdf

http://slidepdf.com/reader/full/chap15-observational-methods-ostrov-hart-in-presspdf 19/19