How to do an observation

Segment 29 & 30 - PSYCHSCI

Types of Observations

• Structured Observation

• Semistructured Observation

• Observations in experiments

• Unstructured observation such as an ethnography (observational study of cultural practices)

• Self-observations such as diaries

Gathering information within an observation

• Use structured observation grids to narrow what you are looking for (related to the aim) – Orange book p.46• What behaviors are considered aggressive for a preschool child?• Are those behaviors different by gender?

• Three types of sampling for the grids• Time sampling: sample at pre-determined times• Event sampling: record only a specific set of events (details of prom

dancing)• Point sampling: observe one participant’s behavior, then move on

to the next participant

Gathering information within an observation

• Data-gathering devices• Video• Still camera• Audio• Hand-written notes (coding on the spot)

• Creating a code system (increases inter-rater reliability)• Create codes for most all common activities (Coolican p.121-122)

Reliability in observations

• Inter-rater reliability (multiple researchers observing the same thing) decreases researcher bias

• Inter-rater reliability can be measured with a correlation coefficient

Participant v. non-participant observations

• Participant advantages• High ecological validity• Reduces participant

expectancy (covert)• Increases reliability & validity

(covert)

• Participant Disadvantages• Ethical concerns (covert)• May not blend in enough to

avoid participant expectancy

• Non-participant disadvantages• Easy informed consent & low

ethical concerns

Naturalistic observations

• Advantages• Ecological validity is high• Very detailed accounts

• Disadvantages • Ethical dilemmas if covert• Time-consuming, which reduces the # of participants

Covert v. Overt observations

• Advantages of Covert• Less participant expectancy

• Disadvantages of Covert• Ethical issues with deception

• Advantages of Overt• Less ethical issues• Best if long-term to make

participants comfortable

• Disadvantages of Overt• Increases participant

expectancy

Setting up and carrying out an Observation

• Step 1 – choose goal(s)• Exploratory goals• Descriptive goals• Evaluative goals

• Step 2 – learn about the topic with a thorough study of appropriate literature

• Step 3 – defocus (empty your mind of pre-conceived notions)• Reduces researcher bias• Allows for self-knowledge to increase reflexivity (personal

knowledge? Bias?)

Setting up and carrying out an Observation

• Step 4 – research site• Choose and set up based on three factors

1. Choose site/participants who will give richest data2. (for ethnography) unfamiliar site w/o prior expertise increases

credibility3. Safe and physically accessable

• Step 5 - Decide on researcher role• Participant?• Covert? • Naturalistic?

Setting up and carrying out an Observation

• Step 6 – gaining access to participants• Gatekeepers (authorities who can provide access) are useful• Informants (people that can translate information or behaviors) are

vital• These people might have bias!!!!!!

• Step 7 – climb the access ladder • It takes time to get people to open up

• Step 8 – build rapport• People must feel like sharing

Setting up and carrying out an Observation

• Step 9 – create thick descriptions (detailed accounts of setting and context as well as what happened)• Reduces observer bias• Embrace serendipity (que sera sera, what will be, will be!)• Rigorous noted increase credibility • Separate your facts and inferences• Write the notes ASAP to avoid memory decay• Write analytical memos when you make choices while in the

observation• Make maps and diagrams to visually explain setting• Make a reflexive journal to note personal bias and feelings

Setting up and carrying out an Observation

• Step 10 – post-observation duties• Discuss findings with key participants to verify

• Increase ethics and credibility• Check & recheck interpretations with other researchers

• Increases inter-rater reliability• Debrief participants