experiments and anova lecture
TRANSCRIPT
![Page 1: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/1.jpg)
Think of three experiments inspired by the classic Eames chair
DESIGN 1: EXPERIMENTSpurpose
problemsproof
![Page 2: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/2.jpg)
Descriptive orientation Observation - Naturalistic - Field - no control
Relational Orientation Correlational, association - non-intervention - statistical control
Experimental Orientation Control and manipulation
DESIGNS
![Page 3: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/3.jpg)
Descriptive orientation Observation - Naturalistic - Field - no control
Relational Orientation Correlational, association - non-intervention - statistical control
Experimental Orientation Control and manipulation
DESIGNS
![Page 4: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/4.jpg)
WHY?
![Page 5: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/5.jpg)
MANIPULATION &
CONTROL
![Page 6: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/6.jpg)
WHY?
![Page 7: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/7.jpg)
MANIPULATION &
CONTROLCAUSALITY
![Page 8: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/8.jpg)
David Hume (1711 – 1776)Scottish Philosopher
conditions of causality
Must be evidence of1. Mutual relationship (covariation)2. Temporal precedence (one before the other)3. Rival explanations ruled out (internal validity)
We have to settle for best available evidence
![Page 9: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/9.jpg)
Think of all the things that caused you to be in this room now?
![Page 10: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/10.jpg)
John Stuart Mills (1806 –1873)English Philosopher
Logic of experiments
1. Method of agreement (if X, then Y)2. Method of difference (if not X, then not Y)
![Page 11: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/11.jpg)
John Stuart Mills (1806 –1873)English Philosopher
Logic of experiments
1. Method of agreement (if X, then Y) Experimental Group2. Method of difference (if not X, then not Y) Control Group
![Page 13: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/13.jpg)
RANDOMselectionallocation
![Page 14: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/14.jpg)
How would you know if exercise reduced depression?
![Page 15: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/15.jpg)
Designs
![Page 16: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/16.jpg)
BETW EEN
![Page 17: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/17.jpg)
BETW EENWITHIN
![Page 18: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/18.jpg)
• Do males and females differ in their anxiety levels?• Does therapy reduce depression?• Does playing violent games lead to violent behaviour?• Is procrastination worse for males or females?• Does the university you attend affect your life chances?• Are richer people happier?• Does gardening improve concentration?• Does this lecture influence mood?• Does listening to music improve attention?
Within or Between?
![Page 19: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/19.jpg)
![Page 20: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/20.jpg)
BE TW EENBE TW EEN
FACTORIAL
3x3 BETWEEN
![Page 21: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/21.jpg)
BE TW EENWI TH IN
FACTORIAL
3x3 mixed
MIXED
![Page 22: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/22.jpg)
BET WEENBE TW EEN
FACTORIAL
2x3 BETWEEN
![Page 23: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/23.jpg)
BET WEENBET WEENBET WEEN
FACTORIAL
2x2x2 BETWEEN
![Page 24: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/24.jpg)
WI TH IN WI TH IN
FACTORIAL
3x3 WITHIN
![Page 25: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/25.jpg)
WIT HIN WI TH IN
FACTORIAL
2x3 WITHIN
![Page 26: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/26.jpg)
WIT HIN WIT HIN
FACTORIAL
2x2 WITHIN
![Page 27: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/27.jpg)
BET WEENWIT HIN
FACTORIAL
2x2 MIXED
MIXED
![Page 28: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/28.jpg)
BET WEENWI TH IN
FACTORIAL
2x3 MIXED
MIXED
![Page 29: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/29.jpg)
And so on....
![Page 30: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/30.jpg)
But... How many participants?Counterbalance within designsStatistical procedures....shhh later
![Page 31: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/31.jpg)
Pre-Treatment End of treatment 6 months post treatment
CBT
Psychotherapy
Exercise
Control
Does therapy work – if so which works best?
How would this be written up?A 2 (time: pre vs post) x 4 (treatment: CBT, Psychotherapy, Exercise, Control) mixed factorial design, with repeated measures on the time variable.
What effects?Effect of TimeEffect of ConditionInteraction of Time and Condition
![Page 32: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/32.jpg)
counterbalancing
![Page 33: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/33.jpg)
“Help, my experiments got problems...”
![Page 34: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/34.jpg)
Internal Validity
Threats
History = If study over time, what else has happened in the mean time?Maturation = If study over time, what has happened to the participants?Instrumentation = Are the instruments valid?Selection = Has this had an effect?Attrition = Have people dropped out? Some more than others?
Can we be sure that the effect is due to the variables we thought?
![Page 35: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/35.jpg)
ExternalValidityTask = is it ecologically valid?Setting = are the findings limited to a setting?Time = when was the study conducted, could this matter?Participants = can we generalise from them?
Threats
Can we extrapolate from the study itself?
![Page 36: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/36.jpg)
The psychology of the experiment
What the @*!#?
![Page 37: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/37.jpg)
SYSTEMATICRANDOM
Artifacts
ERRORS
![Page 38: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/38.jpg)
SYSTEMATICRANDOM ERRORS
![Page 39: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/39.jpg)
“Did I do ok?”“Did I ruin the study?”“Did I do it right?”
![Page 40: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/40.jpg)
“Did I do ok?”“Did I ruin the study?”“Did I do it right?”
“How should I behave here?”“Did I perform well in my rôle as an experimental subject”
Demand Characteristics
Volunteering is a commitment to comply!
Don’t ask WHY, just ask WHERE?
![Page 41: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/41.jpg)
SYSTEMATICRANDOM
Artifacts
ERRORSGood subjectsEvaluation apprehension – look goodExperimenter effects
![Page 42: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/42.jpg)
Situations– novel, formal, public– detailed and complete instructions– little choice of behaviour– brief duration
Personality– familiar, informal, private– few or no instructions– considerable choice of behaviour– lasts for a long time
When do situations matter?
Buss, A.(1989) Personality As Traits. American Psychologist, 44, 1378-1388
Like experiments Less like experiments
![Page 43: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/43.jpg)
Let’s have a look at doing some analysis
![Page 44: Experiments and anova lecture](https://reader038.vdocuments.us/reader038/viewer/2022110118/554dbddeb4c905c7488b4aeb/html5/thumbnails/44.jpg)
Pre-Treatment End of treatment 6 months post treatment
CBT
Psychotherapy
Exercise
Control
Does therapy work – if so which works best?
How would this be written up?A 2 (time: pre vs post) x 4 (treatment: CBT, Psychotherapy, Exercise, Control) mixed factorial design, with repeated measures on the time variable.
What effects?Effect of TimeEffect of ConditionInteraction of Time and Condition