research methods
DESCRIPTION
How do we know when we know. Research Methods. Outline. What is Research Measurement Method Types Statistical Reasoning Issues in Human Factors. What is Research. Purpose To learn something To base reasoning on evidence instead of merely our own assumptions - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/1.jpg)
RESEARCH METHODS
How do we know when we know
![Page 2: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/2.jpg)
Outline
What is Research Measurement Method Types Statistical Reasoning Issues in Human Factors
![Page 3: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/3.jpg)
What is Research
PurposeTo learn somethingTo base reasoning on evidence instead of
merely our own assumptions Scientific vs. Nonscientific Research
How one gathers evidenceEvidence in:
○ History○ Math○ Chemistry
![Page 4: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/4.jpg)
Measurement: General Definition: to put a number on an
observation e.g.: thermometer, IQ Why?
Allows easier comparisonThe inherent ambiguity of language
![Page 5: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/5.jpg)
Characteristics of Good Measurement Reliability
Consistency in measurementTake repeated measures, get same value
ValidityMeasure what think measure.
![Page 6: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/6.jpg)
Validity Types
EcologicalMatch to situation
Internal:The study is well designedThe conclusions regarding theory can be
made External:
The results apply to the desired populationImportant in Human Factors Research
![Page 7: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/7.jpg)
Example: Lighting Study
100 fC Illumination
10,000 fC Illumination
1000 fC Illumination
![Page 8: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/8.jpg)
Method Types
Descriptive Correlational Experimental
![Page 9: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/9.jpg)
Descriptive
Why Use?e.g. Anthropometric data
Archival Data Observational Methods
Interobserver Agreement
![Page 10: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/10.jpg)
Correlational
Measure patterns of relationship Prediction Laws Correlation does not imply causation
Why?
![Page 11: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/11.jpg)
Scatter Plots
-0.4 -0.3 -0.2 -0.1 0 0.1 0.2 0.3 0.4
-150
-100
-50
0
50
100
Web Vert
Lab Vert
Log Column Proportion
Fra
me
Re
lati
ve
to
Sta
rtin
g I
n P
os
tio
n
(arc
min
)
![Page 12: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/12.jpg)
Scatter Plot
40.00 50.00 60.00 70.00 80.00 90.00 100.00 110.00 120.00 130.00 140.0020.00
40.00
60.00
80.00
100.00
120.00
140.00
160.00
GEQ
PA
![Page 13: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/13.jpg)
Experimental
Manipulation Independent Variable Dependent Variable Causation
Requirements:○ Temporal Order○ Co-variation (Correlation)○ Rule out All Alternatives
![Page 14: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/14.jpg)
Statistical Reasoning
Elements Variation in Data
ErrorPossible influence of IV
Question:Is variation in data due to error?Is variation in data due to error and IV?Sound familiar? Signal Detection Theory
![Page 15: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/15.jpg)
Statistics and Signal Detection Theory Alpha = criterion Type I error: probability of concluding
there is an effect when there is not one = False AlarmUse Alpha to set this probability
Type II Error: Probability of not concluding there is an effect when there is one = Miss
Effect Size = d’
![Page 16: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/16.jpg)
Statistical Hypotheses
These are what are tested by stats – not theories
H0: Null Hypothesis: only error is making data vary
Ha: Alternative Hypothesis: error and IV are making data vary
Stats give you p value or sig value = p(H0) is true
![Page 17: Research Methods](https://reader035.vdocuments.us/reader035/viewer/2022062217/56812a93550346895d8e44de/html5/thumbnails/17.jpg)
Proper uses of Stats
Are they necessary with large effect sizes (d’)?
What do you do if p > alpha? What do you do if p < alpha? What does it mean to Reject H0? Do you ever accept H0? If you reject H0 have you analyzed your
data?