advanced research methods psyc325 signal detection theory with special thanks to dr. murray white
DESCRIPTION
Advanced Research Methods PSYC325 Signal Detection Theory with special thanks to Dr. Murray White. Dr. Jan Lauwereyns EA619, ext. 5042 [email protected]. Lecture notes, available on website http://pavlov.psyc.vuw.ac.nz/325 Brief concepts - PowerPoint PPT PresentationTRANSCRIPT
Advanced Research MethodsPSYC325
Signal Detection Theory
with special thanks to Dr. Murray White
Dr. Jan Lauwereyns
EA619, ext. 5042
• Lecture notes, available on website
http://pavlov.psyc.vuw.ac.nz/325
• Brief concepts
Green, D. M., & Swets, J. A. (1966). Signal Detection Theory and Psychophysics. New York: John Wiley.
HitMiss
Correct Rejection
False Alarm
Response
No Yes
Present
Absent
The 2 X 2 Stimulus-Response MatrixStimulus – Response Matrix
Response
Sti
mu
lus
928
42 58
You said
No Yes
Present
Absent
100
100
1st session
4258
92 8
You said
No Yes
Present
Absent
100
100
2nd session
Stim
ulu
sS
timu
lus
Response
Response
Stimulus Detection: The Dice Game Analogy
6
3?0?
6 3?
0?
Special die:three or naught
Certainty
+ + =
Certainty
+ + =
3
14
Uncertainty
+ + = 8
+ + = 8
?
?
If the total is 3…
If the total is 14…
If the total is 8…
The specialdie has to be0
The specialdie has to be3
The specialdie can beeither 0 or 3
+ + = 6
+ + = 6
+ + = 6
+ + = 6
+ + = 6
+ + = 6
+ + = 6
Sp
ecia
l die
= 0
Sp
ecia
l die
= 3
If the total is 6…
Total score from the three dice
3 4 5 6 7 8 9 10 11 12 13 14 152
2 3 4 5 6 5 4 3 2 1 0 0 01
0 0 1 2 3 4 5 6 5 4 3 2 10
0
3
3 4 5 6 7 8 9 10 11 12 13 14 152
Total score from the three dice
1/36
2/36
3/36
4/36
5/36
6/36
Possible outcomes of each throw
HitMiss
Correct Rejection
False Alarm
you say
0 3
3
0
Possible outcomes of each throw
You say…
Th
e sp
ecia
l die
is…
3 97
28 72
100
100 6
8 92
42 58 7
17 83
58 42
28 72
72 28
42 58
83 17
58 42
92 8
8
9
10
11
Say “3” when the total is
Outcome from 200 throws
>
>
>
>
>
>
.028
3 4 5 6 7 8 9 10 11 12 13 14 152
Total score from the three dice
8 92
42 58
100
100
You said
0 3
0
3
False Alarms
Hits
.056
.083
.111
.139
.167
Criterion
(Note: .028 = 1/36, etc.)
.028
3 4 5 6 7 8 9 10 11 12 13 14 152
Total score from the three dice
42 58
83 17
100
100
You said
0 3
0
3
False Alarms Hits
.056
.083
.111
.139
.167
Criterion
0 .1 .2 .3 .4 .5 .6 .7 .8 .9 1
0
.1
.2
.3
.4
.5
.6
.7
.8
.9
1
Probability of a False Alarm
710
> 7
> 10
What rule might you adopt if you were asked not to miss too many “3s”?
Suppose you adopted the rule to say 3 when the total was 10
Suppose you adopted the rule to say 3 when the total was 7
You said
0 3
0
3 42 58
83 17
You said
0 3
0
3 8 92
42 58
6 4
> 10 > 7
-$580
+$460
-$170
+$290
-$10
What rule might you adopt if you were given $5 for each Hit and penalised $10 for each False Alarm? The payoff matrix would look like this:
You said
0 3
0
3 +$5
Suppose you adopted the rule to say 3 when the total was 10
Suppose you adopted the rule to say 3 when the total was 7
64
> 10 > 7
+$120 -$120
Now let’s use a different die:
A special die withthree faces ‘6’and three faces ‘0’
instead ofthree faces ‘3’and three faces ‘0’
.028
.056
.083
.111
.139
.167
Total score from the three dice
3 4 5 6 7 8 9 10 11 12 13 14 152
2 3 4 5 6 5 4 3 2 1 0 0 01
0 0 1 2 3 4 5 6 5 4 3 2 10
0
6
Total score from the three dice
16 17 18
0 0 0
0 0 0
3 4 5 6 7 8 9 10 11 12 13 14 152 16 17 18
0 .1 .2 .3 .4 .5 .6 .7 .8 .9 1
0
.1
.2
.3
.4
.5
.6
.7
.8
.9
1
Probability of a False Alarm
When the special die has 6 on three faces and 0 on three.
compared with when special die had 3 on three faces
Level of activation
low highmoderate
Signal absent
Signal present
d´= 1.0
Compare with when dice values are 3 and 0
There is a 3
There is no 3
Total of the three dice
Special die with 3’s and O’s
Level of activation
low highmoderate
d´= 2.0
Compare with when dice values are 6 and 0
There is a 6There is no 6
Total of the three dice
Special die with 6’s and O’s
Criterion
risky
ß
False Alarms
Criterion
No Yes
Left liberal
Criterion
risky cautious
ß
False Alarms
CriterionNo Yes
Right conservative
beta versus d’
• Effects of – signal-to-noise ratio (d’) – decision criteria (beta)
• Effects of – perceptual sensitivity – response bias
Effects of Scene Context
on Object Perception
Biederman& co.
Context facilitatesthe perception of congruent objects
De Graef,Henderson,
Hollingworth
There is only a response bias
Effects of Reward Expectation
on Neural Mechanisms of Visual Discrimination
Lauwereyns et al. (2002, Neuron): “wishful seeing”
Reward leads to general increase of neural activity = bias effect; no change in d’
Summary
• Signal detection theory allows you to…
– Consider choice situations systematically– Tease apart underlying processes
• Sensitivity– d’ (“d prime”)– Signal to noise ratio– Information characteristics
• Bias– beta (criterion)– Likelihood of response– Demand characteristics