the problems with time neuroenigmas lecture january 19, 2007
TRANSCRIPT
The Problems With Time
Neuroenigmas Lecture
January 19, 2007
Neural processing is not instantaneous
Neural processing is not instantaneous
40 ms
Neural processing is not instantaneous
40 ms
100 ms
Neural processing is not instantaneous
Neural processing is not instantaneous
When is this a problem?
100 mph fast ball moves 15 feet in 100 ms
How might we compensate for neural delays?
How might we compensate for neural delays?
• Sensory compensation
• Motor compensation
http://www.interchange.ubc.ca/vsearch/research/objectupdating/obj_index.html
Theories to explain flash-lag effect
• Motion extrapolation
• Motion integration and post diction
• Latency differences for moving and stationary items
• Attentional capture by flashed item
Citation for review
Flag errors in soccer games: the flash-lag effect
brought to real life
Perception, 2002, volume 31, pages 1205 ^ 1210
Marcus Vinicius C Baldo, Ronald D Ranvaud, Edgard Morya
DOI:10.1068/p3422
Psychophysics
+
-1.0 -0.5 0 0 .5 1 .0
Psychophysics
+
0
0.2
0.4
0.6
0.8
1
Isolated Flash
Subject JD Position (deg)
Pro
por
tion
repo
rted
rig
ht
-1.0 -0.5 0 0 .5 1 .0
-1.0 -0.5 0 0 .5 1 .0
Psychophysics
+
0
0.2
0.4
0.6
0.8
1
Isolated Flash
Subject JD Position (deg)
Pro
por
tion
repo
rted
rig
ht
Psychophysics
+
Psychophysics
+
Psychophysics
+
Psychophysics
+
Psychophysics
+
Psychophysics
+
Psychophysics
+
Psychophysics
+
Psychophysics
+
Psychophysics
+
Psychophysics
+
Psychophysics
+
Psychophysics
+
-1.0 -0.5 0 0 .5 1 .0
Psychophysics
+
0
0.2
0.4
0.6
0.8
1
Flash in motion
Subject JD Position (deg)
Pro
por
tion
repo
rted
rig
ht
-1.0 -0.5 0 0 .5 1 .0
-1.0 -0.5 0 0 .5 1 .0
Psychophysics
+
0
0.2
0.4
0.6
0.8
1
Flash in motion
Subject JD Position (deg)
Pro
por
tion
repo
rted
rig
ht
-1.0 -0.5 0 0 .5 1 .0
.39o
Physiology
Tootell, R. B., M. S. Silverman, et al. Science (1982)
Retinotopy in cat
Prediction: Under conditions that give rise to the perceived shift, receptive fields should shift in a direction opposite to motion direction.
RF
Physiology
RF
Physiology
RF
Physiology
flash positions
RF
Physiology
flash positions
Physiology
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
Physiology
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
Physiology
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
Physiology
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
Physiology
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
Physiology
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
Physiology
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
Physiology
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
Physiology
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
Physiology
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
Physiology
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
Physiology
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
Physiology
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
Physiology
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
Physiology
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
Physiology
1.2 2.0 2.8 3.6 4.4 5.2 6.0.40
5
10
15
20
25
30
35
40
45
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
firin
g ra
te
Position (deg)
rightleftbaseline
Physiology
0
5
10
15
20
25
30
35
40
45
0 100 200 5000
10
20
30
40
50
Time (ms)
firin
g ra
te
1.2 2.0 2.8 3.6 4.4 5.2 6.0.4
firin
g ra
te
Position (deg)
rightleftbaseline
Physiology
0
5
10
15
20
25
30
35
40
45
0 100 4000
10
20
30
40
50
Time (ms)
firin
g ra
te
1.2 2.0 2.8 3.6 4.4 5.2 6.0.4
firin
g ra
te
Position (deg)
rightleftbaseline
Physiology
0
50
0
5
10
15
20
25
30
35
40
45
1.2 2.0 2.8 3.6 4.4 5.2 6.0.4
firin
g ra
te
Position (deg)
rightleftbaseline
Physiology
0
50
0 1500
50
0
5
10
15
20
25
30
35
40
45
1.2 2.0 2.8 3.6 4.4 5.2 6.0.4
firin
g ra
te
Position (deg)
rightleftbaseline
Physiology
0
50
0 1500
50
0
5
10
15
20
25
30
35
40
45
1.2 2.0 2.8 3.6 4.4 5.2 6.0.4
1 o
firin
g ra
te
Position (deg)
rightleftbaseline
flash positions
RF
Physiology
Physiology
0
5
10
15
20
25
30
35
40
45
1.2 2.0 2.8 3.6 4.4 5.2 6.0.4
firin
g ra
te
Position (deg)
Physiology
0
5
10
15
20
25
30
35
40
45
1.2 2.0 2.8 3.6 4.4 5.2 6.0.4
firin
g ra
te
Position (deg)
Physiology
0
5
10
15
20
25
30
35
40
45
**
* *
** *
1.2 2.0 2.8.4
Inward
Outward
firin
g ra
te
Position (deg)
Physiology
10 12 14 160
5
10
15
20
25
30
35
40
45
**
** *
***
*
* *
1.2 2.0 2.8.4
Inward
Outward
firin
g ra
te
Position (deg)
Physiology
10 12 14 160
5
10
15
20
25
30
35
40
45
**
** *
***
*
* *Shift Index = 1.2o
1.2 2.0 2.8.4
Inward
Outward
firin
g ra
te
Position (deg)
Example cell
Physiology
0 .4 .8 1.2 1.6 2.0 2.4 2.80
50
100
150
200
firin
g r
ate
position (deg)
0 .4 .8 1.2 1.6 2.0 2.4 2.80
10
20
30
40
50
firin
g r
ate
position (deg)0 .4 .8 1.2 1.6 2.0 2.4 2.8
0
10
20
30
40
50
60
firin
g r
ate
position (deg)
0 .4 .8 1.2 1.6 2.0 2.4 2.80
10
20
30
40
50
60
70
80
firin
g r
ate
position (deg)
** *
*
* **
***
*
*
* *
* ***
*
* *
*
*
* ***
S.I. = 1.2o S.I. = 0.4o
S.I. = 0.4o S.I. = 0.8o
Physiology
-2.0 0 2.0
0
5
10
15
20
Mean S.I. = .31o
p < .0001
n = 59
num
ber
of c
ells
Position (deg)
-2.0 0 2.0
0
5
10
15
20
Physiology
Full Motion sequence Mean S.I. = .31o
p < .0001
n = 59
num
ber
of c
ells
Position (deg)
Physiology
Full Motion sequence
Shift across population = .31o
p < .0001
Physiology
Full Motion sequence
Shift across population = .31o
p < .0001
Flash Terminal sequence
Physiology
Full Motion sequence
Shift across population = .31o
p < .0001
Flash Terminal sequence
Shift across population = .34o
p < .0001
Physiology
Full Motion sequence
Shift across population = .31o
p < .0001
Flash Terminal sequence
Shift across population = .34o
p < .0001
Single Color sequence
Physiology
Full Motion sequence
Shift across population = .31o
p < .0001
Flash Terminal sequence
Shift across population = .34o
p < .0001
Single Color sequence
Shift across population = .12o
p = .14
Physiology
Non-Color Selective Cells
Similar results to full population
Summary
Summary
• Spatial representation of the the flashed element is distorted
Summary
• Spatial representation of the the flashed element is distorted
• Apparent in the first responses
Summary
• Spatial representation of the the flashed element is distorted
• Apparent in the first responses
• Similar in magnitude to mislocalization in humans
Summary
• Spatial representation of the the flashed element is distorted
• Apparent in the first responses
• Similar in magnitude to mislocalization in humans
• Motion alone is not sufficient to induce shift
Summary
• Spatial representation of the the flashed element is distorted
• Apparent in the first responses
• Similar in magnitude to mislocalization in humans
• Motion alone is not sufficient to induce shift
• Dissociation between perception and V4 physiology in the flashed terminal condition
Summary
• Spatial representation of the the flashed element is distorted
• Apparent in the first responses
• Similar in magnitude to mislocalization in humans
• Motion alone is not sufficient to induce shift
• Dissociation between perception and V4 physiology in the flashed terminal condition
• V4 distortion does not require motion following the flash
Position
PositionPosition
Full motion condition Flash terminal condition
Bhavin R. Sheth, Romi Nijhawan, & Shinsuke Shimojo. (2000). Changing objects lead briefly flashed ones. Nature Neuroscience 3, 489-495.
David Alais & David Burr. (2003). The flash-lag effect occurs in audition and crossmodally. Current Biology 13, 59-63.
R.H. Cai, K. Jacobson, R. Baloh, M. Schlag-Rey & J. Schlag. (2000) Vestibular signals can distort the perceived spatial relationship of retinal stimuli. Experimental Brain Research 135, 275-278.
Alan Johnston & Shinya Nishida (2001). “Time perception: brain time or event time. Current Biology 11, R427-R430.
K. Moutoussis and S. Zeki, Functional segregation and temporal hierarchy of the visual perceptive systems. Proc R Soc Lond [Biol] Biol Sci 264 (1997), pp. 1407–1414.
Color Motion Asynchrony Illusion