top-down influences on the time-course of visual attention:
DESCRIPTION
Top-down influences on the time-course of visual attention:. When the attentional blink meets word superiority effect. Maria V. Falikman Lomonosov Moscow University. Research supported by the Russian Fund for Basic Researches, grant # 03-06-80191. Where cognitive science was born…. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/1.jpg)
Top-down influences on thetime-course of visual attention:
Maria V. Falikman
Lomonosov Moscow University
When the attentional blink meets word superiority effect
Research supported by the Russian Fund for Basic Researches, grant # 03-06-80191
![Page 2: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/2.jpg)
Where cognitive science was born…
“… “… I went away from the symposium I went away from the symposium with the strong conviction, more with the strong conviction, more intuitive than rational, that human intuitive than rational, that human experimental psychology, theoretical experimental psychology, theoretical linguistics, and computer simulation linguistics, and computer simulation of cognitive processes were all part of of cognitive processes were all part of a larger whole...” a larger whole...”
(George Miller on the (George Miller on the 1956 MIT Symposium)1956 MIT Symposium)
![Page 3: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/3.jpg)
Types of processing (information flow)
Top-down (conceptually-driven)
Bottom-up (data-driven)
Stimulus
Task,Experience
Conscious percept
![Page 4: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/4.jpg)
Top-down influenceson visual attention
Unconscious (implicit) Conscious (explicit)
Contextual cueingPriming (+/-)
Schemata
...
Strategic regulation of perceptual task
accomplishment
Context-based or
memory-based
Goal-directedor
task-dependent
![Page 5: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/5.jpg)
VISUAL PRESENTATION
Rapid Serial Visual Presentation (RSVP)
RA P I DS ER I A L
![Page 6: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/6.jpg)
RA P I DS
A L
The Attentional Blink (AB) under RSVP conditions
![Page 7: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/7.jpg)
RA P I DS ER I A L
The Attentional Blink (AB) under RSVP conditions
![Page 8: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/8.jpg)
RA P I DS
A L
The Attentional Blink (AB) under RSVP conditions
![Page 9: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/9.jpg)
RA P I DS ER I A L
The Attentional Blink (AB) under RSVP conditions
![Page 10: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/10.jpg)
RA P I DS
A L
The Attentional Blink (AB) under RSVP conditions
![Page 11: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/11.jpg)
RA P I DS ER I A L
The Attentional Blink (AB) under RSVP conditions
![Page 12: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/12.jpg)
RA P I DS
A L
The Attentional Blink (AB) under RSVP conditions
![Page 13: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/13.jpg)
RA P I DS
A L
ER I
The Attentional Blink (AB) under RSVP conditions
![Page 14: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/14.jpg)
RA P I DS
A L
The Attentional Blink (AB) under RSVP conditions
![Page 15: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/15.jpg)
RA P I DS
A L
ER I
The Attentional Blink (AB) under RSVP conditions
![Page 16: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/16.jpg)
0
20
40
60
80
100
0 1 2 3 4 5 6
Probe relative serial position
% C
orre
ct R
epor
ts
Experimentalcondition
Controlcondition
The AB effect replicated: Results of the standarddual-task RSVP experiment (2000)
![Page 17: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/17.jpg)
Why a blink?
Attentional gate model
Attentional dwell-time
theory
Two-stage model
Interference model
Object substitution
theoryCentral
interference theory
Perceptual system
reconfiguration
Hybrid models
Amnesia!Blindness!
![Page 18: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/18.jpg)
Early selection / filter (Broadbent, 1958)
Models of selective attention and models of its blink
Attentional gate(Raymond et al, 1992)
Late selection (Deutsch & Deutsch, 1963)
Pertinence model (Norman, 1968)
Interference model (Shapiro et al, 1994)
Two-stage model(Chun & Potter, 1995)
Multiple selection (Johnston & Heinz, 1979)
Flexible selection (Yantis & Johnston, 1990)
“Smart selection”(Shapiro & Luck, 1999)
“Intelligent filtering system”(Enns et al, 2001)
Perceptual cycle (Neisser, 1976)
Reentrant model (Di Lollo et al, 2000)
![Page 19: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/19.jpg)
Attention for action
Quo vadis?
Attention as an aspect of action
D.A. AllportO. NeumannA.H.C. van der Heijden
a set of “task-related
mechanisms” (e.g. Deacon & Shelley-Tremblay, 2000)
Gippenreiter, 1983 [rus]1986
or
![Page 20: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/20.jpg)
The prototypical “bottleneck” model
Early stage LC-stageT2 . . .
T2
Early stage LC-stageT1 T1 report
![Page 21: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/21.jpg)
0
20
40
60
80
100
0 1 2 3 4 5 6
Probe relative serial position
% C
orre
ct R
epor
ts
Experimentalcondition
Controlcondition
The AB effect: my old results again
![Page 22: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/22.jpg)
The AB effect might be due to the inability of perceptual system to obtain further information until the previous goal-directed act (conscious
target identification) is completed.
Then, the AB could be modulated through the change of the size of the observer’s activity “units”:
if we incorporate the 1st target into a larger perceptual “object”, the AB will probably not interrupt perception until the end of the act.
““The difficulty is not to combine stimuli, but rather to deal with them The difficulty is not to combine stimuli, but rather to deal with them independently at the same time... capacity limits occur where stimuli independently at the same time... capacity limits occur where stimuli have to be kept apart, not where they have to be combined…”have to be kept apart, not where they have to be combined…”
(Neumann, 1987, p.363)(Neumann, 1987, p.363)
![Page 23: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/23.jpg)
“Attentional units” larger than letters?
WWOO
RRDD
SS
![Page 24: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/24.jpg)
Stimuli examples: Russian letters
WRITTENPRINTED
![Page 25: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/25.jpg)
The word superiority effect
Better performance on letters within a word than on random letters:
• faster recognition
• more letters perceived within a brief (10 ms) presentation
““I find it takes about twice as long to read (aloud, as fast I find it takes about twice as long to read (aloud, as fast as possible) words which have no connexion as words as possible) words which have no connexion as words which make sentences, and letters which have no which make sentences, and letters which have no connexions as letters which make words. When the words connexions as letters which make words. When the words make sentences and the letters words, not only do the make sentences and the letters words, not only do the processes of seeing and naming overlap, but by one mental processes of seeing and naming overlap, but by one mental effort the subject can recognize a whole group of words or effort the subject can recognize a whole group of words or letters, and by one will-act choose the motions to be made letters, and by one will-act choose the motions to be made in naming them, so that the rate at which the words and in naming them, so that the rate at which the words and letters are read is really only limited by the maximum letters are read is really only limited by the maximum rapidity at which the speech organs can be moved...” rapidity at which the speech organs can be moved...”
(Cattell, 1886, p.64).(Cattell, 1886, p.64).
![Page 26: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/26.jpg)
The word superiority effect
Further explorations:
Reicher, 1969
Wheeler, 1970
McClelland, 1976
...
![Page 27: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/27.jpg)
The word superiority effect
R
![Page 28: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/28.jpg)
The word superiority effect
RW O D
![Page 29: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/29.jpg)
The word superiority effect
RW O D
![Page 30: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/30.jpg)
Some examples of “mutable” words(main experimental session)
...P I L O T #
...S P R I T E #
...B R I D G E #
I
…W A T E R #
L
…F A V O R #
G
…B R I D E #
![Page 31: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/31.jpg)
the AB is due to a certain bottom-up controlled limitation (“a bottleneck”),
Hypothesis
it is rather shaped by top-down processes in the information processing system,
it will leave its signature on the observers’ performance on mutable words.
it will either disappear or be diminished in the word-reading task.
IFIF
IFIF
![Page 32: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/32.jpg)
0
20
40
60
80
100
1 2 3 4 5 6
Probe relative serial position
% C
orre
ct R
epor
ts
Dual task(probe X)Single task(probe X)Mutablewords
Comparison of correct reports on separate letters in mutable words and on a probe X under “standard”
AB conditions (2000)
Word identification
point?
![Page 33: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/33.jpg)
0
20
40
60
80
100
1 2 3 4 5Probe relative serial position
% C
orr
ect
Re
port
s
Subject 6
Subject 17
Mean
There is a blink on mutable words! Individual differences.
![Page 34: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/34.jpg)
0
20
40
60
80
100
1 2 3 4 5Probe relative serial position
% C
orr
ect
Re
port
s
Mentioninga positionfor all wordstrings
And what about the overall result?
![Page 35: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/35.jpg)
The ACTUAL experimental design:
Concluding control
session:
identify the type of a white letter and name three letters following
it (after Weichselgartner
& Sperling, 1987)
Main experimental
session:
identify the type of a white letter and read a word beginning with
this letter
Preceding control
session:
identify the type of a white letter and name three letters following
it (after Weichselgartner
& Sperling, 1987)
![Page 36: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/36.jpg)
0
5
10
15
20
25
30
35
40
45
50
1 2 3 4 5 6
Relative serial position
Rep
ort
pro
bab
ility
, %
Preceedingsession
Concludingsession
Strategic change: Results of framing sessions
![Page 37: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/37.jpg)
There could be no strategic changes! Individual differences again.
0
10
20
30
40
50
60
70
80
1 2 3 4 5 6
Relative serial position
Rep
ort p
roba
bilit
y, %
0
10
20
30
40
50
60
70
80
1 2 3 4 5 6
Relative serial position
Rep
ort
pro
bab
ilit
y, %
Subject 16 Subject 2
![Page 38: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/38.jpg)
Control experiment: No practice effects
0
5
10
15
20
25
30
35
40
45
50
1 2 3 4 5 6
Relative serial position
Re
port
pro
babi
lity,
%
Preceedingsession
Concludingsession
No words noticed between!
![Page 39: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/39.jpg)
Word superiority in written vs. printed T1 task
T1 type identification
in the concluding
control session:
90.4 2.9%
T1 type identification in the word-
reading session:
96.2 2.4 %
T1 type identification
in the preceding control
session:
89 3.9%
Significant!(p<0.0001)
Significant!(p<0.0001)
![Page 40: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/40.jpg)
Subjective dual-task estimation through
the experimental sessions (% of subjects)
Preceding Preceding sessionsession
Concluding Concluding sessionsession
Main sessionMain session(word-(word-
reading)reading)
Two separate tasks A single whole
![Page 41: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/41.jpg)
The AB seems to depend on the task and on subjective strategies.
But strategies serve for achieving a goal,
the goal is to report on T1 etc.
For that, verbal working memory consolidation or encoding is essential!
and
![Page 42: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/42.jpg)
Working memory consolidation:
neurophysiological data P300 - a late ERP component, a correlate of working memory encoding and attentional load
T1: repeats the dynamics of the AB after T1 identification (McArthur et al, 1999)
T2: suppressed for missed probes during the AB (Vogel et al, 1998; see also Rolke et al, 2001)
![Page 43: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/43.jpg)
A possible model: two-stage compatible
S
P
H
A
R
E
PP
HH
PP HH
T1 + “word” WM encoding
ReportPP HH
RR
......
PP ......
T1 WM encoding...
...
Not yet!
RR
AA
Time to start WM encoding:- I got the word! - My VSTM buffer is full!
![Page 44: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/44.jpg)
Perceptual task accomplishment can in principle be organized in such a way, that, given a sufficient load of that limited-capacity block or process, the AB would either disappear or diminish and shift from its critical temporal interval.
These changes can be determined both externally (by task conditions and requirements) and internally (by subjective strategy), that is characteristic for any human activity.
Conclusions
![Page 45: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/45.jpg)
if T1 is an addition task (e.g. 2+3)
Hurrah!Hurrah!
Recent results working for this hypothesis:
and T2 is an answer
(seems to be… 5!)
there is no blink!
(Kunar & Shapiro, in preparation)
![Page 46: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/46.jpg)
Our results directly suggest that the attentional blink deficit does not represent merely the workings of a fixed capacity-limited mechanism for the perception of events occurring over time, but rather the structure of actions a subject has to perform in order to accomplish a given task.
Conclusions
![Page 47: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/47.jpg)
Pronounceable pseudowords
Missing controls?
- in progress Random strings, instruct to read words
- in progress
Words with ambiguous endings? - Thanks to Molly Potter for the brilliant idea! To be performed.
More ideas? - Please keep them in mind until the discussion...
![Page 48: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/48.jpg)
Visual search?
Prospect:
Crowding?
Metacontrast masking?
Unconscious perceptual priming?
- YES (Fine, in press)
Attentional switching (gating paradigm)?
![Page 49: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/49.jpg)
Special thanks to
Our programmers:
Ekaterina Pechenkova (Moscow University) for collaboration and invaluable discussions
Suren Sagiyan
Dr. Valeriy Romanov, Dr. Yuriy Dormashev (Moscow University) for inspiration of the AB research
George Kouryachy
![Page 50: Top-down influences on the time-course of visual attention:](https://reader035.vdocuments.us/reader035/viewer/2022062322/56814f2f550346895dbcbbd3/html5/thumbnails/50.jpg)
Thank you for your attention
that hopefully didn’t blink
(owing to the top-down regulation!)