![Page 1: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/1.jpg)
Visual Cognition
September 11, 2008
![Page 2: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/2.jpg)
Overview of Visual Cognition
• Visual system: mission critical• Multivariate inputs, unitary experience• Multiple types of vision means many
types of units in a distributed visual network
• Segregating vs. parsing• Visual experience reveals nature of
underlying representations• Theory >> data
![Page 3: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/3.jpg)
Who’s Coming to Dinner?
• Gestalt Psychology (interested in basic dimensions of perceptual organization)
• Cognitive Psychology (interested primarily in effects of cognitive operations on visual experience)
• Cognitive Neuropsychology (interested in effects of selective lesions of visual cortex on visual behavior)
• Electrophysiology (interested in single- and multiple-unit activity of cells in visual cortex)
• Cognitive science (interested in developing overall theories of visual experience and object recognition)
![Page 4: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/4.jpg)
Sensation and Perception• Sensation: Conscious outcome of sense
organs and projection regions. (“I detect something”, not necessarily conscious, and not necessarily meaningful)
• Perception: means by which information acquired from the environment via the sense organs is transformed (organized) into conscious experiences of objects, events, sounds, tastes, etc. (“I know, recognize, appreciate what I am sensing, and it means something to me”)
![Page 5: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/5.jpg)
Three Stages of Visual Processing
• Reception: absorption of physical energy by receptors
• Transduction: translation of physical energy into electrochemical activity of the nervous system
• Coding: how information is encoded and represented; relationship between aspects of the physical stimulus and resultant nervous system activity (e.g., rate, temporal patterning of neuronal activity)– Population coding– Sparse coding
![Page 6: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/6.jpg)
Basic Perceptual Phenomena You Already Know About
• Size and Shape Constancies: reflect mechanisms whereby perception of a distal object stays the same despite proximal changes in the perception – implies storage of a “structural representation”
• Depth Cues: monocular or binocular sources of information that convey information about relative distance of objects from viewer – involve cues about the structure, movement, and proximity of objects
![Page 7: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/7.jpg)
![Page 8: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/8.jpg)
Object vs. Spatial Vision
(Mishkin & Ungerleider)
General principle:
inferior lesions produce perceptual
impairments; superior lesions
produce syndromes dominated by
spatial impairment
![Page 9: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/9.jpg)
Milner & Goodale: Perception-Action Model
• Alternative to the Mishkin-Ungerleider model– Dorsal: “How do I interact with that
object”?– Ventral: “What is that object”?
• Evidence: distinctions between object recognition and visual control of action; Balint’s syndrome; optic ataxia
![Page 10: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/10.jpg)
Perceptual Organization
• Two complementary issues:– Organizing coherent objects and events out of
segregated sensory/perceptual inputs (“binding”)– “Parsing” the perceptual world; understanding
which inputs belong together and which come from separate objects
– http://www.michaelbach.de/ot/mot_feet_lin/index.html
![Page 11: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/11.jpg)
Perceptual Organization• Gestalt Psychology
– Law of Prägnanz: perceptual system organizes to the simplest and most stable shape possible from the array
– other laws describe how disparate perceptual elements are grouped
– although their “laws” are probably incorrect, the elementary concept of perceptual grouping is critical
– Inferring processes from performance
![Page 12: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/12.jpg)
Gestalt “Laws” of Perceptual Organization
proximity proximityproximity similarity
good continuation closure
![Page 13: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/13.jpg)
Figure–Ground Segregation
• A type of perceptual organization in which edges are assigned to regions for purposes of shape discrimination
![Page 14: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/14.jpg)
![Page 15: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/15.jpg)
Is PO learned or hard-wired?
• Schematic depiction of two types of displays: (a) homogeneous displays and (b) heterogeneous displays. From Spelke et al. (1993) with permission from Elsevier.
Infants do not use the principle of good continuation, suggesting that it is a learned phenomenon
![Page 16: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/16.jpg)
Is the “x” on the same or different object? Answering this question takes longer with the
display on the right. (why?)
Top-Down Influences in Grouping and Segmentation
Vecera & Farah, 1997
![Page 17: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/17.jpg)
![Page 18: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/18.jpg)
http://www.michaelbach.de/ot/fcs_SpatFreqComposites/index.html
Spatial Frequency Filtering
![Page 19: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/19.jpg)
Gestalt Theory in the 21Gestalt Theory in the 21stst CenturyCentury
• Basic perceptual principles have survived
• Contentions that such processes are necessarily very “early” in perception have not– Proximity computation occurs after depth
perception– Segmentation is not just “bottom-up”
(Vecera &Farah, 1997)
![Page 20: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/20.jpg)
Illusions are fun….
But their real value is that they reveal shed light on what is stored
about object structure
![Page 21: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/21.jpg)
Relative Size Texture Gradient
![Page 22: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/22.jpg)
Illustrates how visual illusions may be based on stored information about visual structure
http://www.michaelbach.de/ot/sze_muelue/index.html
![Page 23: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/23.jpg)
![Page 24: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/24.jpg)
Shape Constancy
![Page 25: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/25.jpg)
Depth PerceptionDepth Perception
Monocular depth cues – cues that provide depth information with one eye closed– pictorial cues (e.g., linear perspective)– aerial perspective (differing contrast)– texture gradients (decreased detail from front to
back)– interposition– shading (production of shadows by 3-D objects)– familiar size as anchor– motion parallax
![Page 26: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/26.jpg)
Monocular Depth Cues
-texture gradients
-relative size
-interposition
Crivelli:
The Annunciation
![Page 27: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/27.jpg)
Ingenious use of monocular depth cues to produce paradoxical perceptions
M.C. Escher: Waterfall
When Worlds Collide:
![Page 28: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/28.jpg)
Ames Room – importance of perceived distance/relative size
![Page 29: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/29.jpg)
Ames Room: Importance of perceived distance
http://www.youtube.com/watch?v=5ic7QGjGEX8
![Page 30: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/30.jpg)
Kanizsa (1976) – interposition as cue
![Page 31: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/31.jpg)
Kanizsa (1976)
http://www.michaelbach.de/ot/cog_kanizsa/index.html
![Page 32: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/32.jpg)
Shading as a Depth Cue to Concavity or
Convexity
Where is our major light source?
![Page 33: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/33.jpg)
Depth Perception (cont’d)
• Binocular Cues to Depth– Binocular disparity: different images to each eye
as a function of object closeness; basis of stereoscopic vision
– Binocular convergence: rotation of eyes depending on object closeness; brain receives efferent motor signals from ocular muscles and interprets distance accordingly
– Motion parallax: differential perception of motion (speed and direction) as a function of distance from perceiver
![Page 34: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/34.jpg)
![Page 35: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/35.jpg)
How are depth cues combined?
• Additively
• Preferentially
• Multiplicatively
• Most data suggests additivity, though one cue may occasionally overwhelm another in certain circumstances
![Page 36: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/36.jpg)
Color Vision
• Young-Helmholtz theory: three populations of cones– Wide receptivity to wavelenth (continuous, not
categorical; i.e., not just RGB detectors)
• Opponent-Process theory: R-G, B-Y, B-W– LGN cells show activity to some wavelengths
and activity to others
• Synthesis: Two-stage theory (Trichromatic at the level of neurons; O-P at the level of fibers and pathways)
![Page 37: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/37.jpg)
(“large-bodied”)
(“small-bodied”)
*
![Page 38: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/38.jpg)
Multiple Visual Areas Multiple Visual Areas (Zeki)(Zeki)
• V1 and V2: responsive to color and form
• V3 and V3A: form and motion
• V4: color
• V5: motion
![Page 39: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/39.jpg)
Color perception/cognition can Color perception/cognition can be selectively impairedbe selectively impaired
• Achromatopsia: selective impairment of inferior visual cortex (V4?)
• Color anomia: a general visual-verbal disconnection (seen with other visual-verbal disturbances)
• Specific color aphasia: specific inability to name colors
![Page 40: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/40.jpg)
Theories of PerceptionTheories of Perception• “Indirect” perception: perception is the result
of interactive processes from without and from within – use of internal representations based on “top-down” and “bottom-up” processing
• “Direct” perception (Gibson): information from the visual world is sufficient to permit perception without the involvement of internal representations - focus in “bottom-up” processing, without the need to posit internal representations
![Page 41: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/41.jpg)
““Direct” View (Gibson)Direct” View (Gibson)
• “Optic array” contains all necessary visual information
• Layout of objects in space given by texture gradients, optic flow patterns, and affordances (implied meaning of objects)
• Perception involves “picking up” information through “resonance”
Has had historical impact in restoring interest in the perceptual environment
Has been criticized as being underspecified, and neglects role of knowledge in stimulus exploration
![Page 42: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/42.jpg)
Data in Favor of “Indirect” Data in Favor of “Indirect” ViewView
• Context effects in perception: what is seen depends upon surround
• Effects of emotion (e.g., weapon focus)
• Visual illusions: idea is that general knowledge about objects is applied inappropriately to the perception of two-dimensional figures (e.g., Muller-Lyer)
![Page 43: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/43.jpg)
![Page 44: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/44.jpg)
Template Theories of Pattern Template Theories of Pattern RecognitionRecognition
• Template theories: a miniature copy or template of each known pattern is stored in long-term memory– straightforward template
theory– normalized template
theory• Problems
– not adaptable– impose large storage
requirements
![Page 45: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/45.jpg)
![Page 46: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/46.jpg)
Feature Theories of Pattern Feature Theories of Pattern RecognitionRecognition
• Feature theories: pat-terns consist of a set of specific features or attributes
• Advantages:– elementary features can
combine to form multiple objects
• Problems:– context effects in
perception– recognition can take
place when features are occluded
![Page 47: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/47.jpg)
Prototype Theories of Pattern Recognition
• Individual instances are not stored; what is stored is an “exemplar” or representative element of a category
• Recognition based on “distance” between perceived item and prototype
• Nature of computation still relatively unknown
![Page 48: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/48.jpg)
![Page 49: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/49.jpg)
Global Processing Precedence
Navon (1977): Is the large letter an H or an S? Are the small letters H’s or S’s?
Decision speed for small letters greatly affected by whether large letter was the same or different; decision speed for large lettters unaffected by small letters
Hemispheric differences, particularly for divided attention tasks
![Page 50: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/50.jpg)
Theories of Object Recognition
![Page 51: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/51.jpg)
Object Recognition: Key Object Recognition: Key QuestionsQuestions
• When does one object end and another begin? (grouping/segmentation)
• Viewpoint independence (perception of objects as objects, regardless of view)
• How do we know that that two things belong together, and how do we know that dogs are dogs and not cats? (categorization)
![Page 52: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/52.jpg)
More Key Issues• The “binding problem”: if perception of a
given object is distributed throughout visual areas, how does the brain combine features to produce unitary percept?
• Conscious vs. unconscious perception: perception of some object or object qualities may proceed pre-consciously or without effort (a general principle)– Example: Threat
![Page 53: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/53.jpg)
![Page 54: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/54.jpg)
High Low
Spatial Frequency Domain
![Page 55: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/55.jpg)
The Building Blocks of Object The Building Blocks of Object Recognition: Marr’s RepresentationsRecognition: Marr’s Representations
• Primal Sketch: 2-D representation of light intensity changes, information about edges, contours, and blobs– Raw: pure light intensity
changes– Full: uses information to
identify shapes• 2 1/2-D Sketch: depth and
orientation of visible surfaces, shading, texture, motion, binocular disparity; observer-centered
• 3-D Sketch: three dimensional description of objects independent of view
![Page 56: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/56.jpg)
Marr-Hildreth Algorithm• Attempts to account for
development of primal sketch
• Idea of “blurred repres-entations”
• “Zero-crossings” identify edges within a visual image
• Only ‘reliable’ zero-cross-ings are kept
• Four types of tokens: edge-segments, bars, terminations, and blobs
Intensity change
Rate of change (1st D)
Zero-crossing (2nd D)
![Page 57: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/57.jpg)
Marr & Nishihara (1978)
• Development of 3-D sketch based on processing of more elementary shape primitives (basic primitive is a cylinder with a major axis)
• Hierarchical organization of primitives• Concavities important in segmenting parts• This is a completely computational, not
empirical, model
![Page 58: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/58.jpg)
![Page 59: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/59.jpg)
Biederman’s RBC Theory• Objects built from primitives called “geons” (n
= 36)• Viewer must decide appropriate way a visual
object is to be segmented into geons• Two key components of decision:
– locating concavity– deciding which edge information remains invariant
across different viewing angles (invariant properties like curvature, parallelism, etc.)
![Page 60: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/60.jpg)
Biederman’s Recognition-
by-Components
Theory
• Adapted from Biederman (1987)
![Page 61: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/61.jpg)
Recognition-by-Components Theory
• Biederman (1987): five invariant properties of edges– Curvature: points on a curve– Parallelism: sets of points in parallel– Cotermination: edges terminating at a
common point– Symmetry: versus asymmetry– Collinearity: points sharing a common
line
![Page 62: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/62.jpg)
Biederman (1987). Participants were presented with degraded line drawings of objects. Recognition was much harder to achieve when parts of the contour containing concavity information were omitted
than when other parts of the contour were deleted. This confirms the assumption that information about concavities is important for object recognition. Figures adapted from Biederman (1987). Biederman’s
view is “viewpoint invariant”
![Page 63: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/63.jpg)
![Page 64: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/64.jpg)
![Page 65: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/65.jpg)
Viewpoint-dependent and Viewpoint-invariant
Theories• Biederman (1987)
– The ease of object recognition is not affected by the observer’s viewpoint
• Tarr (1995), Tarr and Bülthoff (1995, 1998)– Changes in viewpoint reduce the speed
and/or accuracy of object recognition
• Milner and Goodale (1995)– Dorsal pathway makes use of viewpoint-
dependent information– Ventral pathway makes use of viewpoint-
invariant information
![Page 66: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/66.jpg)
Common Elements in Object Recognition
Theories• Edge coding
• Grouping or encoding into higher-order features
• Matching to a stored “structural representation”
• Access to semantic knowledge
![Page 67: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/67.jpg)
Face Recognition
• Two general theories:– Neural substrate model (module)– Specialized processing model
• Face recognition can be selectively impaired (prosopagnosia), or can it?
• Global (configurational) vs. local (feature-based) processing
![Page 68: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/68.jpg)
Two Models:
-neural substrate (modules)
-specialized processing
![Page 69: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/69.jpg)
![Page 70: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/70.jpg)
V4 (color)FFA (face)
![Page 71: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/71.jpg)
Neural Substrate Example: the “Fusiform Face Area”
![Page 72: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/72.jpg)
Spiridon, Fischl, & Kanwisher, Hum Brain Mapping, 2006
![Page 73: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/73.jpg)
Spiridon, Fischl, & Kanwisher, Hum Brain Mapping, 2006
![Page 74: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/74.jpg)
Examples of “Greebles”. In the top row, four different “families” are represented. For each family, two members of different “genders” are shown (e.g., Ribu is one gender and Pila is the other). The bottom row shows a new set of Greeble figures constructed on the same logic but asymmetrical in structure. Images provided courtesy of Michael J. Tarr
(Brown University, Providence, RI).
![Page 75: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/75.jpg)
Speed of Greeble matching as a function of stage training and difference in orientation between successive Greeble stimuli. Based on data in Gauthier and
Tarr (2002). Figure shows that, although speed increases with training, Greeble identification is still viewpoint dependent
![Page 76: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/76.jpg)
Face Recognition
• Probably involves specialized processing/visual expertise
• Dedicated neural substrates aren’t the only answer
• Hybrid model: neural substrates dedicated to configural processing
![Page 77: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/77.jpg)
Disorders of Object Recognition – Visual Agnosia
• Apperceptive agnosia– Object recognition is impaired because of
deficits in perceptual processing
• Associative agnosia– Perceptual processes are essentially intact,
but object recognition is impaired partly or mainly because of difficulties in accessing relevant knowledge about objects from memory
![Page 78: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/78.jpg)
Riddoch and Humphreys (2001)A hierarchical model of object recognition
and naming, specifying
different component processes which,
when impaired, can produce
varieties of apperceptive and
associative agnosia.
![Page 79: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/79.jpg)
![Page 80: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/80.jpg)
Structural DescriptionsStructural Descriptions
• Structural descriptions consist of propositions which “describe the nature of the components of a configuration and make explicit the spatial arrangement of these parts” (Bruce & Green, 1990)
• Perceptual representation systems for faces, objects, etc. Evidence for separate systems: category-specific recognition defects
![Page 81: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/81.jpg)
O bj ect- Centered
Representation
spoken name
N ame Retr ieval
(S peech O utput Lexicon)
S emantic S ystem
O bj ect Recognit ion
U nits
Viewer - Centered
Representation
I nit ial
Representation
S ensation of O bj ect
![Page 82: Visual Cognition September 11, 2008. Overview of Visual Cognition Visual system: mission critical Multivariate inputs, unitary experience Multiple types](https://reader033.vdocuments.us/reader033/viewer/2022051113/56649d985503460f94a8207f/html5/thumbnails/82.jpg)