1 psy280: perception prof. anderson department of psychology vision 7 motion
Post on 14-Dec-2015
214 Views
Preview:
TRANSCRIPT
1
Psy280: Psy280: PerceptionPerception
Prof. AndersonProf. Anderson
Department of PsychologyDepartment of Psychology
Vision 7Vision 7
MotionMotion
2
Optional papers: Optional papers: QuALMRIQuALMRI
QuQuestion/hypothesisestion/hypothesis AAlternativelternative LLogicogic MMethodethod RResultsesults IInferencesnferences
Detailed description on websiteDetailed description on website
3
Part 2: Perceiving SizePart 2: Perceiving Size Not as simple as size of stimulus on retinaNot as simple as size of stimulus on retina Visual angle: retinal projection depends on Visual angle: retinal projection depends on
distancedistance Different physical Different physical sizesize Same retinalSame retinalProjectionProjection
Bigger stimulus further awayBigger stimulus further away = visual angle to closer smaller stimulus= visual angle to closer smaller stimulus
4
Size constancySize constancy
Perception of size remains constantPerception of size remains constant Despite different visual angle/retinal Despite different visual angle/retinal
sizesize
5
Size distance scalingSize distance scaling
Perceived size = Perceived size = retinal imageretinal image sizesize X X distance from objectdistance from object
Without depth informationWithout depth information Perceived size = Perceived size = retinal image sizeretinal image size
2 x distance but same retinal size = 2 x perceived size
6
Emmert’s lawEmmert’s law
Perceived size of an after image Perceived size of an after image depends on depth perception depends on depth perception (consistent with S = R x D)(consistent with S = R x D)
7
Size-depth illusionsSize-depth illusions Moon appears larger on the horizon than the skyMoon appears larger on the horizon than the sky
Same retinal sizeSame retinal size Difference in magnitude Difference in magnitude
estimationestimation Horizon provides depth cuesHorizon provides depth cues Sky does notSky does not
Appear flattenedAppear flattened
8
MotionMotion
9
Motion: Frames of Motion: Frames of referencereference
What does the term "at rest" mean?What does the term "at rest" mean? Can you cite an example of an object at rest?Can you cite an example of an object at rest?
Is the room at rest? Is the room at rest? Room has at least three types of motion Room has at least three types of motion
Motion due to earth :Motion due to earth :24000 miles / 24 hours = 24000 miles / 24 hours = 10001000 miles/hr miles/hr
Earth circles the sun:Earth circles the sun:2 pi 93,000,000 miles / 8760 hours = 2 pi 93,000,000 miles / 8760 hours = 6670066700 miles/hr miles/hr
Sun circles the galaxy (30,000 light year = r) every 1 / 4 Sun circles the galaxy (30,000 light year = r) every 1 / 4 billion years billion years 1.76 x 101.76 x 101717 miles / 2.19 x 10 miles / 2.19 x 101212 hr = hr = 8040080400 miles/ hr miles/ hr
Is there anything that is not moving?Is there anything that is not moving? Must be careful about our description of motionMust be careful about our description of motion Moving relative to what reference frame?Moving relative to what reference frame?
10
Animism: Worshiping the Animism: Worshiping the lightlight
Divides living Divides living organismsorganisms Animals vs plantsAnimals vs plants Capacity for Capacity for
voluntary movement voluntary movement vs phototropismvs phototropism
Co-evolutionCo-evolution Organisms that Organisms that
movemove Evolution of a Evolution of a
capacity to sense capacity to sense movementmovement
QuickTime™ and aSorenson Video decompressorare needed to see this picture.
11
Invisible motion: Invisible motion: Morning gloryMorning glory
5 AM to 7PM5 AM to 7PM Open in morningOpen in morning
Pollination by diurnal Pollination by diurnal insectinsect
Dies in afternoonDies in afternoon Motion too slow to Motion too slow to
notice even dramatic notice even dramatic changechange
Our visual system are Our visual system are tuned to events that tuned to events that move more quicklymove more quickly E.g., Animals (fast) not E.g., Animals (fast) not
plants (slow)plants (slow)
QuickTime™ and aSorenson Video decompressorare needed to see this picture.
12
Motion and change Motion and change detectiondetection
Visual motion is sensing change in Visual motion is sensing change in retinal image (sort of)retinal image (sort of)
As duration between changes As duration between changes increases perception of motion increases perception of motion decreasesdecreases
Motion is a perceptual adaptation Motion is a perceptual adaptation for detection of change, otherwise for detection of change, otherwise invisible to the eyeinvisible to the eyeCan’t tell
difference across space
Can tell difference across time
QuickTime™ and aGraphics decompressorare needed to see this picture.
13
Motion and the retinal Motion and the retinal imageimage
Change in image intensity Change in image intensity (luminance) over time(luminance) over time Dark to lightDark to light Light to darkLight to dark
Difference imageQuickTime™ and aGraphics decompressorare needed to see this picture.
14
Illusory movement:Illusory movement:Apparent motionApparent motion
Luminance changeLuminance change No physical No physical
continuitycontinuity Infer motion where Infer motion where
none is presentnone is present Critical Critical
temporal/spatial temporal/spatial parametersparameters Simultaneous flicker Simultaneous flicker
<10-30 ms interval<10-30 ms interval Perceive 2 eventsPerceive 2 events
MotionMotion ~60 ms interval~60 ms interval Perceive 1 eventPerceive 1 event
QuickTime™ and aGIF decompressorare needed to see this picture.QuickTime™ and aGIF decompressorare needed to see this picture.
15
Not just simple luminance Not just simple luminance change: 2nd order motionchange: 2nd order motion First-order motionFirst-order motion
Change in luminance Change in luminance boundaryboundary
Luminance change Luminance change doesn’t explain all doesn’t explain all motionmotion
Second-order motionSecond-order motion Motion but no Motion but no
luminance boundaryluminance boundary Not net luminance Not net luminance
changechange Object disappears Object disappears
when motion stopswhen motion stops
QuickTime™ and aAnimation decompressorare needed to see this picture.
16
Second order motion:Second order motion:Illusory shapes and Illusory shapes and
motionmotion No luminance No luminance boundary for low-level boundary for low-level motion detectors to motion detectors to useuse
Motion perception Motion perception must rely on other top-must rely on other top-down/higher-order down/higher-order influencesinfluences
Simple luminance Simple luminance based motion detectors based motion detectors can’t explain all of can’t explain all of motion perceptionmotion perception
QuickTime™ and aAnimation decompressorare needed to see this picture.
17
Simple luminance detectors Simple luminance detectors won’t do: The aperture won’t do: The aperture
problemproblem Narrow view of world through small receptive Narrow view of world through small receptive
fields (RF)fields (RF) Ambiguity of direction of motionAmbiguity of direction of motion
Need additional info for accurate motion sensingNeed additional info for accurate motion sensing Edges or textureEdges or texture
18
The aperture problemThe aperture problem Looking at motion Looking at motion
through the through the window of one window of one neuronneuron
RF represents RF represents horizontal motionhorizontal motion
Global scene has Global scene has different motiondifferent motion Local computations Local computations
don’t necessarily don’t necessarily explain motionexplain motion
Need to share Need to share information across information across neuronsneurons Perceived motion
QuickTime™ and aAnimation decompressorare needed to see this picture.QuickTime™ and aAnimation decompressorare needed to see this picture.
19
Motion perception: Motion perception: More than the sum of its More than the sum of its
partsparts The underlying mechanism involves
signals at different retinal locations being integrated to arrive at global motion signals
20
Motion integration at the Motion integration at the same retinal location: same retinal location:
PlaidsPlaids First order low-level First order low-level motion detectors motion detectors Respond to each Respond to each
component of motion component of motion (horizontal and (horizontal and vertical)vertical)
Motion integrationMotion integration Don’t perceive eitherDon’t perceive either Create common Create common
directional signaldirectional signal Like force vectorsLike force vectors
Down & left moving Down & left moving plaidplaid
QuickTime™ and aGraphics decompressorare needed to see this picture.
QuickTime™ and aGraphics decompressorare needed to see this picture.
21
Motion detection as an Motion detection as an opponent processopponent process
Like colour vision: Red-green, blue-Like colour vision: Red-green, blue-yellowyellow
MotionMotion Up-downUp-down Left-rightLeft-right Spiral in-out Spiral in-out
Enhances “motion contrast”Enhances “motion contrast”
22
Motion after effectMotion after effect Reversing waterfallReversing waterfall Fatigue your direction Fatigue your direction
sensitive neuronssensitive neurons See opposite motion See opposite motion
where there is nonewhere there is none ExplanationExplanation
No motionNo motion Direction selective cells Direction selective cells
produce equal responsesproduce equal responses No longer equally oppose No longer equally oppose
each othereach other E.g., Adapt to red—E.g., Adapt to red—
>perceive green>perceive green
QuickTime™ and aAnimation decompressorare needed to see this picture.
23
Spiral motion after Spiral motion after effect: Disfiguring Bradeffect: Disfiguring Brad
QuickTime™ and aGIF decompressorare needed to see this picture.
• Fatigue neurons representing radial expansion• Induces radial contraction due to lessened inhibitory influence• Motion (perception) is a perceptual/neural process, not necessarily a property of the world (object movement)!
24
Direction repulsion: Direction repulsion: Lateral inhibitory Lateral inhibitory
influences in motioninfluences in motion Vertical and 45 Vertical and 45
degree movementdegree movement Interact to enlarge Interact to enlarge
directional disparitydirectional disparity Evidence of lateral Evidence of lateral
inhibitory inhibitory interactions between interactions between motion detectorsmotion detectors
Enhancement of Enhancement of directional “contrast”directional “contrast”
Motion “mach bands”Motion “mach bands”
QuickTime™ and aGraphics decompressorare needed to see this picture.
Actual Perceived
25
Perceptual organization: Perceptual organization: Structure from motionStructure from motion
Motion perception Motion perception not used just to assess not used just to assess stimulus movementstimulus movement
Can define “objects”Can define “objects” Laws of organizationLaws of organization
Common fateCommon fate Things that move Things that move
together belong to together belong to same objectsame object
A camouflaged animal A camouflaged animal is difficult to see until is difficult to see until it movesit moves
Not just knowledge Not just knowledge basedbased Can see novel objectsCan see novel objects
QuickTime™ and aVideo decompressorare needed to see this picture.QuickTime™ and aVideo decompressorare needed to see this picture.
QuickTime™ and aYUV420 codec decompressorare needed to see this picture.
26
Structure from motion: Structure from motion: Kinetic depthKinetic depth
Can define depthCan define depth What motion cues What motion cues
define depth?define depth? ParallaxParallax
Differing dot Differing dot velocityvelocity
Track single dotTrack single dot See velocity changeSee velocity change
Infer depth from Infer depth from motionmotion
QuickTime™ and aAnimation decompressorare needed to see this picture.
27
Kinetic depth: Shadow Kinetic depth: Shadow motionmotion
Moving shadows are Moving shadows are also strong cue for also strong cue for depth changedepth change
HeuristicHeuristic Ambiguous infoAmbiguous info
Shadow might reflect Shadow might reflect light source movementlight source movement
Assume light source Assume light source is constantis constant
Sun doesn’t move Sun doesn’t move that fastthat fast
QuickTime™ and aGraphics decompressorare needed to see this picture.
QuickTime™ and aCinepak decompressorare needed to see this picture.
28
Experience and motion Experience and motion perception: Biological perception: Biological
motionmotion Dot walkersDot walkers We each have We each have
our own motion our own motion signaturesignature Recognition by Recognition by
motionmotion Experience Experience
influences influences motion motion perceptionperception
QuickTime™ and aAnimation decompressorare needed to see this picture.
29
Motion from structureMotion from structure
Not only can Not only can motion induce motion induce shape perceptionshape perception
Shape can Shape can induce motion induce motion perceptionperception
Top-down Top-down influencesinfluences FFA/IT —> MTFFA/IT —> MT
30
Motion from structureMotion from structure
Not only can Not only can motion induce motion induce shape perceptionshape perception
Shape can Shape can induce motion induce motion perceptionperception
Top-down Top-down influencesinfluences FFA/IT —> MTFFA/IT —> MT
31
How does the brain How does the brain represent motion?represent motion?
32
V1: Simple motion V1: Simple motion detectorsdetectors
Directionally selectiveDirectionally selective E.g., right ward and upE.g., right ward and up
Small receptive fieldsSmall receptive fields Local not global motionLocal not global motion
Thus, respond to Thus, respond to components of a plaid, components of a plaid, not perceived directionnot perceived direction
Higher level info must Higher level info must override V1 simple override V1 simple motionmotion
33
Designing a directionally Designing a directionally selective V1 neuronselective V1 neuron
Temporal componentTemporal component Built in delaysBuilt in delays
Neuron to neuron Neuron to neuron communication takes communication takes timetime
Timing of inhibition is Timing of inhibition is criticalcritical
Results in neuron Results in neuron liking right to left liking right to left motionmotion Not left to rightNot left to right
Delayed inhibition
34
The brain’s motion eye: The brain’s motion eye: Area MT (V5)Area MT (V5)
Middle temporal area (MT)Middle temporal area (MT) Dorsal streamDorsal stream 90% of cells are directionally 90% of cells are directionally
selectiveselective Organized in directional Organized in directional
columnscolumns Like V1 orientation or IT shape Like V1 orientation or IT shape
columnscolumns Stimulation of column Stimulation of column
increases directional motion increases directional motion perceptionperception
100 times larger than V1 RFs100 times larger than V1 RFs Wide view of worldWide view of world Good for composite motionGood for composite motion
Human MT
35
MT motion processing:MT motion processing:Random dot stimuliRandom dot stimuli
0%, 30%, and 100% coherence0%, 30%, and 100% coherence Use to determine monkey/human detection of Use to determine monkey/human detection of
directional motiondirectional motion
QuickTime™ and aVideo decompressorare needed to see this picture.QuickTime™ and aVideo decompressorare needed to see this picture.QuickTime™ and aVideo decompressorare needed to see this picture.
How do we know MT supports motion How do we know MT supports motion perception?perception?
36
Psychophysical and Psychophysical and neural motion response neural motion response
profilesprofiles Neuronal Neuronal
response related response related to perceptual to perceptual experience of experience of motion?motion?
MT neuron firing MT neuron firing rate parallels rate parallels perceptionperception
Neuron and observer motion detection
Random dots
37
Stimulation of MT and Stimulation of MT and motionmotion
Neurons response Neurons response correlatedcorrelated with with perceptual perceptual experience of experience of motionmotion
Causally related?Causally related? Stimulation of MT Stimulation of MT
increasesincreases propensity to propensity to perceive motion in perceive motion in certain directioncertain direction
Right
Left
Proportion seen right directed motion
38
After MT: After MT: Increasing Increasing
complexity/specificitycomplexity/specificity Medial superior Medial superior temporal (MST)temporal (MST) More specific More specific
patternspatterns Expansion/Expansion/
contractioncontraction Superior temporal Superior temporal
sulcus (STS)sulcus (STS) Biological motionBiological motion
Higherarchical Higherarchical organization and organization and sepcificity coding sepcificity coding extends to motionextends to motion
Neuron 1 Neuron 2
39
Keeping the world stillKeeping the world still Examples of motion w/out retinal changeExamples of motion w/out retinal change
E.g., motion after effectsE.g., motion after effects
What about retinal change w/out motion?What about retinal change w/out motion?
Eyes constantly make small fast movementsEyes constantly make small fast movements Remember: World fades without these movementsRemember: World fades without these movements
Why doesn’t world appear to shake or move Why doesn’t world appear to shake or move when we move our eyes?when we move our eyes? Would get pretty nauseatingWould get pretty nauseating
Vision needs to “correct” for eye movementsVision needs to “correct” for eye movements How does it do it?How does it do it?
40
Corollary discharge Corollary discharge theorytheory
Integration of retinal stimulation and eye Integration of retinal stimulation and eye movementsmovements
Use motor signals to stabilize visionUse motor signals to stabilize vision Head movementHead movement Eye movementEye movement
How about movement without motor signal?How about movement without motor signal? (keep one eye closed) Push your open eye. Gently (keep one eye closed) Push your open eye. Gently
please!please! World moves!World moves!
41
Corollary discharge Corollary discharge theorytheory
3 signals3 signals Motor (MS)Motor (MS) Image movement (IMS)Image movement (IMS) Corollary discharge Corollary discharge
(CDS) (CDS) Comparator (c)Comparator (c)
Eye (IMS) and motor Eye (IMS) and motor signals (MS) need to be signals (MS) need to be comparedcompared
CDS is a copy of motor CDS is a copy of motor signalsignal
CDS and IMS cancel CDS and IMS cancel each othereach other
When both are present When both are present no signal sent to visual no signal sent to visual cortexcortex
——> No perception of > No perception of motionmotion
Visual cortex
CDS
Motor cortex
IMS
C
MS
Eye
42
Corollary discharge Corollary discharge theorytheory
Anytime CDS and IMS don’t co-occur —> perceive motionAnytime CDS and IMS don’t co-occur —> perceive motion
IMS alone —> perceive motionIMS alone —> perceive motion Veridical movementVeridical movement
Eyes still, stimulus movesEyes still, stimulus moves
Illusory movement Illusory movement Pushing your eyePushing your eye Move image on retinaMove image on retinaw/out MS/CDSw/out MS/CDS
This theory makes interesting predictionsThis theory makes interesting predictions CDS alone should also result in motionCDS alone should also result in motion
43
CDS: Moving after CDS: Moving after images!images!
CDS without IMSCDS without IMS Doesn’t often happenDoesn’t often happen No canceling of IMS and No canceling of IMS and
CDSCDS Should result in motion Should result in motion
perceptionperception
After imagesAfter images No IMSNo IMS
Fatigued photoreceptors Fatigued photoreceptors result in stationary result in stationary “stimulus”“stimulus”
MS/CDS without IMSMS/CDS without IMS After images move!After images move!
44
CDS alone results in CDS alone results in motion perceptionmotion perception
Track a flying birdTrack a flying bird No IMS, stabilized on retinaNo IMS, stabilized on retina MS/CDS without IMSMS/CDS without IMS CDS activates motion perception in CDS activates motion perception in
cortexcortex
Paralyze eye musclesParalyze eye muscles Can send MS but no eye movementCan send MS but no eye movement
MS/CDS without IMSMS/CDS without IMS Stationary events appear to moveStationary events appear to move
45
Motion perception is more Motion perception is more than movement across the than movement across the
retinaretina Perception more than what retina tells usPerception more than what retina tells us So what’s new!So what’s new!
Can dissociate retinal change and motion Can dissociate retinal change and motion perceptionperception
Retinal change without motion perceptionRetinal change without motion perception Move eyes across stationary sceneMove eyes across stationary scene
World doesn’t move despite radical retinal shiftWorld doesn’t move despite radical retinal shift
Motion perception without retinal changeMotion perception without retinal change Track a moving objectTrack a moving object
No movement across retina: Powerful perception of No movement across retina: Powerful perception of motionmotion
46
““Real movement” Real movement” neuronsneurons
Higher order cortical Higher order cortical neurons (e.g. V3)neurons (e.g. V3) Bar moves through RFBar moves through RF
Move barMove bar Move eyesMove eyes
Retinal stimulation held Retinal stimulation held constantconstant
Respond most when not Respond most when not moving eyesmoving eyes
V1?V1?
Real movement neuron
47
The EndThe End
48
MT and virtual motionMT and virtual motion
MT responsive to virtual motionMT responsive to virtual motion Motion after effects or illusory motionMotion after effects or illusory motion No retinal changeNo retinal change Stimulate MT—>voila! MotionStimulate MT—>voila! Motion
Time course of MT activation follows motion after effect
49
3D motion: 3D motion: More motion heuristicsMore motion heuristics
Visual stimulus is Visual stimulus is ambiguousambiguous Multiple Multiple
interpretationsinterpretations Which is visual Which is visual
system attracted to?system attracted to? Vision assumes Vision assumes
movement of rigid movement of rigid objectsobjects
QuickTime™ and aGraphics decompressorare needed to see this picture.
50
Intelligence of motion Intelligence of motion perceptionperception
1. Notice oscillation in direction of motion: Due to single reversal
2. Look at with and without blinking your eyes
QuickTime™ and aGIF decompressorare needed to see this picture.
top related