motion perception - dt2350 human perception for …...dt2350 human perception for information...

46
Motion Perception DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH [email protected] HT 2016 1 / 44

Upload: others

Post on 27-Jun-2020

10 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Motion PerceptionDT2350 Human Perception for Information

Technology

Giampiero Salvi

KTH/CSC/TMH [email protected]

HT 2016

1 / 44

Page 2: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Literature

Goldstein, E. (2009/2014) Sensation andPerception

I Chapter 8: Motion Perception

Weinschenk, S.M. (2011) 100 Things EveryDesigner Needs to Know About People

I surprisingly I could not find any relevantchapter

2 / 44

Page 3: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Motion Perception

1. stationary observer, moving stimuli

2. moving observer3 / 44

Page 4: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Importance of Motion Perception

I detect danger

I perceive behaviour

I disambiguate vision

4 / 44

Page 5: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Motion AgnosiaExample: 43-years-old woman who suffered a stroke

Zihl et al. (1983,1991)

5 / 44

Page 6: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Motion as Attention Capture

The three “F”s

1. Fight

2. Flee

3. Freeze

3. makes it harder to differentiate between theanimal and the background

6 / 44

Page 7: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Explanation

I bird hard to see because same lines asbackground

I movement perceptually organises bird lines intoone object

8 / 44

Page 8: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Important Even Without Camouflage

I vision is ambiguous

I pattern recognition more difficult thanmovement detection

I research show we perceive shapes moreaccurately if the object is moving

9 / 44

Page 9: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Real vs Illusory Motion

Illusory motion:

I apparent motion

I induced motion

I motion aftereffects

10 / 44

Page 10: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Apparent Motion

It is the basis for movies and television

11 / 44

Page 11: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Induced Motion

12 / 44

Page 12: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Motion Aftereffects

13 / 44

Page 13: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Demonstration

http://youtu.be/oNhcpOIQCNs

14 / 44

Page 14: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Are Real and Apparent Motion DifferentPerceptually?

Visual cortexLarsen et al. (2006)

15 / 44

Page 15: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Neural Explanation of Motion PerceptionReichardt detector

Werner Richardt (1969)

16 / 44

Page 16: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Reichardt detector (1969)

17 / 44

Page 17: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Reichardt detector (1969)

17 / 44

Page 18: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Reichardt detector (1969)

17 / 44

Page 19: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Reichardt detector (1969)

17 / 44

Page 20: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Reichardt detector (1969)

17 / 44

Page 21: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Motion Perception Cannot Be Explainedwith the Retina

Jeremy walks, Maria looks straight at the window

18 / 44

Page 22: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Motion Perception Cannot Be Explainedwith the Retina

Jeremy walks, Maria follows him with the eyes

19 / 44

Page 23: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Motion Perception Cannot Be Explainedwith the Retina

Maria walks in the room

20 / 44

Page 24: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Information In The Environment

Gibson: disregard the retina

I Jeremy generates a local disturbance of theoptic array

I this happens both if Maria looks straight orfollows him

I when Maria moves it is different: global opticflow

21 / 44

Page 25: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Global Optic Flow

I in this case everything moves

I this tells Maria that what she sees is stationaryand that she is the one moving

22 / 44

Page 26: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Problems

I Eye motions: Corollary discharge theory

I Aperture problem (neuron receptive field)

23 / 44

Page 27: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Taking Eye Motions Into Account

NOTE: the book does not take head movementsinto account

24 / 44

Page 28: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Corollary Discharge Model

I corollary discharge signal (CDS)

I image displacement signal (IDS)

25 / 44

Page 29: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

CDM: Moving Person

26 / 44

Page 30: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

CDM: Scanning Stationary Scene

27 / 44

Page 31: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Behavioural Demonstration 1

corollary discharge (eye movement) without imagedisplacement

28 / 44

Page 32: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Behavioural Demonstration 2corollary discharge (muscle contraction) withoutimage displacement

29 / 44

Page 33: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Physiological Evidence

I patient with lesions

I did not receive corollary discharge

I everything moved around when he moved hiseyes

Haarmeier et al. (1997)

30 / 44

Page 34: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Physiological Evidence in Monkeys

“real motion neuron”

Galletti and Fattori (2003)

31 / 44

Page 35: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Motion of Arrays of Dots

I possible to vary difficulty of perception (degreeof coherence)

I monkeys’ ability to detect direction

I response of neuron in Medial Temporal cortex

Newsome et al. (1989)

32 / 44

Page 36: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Relationship to Physiology

(Monkeys must be trained for months to indicatethe direction)

33 / 44

Page 37: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Effect of Lesioning and Microstimulation

I without lesioning they detect motion with1-2% coherence

I with lesioning they need 10-20% coherence

I with stimulation can change direction ofmovement

34 / 44

Page 38: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Physiology: The Aperture Problem

35 / 44

Page 39: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Physiology: The Aperture Problem

36 / 44

Page 40: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Physiology: The Aperture Problem

37 / 44

Page 41: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Medial Temporal Area: Pooling Responses

Neurons in Medial Temporal Area

I up to 70msec orientation of the bar

I after 140msec real movement

I use object edge detectors in Striate Cortex

Pack and Born (2001)

38 / 44

Page 42: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Perceiving Biological MotionPoint-light walker

39 / 44

Page 43: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Point-light Walker Example

http://youtu.be/r0kLC-pridI

40 / 44

Page 44: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Brain Activation to Biological MotionStimulating Superior Temporal Sulcus (STS)disrupts biological motion perception

Grossman et al. (2005)41 / 44

Page 45: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Beyond the Stimulus: Implied MotionKnowledge based motion perceptionrepresentational momentum (Reed and Vinson, 1996)

42 / 44

Page 46: Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

Implied and Apparent Motion

Ramachandran and Anstis (1986)

43 / 44