introduction

1
Intention Recognition in Autistic Spectrum Condition (ASC) using Video Recordings and their Corresponding Animacy Display. Phil McAleer 1 , Lawrie McKay 1 , Judith Piggot 2 , David R. Simmons 1 , Frank E. Pollick 1 1 Department of Psychology, University of Glasgow, 2 Cardiff University [email protected] http://paco.psy.gla.ac.uk & www.psy.gla.ac.uk/~phil Introduction Animacy Displays Conclusions References • Heider and Simmel (1944) showed that people, on viewing a simple animation involving geometric shapes, would attribute emotions and intentions to the shapes based on their movements. • People with Autistic Spectrum Condition (ASC) are known to be deficient in visualizing the intent of others, especially in “Theory of Mind” tasks involving animacy displays (Castelli, Frith, Happe & Frith, 2002). • Our previous research introduced a new method to create animacy displays directly from human motion, and results showed people attributed higher ratings of animacy to displays showing an overhead perspective (McAleer et al. 2004). • We continue to use this method of stimuli production to investigate: (1) the attribution of social intention in people with ASC’s; (2) the effect of viewpoint of the display; (3) compare the judgement of intention in the animacy displays to the corresponding original video displays. • A pair of actors were filmed on a 3½m square stage using two digital video cameras: one positioned directly above centre stage (Overhead); the second positioned inline with the centre of the side of the stage (SideView). The actors performed the following six intentions: Chase, Fight, Flirt, Follow, Guard & Play (Blythe, Todd & Miller, 1999). • The X and Y co-ordinates were extracted from the footage using the EyesWeb open platform for multimedia production and motion analysis, which tracks the centre of mass of the silhouette image for each respective person. (www.eyesweb.org). • Using Matlab, the Psychophysics Toolbox and Showtime, these co-ordinates were filtered to reduce noise and then used to create QuickTime movies depicting white disks on a grey background. Blythe, P.W., Todd, P.M., and Miller, G.F. (1999). Judging intention from motion: Basic mechanisms for social rationality. In G. Gigerenzer, P.M. Todd, and the ABC Research Group, Simple heuristics that make us smart. New York: Oxford University Press. Castelli, F., Frith, C., Happe, F. & Frith, U., (2002). Autism, Asperger syndrome and brain mechanisms for the attribution of mental states to animated shapes, Brain, 125 1839 - 1849 Heider, F., & Simmel, M., (1944). An Experimental Study of Apparent Behavior, American Journal of Psychology, 57:2. McAleer, P., Mazzarino, B., Volpe, G., Camurri, A., Patterson, H., & Pollick, F. (2004). Perceiving Animacy and Arousal in Transformed Displays of Human Interaction. Journal of Vision, Results No significant difference between groups. Effect of Viewpoint, F(1,6) = 9.1, p<0.05, (Overhead > Side). Stimulus Production Video Displays Results Effect of viewpoint across groups, F(1,6) = 6.3, p<0.05, (Overhead for ASC Group < Overhead Controls = Side View Controls). Overhea d Side View Time Overhea d Side View Time Design • 6 Intentions: CHASE, FIGHT, FLIRT, FOLLOW, GUARD & PLAY. • 2 Viewpoints: OVERHEAD & SIDE. Task 6 ALTERNATIVE FORCED CHOICE. Participants ASC group: 4 males (age 18 – 25), diagnosed using the Autistic Diagnosis Interview (ADI). Control group: 4 males (age 18 – 25). Though results are preliminary with further research and a larger clinical sample required, they suggest: • People with ASC’s can attribute intention to video displays, but this ability is greatly diminished in displays shown from an overhead perspective. • People with ASC’s are poorer at attributing intention to animacy displays compared to a control population. Confusion Matrices Confusion Matrices S ide -C ontrolG roup -A nim acy Response Fight G uard Flirt Follow P lay Chase Fight 0.75 0.125 0 0 0.125 0 G uard 0.375 0.375 0 0 0.25 0 P resented Flirt 0.125 0 0.75 0 0.125 0 Follow 0 0 0 0.25 0.625 0.125 P lay 0.625 0 0 0 0.375 0 Chase 0.125 0 0 0.25 0.125 0.5 O verhead -ControlG roup -A nim acy Response Fight G uard Flirt Follow P lay Chase Fight 0.625 0.25 0 0 0.125 0 G uard 0 1 0 0 0 0 P resented Flirt 0 0.125 0.75 0 0.125 0 Follow 0 0 0 0.875 0 0.125 P lay 0.125 0.25 0 0 0.5 0.125 Chase 0 0 0 0.625 0 0.375 Side -ASC G roup -A nim acy Response Fight G uard Flirt Follow P lay Chase Fight 0.625 0 0 0 0.375 0 G uard 0.25 0.25 0.125 0 0.25 0.125 P resented Flirt 0.125 0 0.5 0.25 0.125 0 Follow 0 0.125 0.125 0.125 0.5 0.125 P lay 0.625 0 0.25 0 0.125 0 Chase 0 0 0.25 0.375 0.375 0 O verhead -ASC G roup -A nim acy Response Fight G uard Flirt Follow P lay Chase Fight 0.5 0.25 0 0.125 0.125 0 G uard 0.25 0.625 0 0 0.125 0 P resented Flirt 0 0.25 0.75 0 0 0 Follow 0 0 0 0.875 0 0.125 P lay 0.375 0.25 0 0 0.375 0 Chase 0 0 0.125 0.625 0 0.25 S ide -C ontrolG roup -Video Response Fight G uard Flirt Follow P lay Chase Fight 0.875 0.125 0 0 0 0 G uard 0.125 0.875 0 0 0 0 P resented Flirt 0 0 1 0 0 0 Follow 0 0 0 1 0 0 P lay 0 0 0 0 0.75 0.25 Chase 0 0 0 0.5 0.125 0.375 O verhead -ControlG roup -Video Response Fight G uard Flirt Follow P lay Chase Fight 1 0 0 0 0 0 G uard 0.125 0.875 0 0 0 0 P resented Flirt 0 0 0.75 0 0.25 0 Follow 0 0 0 1 0 0 P lay 0.25 0 0 0 0.75 0 Chase 0 0 0 0.5 0 0.5 Side -ASC G roup -Video Response Fight G uard Flirt Follow P lay Chase Fight 0.875 0 0 0 0 0 G uard 0.375 0.5 0 0 0 0 P resented Flirt 0 0 0.25 0.25 0.25 0 Follow 0 0 0 1 0 0 P lay 0.25 0.125 0 0 0.625 0 Chase 0 0 0 0.25 0 0.75 O verhead -ASC G roup -V ideo Response Fight G uard Flirt Follow P lay Chase Fight 0.5 0.125 0.125 0 0 0 G uard 0.5 0.25 0 0 0 0 P resented Flirt 0 0.125 0.375 0.125 0.25 0 Follow 0 0 0 1 0 0 P lay 0.375 0.125 0 0.125 0.375 0 Chase 0 0 0 0.625 0 0.25 0 0.2 0.4 0.6 0.8 1 S ide O verhead VID EO Proportion C orrect C ontrolG roup ASC G roup Chance 0 0.2 0.4 0.6 0.8 1 S ide O verhead AN IM AC Y Proportion C orrect C ontrolG roup ASC G roup C hance

Upload: iola-alexander

Post on 02-Jan-2016

15 views

Category:

Documents


2 download

DESCRIPTION

Intention Recognition in Autistic Spectrum Condition (ASC) using Video Recordings and their Corresponding Animacy Display. Phil McAleer 1 , Lawrie McKay 1 , Judith Piggot 2 , David R. Simmons 1 , Frank E. Pollick 1 1 Department of Psychology, University of Glasgow, 2 Cardiff University - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Introduction

Intention Recognition in Autistic Spectrum Condition (ASC) using Video Recordings and their Corresponding

Animacy Display.Phil McAleer1, Lawrie McKay1, Judith Piggot2, David R. Simmons1, Frank E. Pollick1

1Department of Psychology, University of Glasgow, 2Cardiff University

[email protected]://paco.psy.gla.ac.uk & www.psy.gla.ac.uk/~phil

Introduction

Animacy Displays

Conclusions

References

• Heider and Simmel (1944) showed that people, on viewing a simple animation involving geometric shapes, would attribute emotions and intentions to the shapes based on their movements.

• People with Autistic Spectrum Condition (ASC) are known to be deficient in visualizing the intent of others, especially in “Theory of Mind” tasks involving animacy displays (Castelli, Frith, Happe & Frith, 2002).

• Our previous research introduced a new method to create animacy displays directly from human motion, and results showed people attributed higher ratings of animacy to displays showing an overhead perspective (McAleer et al. 2004).

• We continue to use this method of stimuli production to investigate: (1) the attribution of social intention in people with ASC’s; (2) the effect of viewpoint of the display; (3) compare the judgement of intention in the animacy displays to the corresponding original video displays.

• A pair of actors were filmed on a 3½m square stage using two digital video cameras: one positioned directly above centre stage (Overhead); the second positioned inline with the centre of the side of the stage (SideView). The actors performed the following six intentions: Chase, Fight, Flirt, Follow, Guard & Play (Blythe, Todd & Miller, 1999).

• The X and Y co-ordinates were extracted from the footage using the EyesWeb open platform for multimedia production and motion analysis, which tracks the centre of mass of the silhouette image for each respective person. (www.eyesweb.org).

• Using Matlab, the Psychophysics Toolbox and Showtime, these co-ordinates were filtered to reduce noise and then used to create QuickTime movies depicting white disks on a grey background.

Blythe, P.W., Todd, P.M., and Miller, G.F. (1999). Judging intention from motion: Basic mechanisms for social rationality. In G. Gigerenzer, P.M. Todd, and the ABC Research Group, Simple heuristics that make us smart. New York: Oxford University Press.

Castelli, F., Frith, C., Happe, F. & Frith, U., (2002). Autism, Asperger syndrome and brain mechanisms for the attribution of mental states to animated shapes, Brain, 125 1839 - 1849

Heider, F., & Simmel, M., (1944). An Experimental Study of Apparent Behavior, American Journal of Psychology, 57:2.

McAleer, P., Mazzarino, B., Volpe, G., Camurri, A., Patterson, H., & Pollick, F. (2004). Perceiving Animacy and Arousal in Transformed Displays of Human Interaction. Journal of Vision, 4(8), 230a.

Results

• No significant difference between groups.

• Effect of Viewpoint, F(1,6) = 9.1, p<0.05, (Overhead > Side).

Stimulus Production

Video Displays

Results

• Effect of viewpoint across groups, F(1,6) = 6.3, p<0.05, (Overhead for ASC Group < Overhead Controls = Side View Controls).

Overhead Side View

Time

Overhead Side View

Time

Design

• 6 Intentions: CHASE, FIGHT, FLIRT, FOLLOW, GUARD & PLAY.

• 2 Viewpoints: OVERHEAD & SIDE.

Task

• 6 ALTERNATIVE FORCED CHOICE.Participants

• ASC group: 4 males (age 18 – 25), diagnosed using the Autistic Diagnosis Interview (ADI).

• Control group: 4 males (age 18 – 25).

Though results are preliminary with further research and a larger clinical sample required, they suggest:

• People with ASC’s can attribute intention to video displays, but this ability is greatly diminished in displays shown from an overhead perspective.

• People with ASC’s are poorer at attributing intention to animacy displays compared to a control population.

Confusion Matrices

Confusion Matrices

Side - Control Group - Animacy Side - Control Group - VideoResponse

Fight Guard Flirt Follow Play ChaseFight 0.75 0.125 0 0 0.125 0Guard 0.375 0.375 0 0 0.25 0

Presented Flirt 0.125 0 0.75 0 0.125 0Follow 0 0 0 0.25 0.625 0.125Play 0.625 0 0 0 0.375 0Chase 0.125 0 0 0.25 0.125 0.5

Overhead - Control Group - Animacy Overhead - Control Group - VideoResponse

Fight Guard Flirt Follow Play ChaseFight 0.625 0.25 0 0 0.125 0Guard 0 1 0 0 0 0

Presented Flirt 0 0.125 0.75 0 0.125 0Follow 0 0 0 0.875 0 0.125Play 0.125 0.25 0 0 0.5 0.125Chase 0 0 0 0.625 0 0.375

Side - ASC Group - Animacy Side - ASC Group - VideoResponse

Fight Guard Flirt Follow Play ChaseFight 0.625 0 0 0 0.375 0Guard 0.25 0.25 0.125 0 0.25 0.125

Presented Flirt 0.125 0 0.5 0.25 0.125 0Follow 0 0.125 0.125 0.125 0.5 0.125Play 0.625 0 0.25 0 0.125 0Chase 0 0 0.25 0.375 0.375 0

Overhead - ASC Group - Animacy Overhead - ASC Group - VideoResponse

Fight Guard Flirt Follow Play ChaseFight 0.5 0.25 0 0.125 0.125 0Guard 0.25 0.625 0 0 0.125 0

Presented Flirt 0 0.25 0.75 0 0 0Follow 0 0 0 0.875 0 0.125Play 0.375 0.25 0 0 0.375 0Chase 0 0 0.125 0.625 0 0.25

Side - Control Group - VideoResponse

Fight Guard Flirt Follow Play ChaseFight 0.875 0.125 0 0 0 0Guard 0.125 0.875 0 0 0 0

Presented Flirt 0 0 1 0 0 0Follow 0 0 0 1 0 0Play 0 0 0 0 0.75 0.25Chase 0 0 0 0.5 0.125 0.375

Overhead - Control Group - VideoResponse

Fight Guard Flirt Follow Play ChaseFight 1 0 0 0 0 0Guard 0.125 0.875 0 0 0 0

Presented Flirt 0 0 0.75 0 0.25 0Follow 0 0 0 1 0 0Play 0.25 0 0 0 0.75 0Chase 0 0 0 0.5 0 0.5

Side - ASC Group - VideoResponse

Fight Guard Flirt Follow Play ChaseFight 0.875 0 0 0 0 0Guard 0.375 0.5 0 0 0 0

Presented Flirt 0 0 0.25 0.25 0.25 0Follow 0 0 0 1 0 0Play 0.25 0.125 0 0 0.625 0Chase 0 0 0 0.25 0 0.75

Overhead - ASC Group - VideoResponse

Fight Guard Flirt Follow Play ChaseFight 0.5 0.125 0.125 0 0 0Guard 0.5 0.25 0 0 0 0

Presented Flirt 0 0.125 0.375 0.125 0.25 0Follow 0 0 0 1 0 0Play 0.375 0.125 0 0.125 0.375 0Chase 0 0 0 0.625 0 0.25

0

0.2

0.4

0.6

0.8

1

Side Overhead

VIDEO

Pro

po

rtio

n C

orr

ect

Control Group

ASC GroupChance

0

0.2

0.4

0.6

0.8

1

Side Overhead

ANIMACY

Pro

po

rtio

n C

orr

ect

Control Group

ASC GroupChance