socio-cognitive rehabilitation in autism spectrum disorders via human-machine interaction

37
Socio-cognitive rehabilitation in autism spectrum disorders via human-machine interaction Guillaume Dumas ([email protected]) Human Genetics & Cognitive Functions, Neuroscience Department, Institut Pasteur SoNeTAA, Child & Adolescent Psychiatry Department, Hôpital Robert-Debré, AP-HP Solutions for Open Science (SOS) — Institut Pasteur, Paris 2017-10-12

Upload: guillaume-dumas

Post on 28-Jan-2018

327 views

Category:

Science


1 download

TRANSCRIPT

Page 1: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-cognitive rehabilitation in autism spectrum disorders via human-machine interactionGuillaume Dumas ([email protected])Human Genetics & Cognitive Functions, Neuroscience Department, Institut PasteurSoNeTAA, Child & Adolescent Psychiatry Department, Hôpital Robert-Debré, AP-HP

Solutions for Open Science (SOS) — Institut Pasteur, Paris 2017-10-12

Page 2: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

A long time ago in a journal far, far away …

Page 3: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

The Haken-Kelso-Bunz model (1985)

3

A theoretical model of phase transitions in human hand movements. Biological Cybernetics, 51, 347 356.

Page 4: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

The Haken-Kelso-Bunz model (1985)

4

Phase Transition

Page 5: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

The Haken-Kelso-Bunz model (1985)

5

Page 6: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

30 years later …

Page 7: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

The Virtual Partner Interaction (Kelso et al. PLoS ONE 2009)

7

Page 8: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

The Virtual Partner Interaction (Kelso et al. PLoS ONE 2009)

8

Page 9: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

The Virtual Partner Interaction (Kelso et al. PLoS ONE 2009)

9

Page 10: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

3 developers later …

Page 11: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

The Virtual Partner Interaction (Kelso et al. PLoS ONE 2009)

11

Page 12: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Two-body Neuroscience (Dumas, CIB 2011)

12

Page 13: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Human Dynamic Clamp (Dumas et al. PNAS 2014)

13

Page 14: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Human Dynamic Clamp (Dumas et al. PNAS 2014)

14

Page 15: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Human Dynamic Clamp (Dumas et al. PNAS 2014)

15

Page 16: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Human Dynamic Clamp (Dumas et al. PNAS 2014)

16

Page 17: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Web-VPI

17

Page 18: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Virtual Teacher Interaction (Kostrubiec et al. PLoS ONE 2015)

18

Page 19: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Social Neuroscience for Therapeutic Approaches in Autism (SoNeTAA)

19

Comorbidities intellectual disability

epilepsy motor control problems

ADHD Tics

Anxiety sleep disorders

gastrointestinal problems

Epidemiology 0.7–1.1% of the

population 4/1 male/female ratio

Page 20: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Social Neuroscience for Therapeutic Approaches in Autism (SoNeTAA)

19

Comorbidities intellectual disability

epilepsy motor control problems

ADHD Tics

Anxiety sleep disorders

gastrointestinal problems

Epidemiology 0.7–1.1% of the

population 4/1 male/female ratio

Page 21: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Social Neuroscience for Therapeutic Approaches in Autism (SoNeTAA)

20

~10000 patients/year

>2000 patients with autism/year

Page 22: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Social Neuroscience for Therapeutic Approaches in Autism (SoNeTAA)

20

~10000 patients/year

>2000 patients with autism/year

Page 23: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Social Neuroscience for Therapeutic Approaches in Autism (SoNeTAA)

21

Page 24: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Projet Enjeu Biotech de l’ECP (2015/16)

22

Page 25: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Projet Enjeu Biotech de l’ECP (2015/16)

23

Page 26: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Projet Enjeu Biotech de l’ECP (2016/17)

24

Page 27: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Projet Enjeu Biotech de l’ECP (2016/17)

25

Page 28: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Projet Enjeu Biotech de l’ECP (2016/17)

26

Page 29: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

KATE

27

Page 30: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Perspectives

28

Scores

Fixed product

Game or

Robot

Commercial Relationship

Limited User Feedback

Game Design

No Validation

Page 31: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Perspectives

28

Scores

Fixed product

Game or

Robot

Commercial Relationship

Limited User Feedback

Game Design

No Validation

Measures

Open Source

KATE

Sharing Users feedbacks

Gather Scientific validation

Page 32: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Perspectives

29

Credit: Louis Pelosse

Page 33: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Perspectives

29

Accessibility Credit: Louis Pelosse

Page 34: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Perspectives

29

AccessibilitySustainability

Credit: Louis Pelosse

Page 35: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Perspectives

29

AccessibilitySustainabilityInclusivity

Credit: Louis Pelosse

Page 36: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Perspectives

29

AccessibilitySustainabilityInclusivity

Credit: Louis Pelosse

Page 37: Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Socio-Cognitive Rehabilitation in Autism Spectrum Disorders via Human-Machine Interaction

Acknowledgement

30

Old-Paris Team

Jacqueline Nadel Jacques Martinerie Robert Soussignan Mario Chavez Emeline Mercier

Boca Raton Team

New-Paris Team

Collaborators

Leonhard Schilbach Eva Loth Benno Schwikowski Merle Fairhurst Danilo Bzdok Denis Engemann Benoît Theuil

Thomas Bourgeron Richard Delorme Aline Lefebvre Yang-Min Kim Roberto Toro Thomas Rolland Freddy Cliquet Anita Beggiato Alexandre Mathieu Hany Goubran-BotrosJ.A. Scott Kelso

Emmanuelle Tognoli Gonzalo DeGuzman Armin Fuchs Mengsen Zhang

Viviane Kostrubiec Alexandre Lehmann Asaf Bachrach Julien Laroche Elvis Dohmatob Erik Maronde Albane Imbert