similar presentation english

SIMILAR NoE at the HUMAINE meeting - 5/06/2007

Multimodal Interaction R&D

• 4 Years Dec 2003 – Dec 2007• 6 M€• 32 partners + 8 fellows

SIMILAR NoE at the HUMAINE meeting - 5/06/2007

Similar on the map

32+8 institutions spread all over Europe

(and one in Africa)

Red : Partners

YellowYellow : Fellows

Blue : Industry

SIMILAR NoE at the HUMAINE meeting - 5/06/2007

Research interests and application domains

• R&D in modalities fusion and fissionSpeech, Handwriting, Gesture, Posture, Emotions, …

• 3 Actual applications domains:– Games and Education,

– Medical imaging and robotics,

– Disabled people

• 3 Future applications domains:– Interactive arts such as music and dance

– Robotic companions,

– Cars

• Next steps: Multi-user interaction and robotics - MAGI and PERGI FP7 proposals submitted

SIMILAR NoE at the HUMAINE meeting - 5/06/2007

Modalities Fusion Example

Right Hand

Left Hand

Right LegLeft Leg

Upper Body

Lower BodyBody

Gestures

Center of Gravity

Speach

Facial Emotion

Voice Emotion

MultimodalHuman

Emotion

SIMILAR NoE at the HUMAINE meeting - 5/06/2007

Similar achievements– The OpenInterface open source platform

– The SIMILAR multimodal behavior interpretation theory

– The SIMILAR medical image database

– The SIMILAR facial expression recognition annotated database

– Development of migratory context-aware user interfaces, standardized UsiXML language

• Many Similar achievements will continue at the end of the project:– The third summer workshop eNTERFACE in July 2007

(after Mons and Dubrovnik, we go to Istanbul)

– The JMUI journal will be distributed by Springer

– 23 PhD exchanges in 2007

– 13 books published in the SIMILAR collection

– Over 950 scientific paper published – 5 web sites (www.similar.cc, www.openinterface.org, www.jmui.org,

www.enterface.net, www.locomummy.net).

SIMILAR NoE at the HUMAINE meeting - 5/06/2007

Similar on the web

SIMILAR NoE at the HUMAINE meeting - 5/06/2007

Similar on the web

SIMILAR NoE at the HUMAINE meeting - 5/06/2007

Similar on the web

SIMILAR NoE at the HUMAINE meeting - 5/06/2007

Similar on the web

SIMILAR NoE at the HUMAINE meeting - 5/06/2007

Similar after 2007

Similar actions will continue under the official name:

OpenInterface Association a non-profit organisation under Belgian law.

Contact : benoit.macq@uclouvain.be