Whole Body Interaction Workshop

HCI2008 September 1st, 2008

2

AGENDA

• 09.00-10.30 Presentations

• 10.30-11.00 Coffee in room 322/324

• 11.00-12.30 Presentations

• 12.30-13.30 Lunch in room 322/324

• 13.30-15.00 Discussion

• 15.00-15.30 Coffee in room 322/324

• 15.30-17.00 Discussion/Ways Forward

3

AGENDA

• Presentations– 15 minutes– No time limit for discussions

• Discussion 1– Towards Everyday WBI

• Discussion 2 – Ways forward– Research Agenda– ITN ?

4

Whole Body Interaction

• Developments– Improved and Marker-less motion capture

• Stanford

– Advanced Interaction frameworks• Jacob CHI2008

– Experiments by artists• Nimoy, Rokeby, Botto

– Bio-cybernetics and Biomechanics• Understanding of patterns/gestures of movement• Understand of human capabilities/limitations

– And … ?

5

LJMU

HCI Fun project

6

LJMU

.

7

LJMU

8

Some Initial Questions

• What would be the criteria for a useful and successful framework for addressing the research questions of Whole Body Interaction?

• What are some of the basic lessons that can be learned from previous attempts to framework the topic?

• Can we come up with a set of concepts and a terminology to support interdisciplinary design, analysis and evaluation?

9

Questions

• The mappings of the bodies’ movement to the system’s interpretation of that movement; were movements required physically possible. Does the system only expect normal movements – what of abnormal, exaggerated or other out of range movements?

• What is the users’ understanding and comprehension of the mappings and metaphors of their movement to system reaction? Could the user and system mutually adapt or would users be forced to adapt their body movements?

10

Questions

• What is the scope of whole body interaction and body as a data source for– Physical Presence/Cartesian Space – posture,

movement, location, orientation– Physiological – Heart rate, breathe volume and rate,

skin resistance as both data and control– Human senses – taste, smell, kinesthetic, vision,

speech/sound, balance and the possibilities for synaesthesia between two or more senses.

11

Discussions

• Towards an everyday Whole Body Interaction– As ubiquitous as mouse & keyboard– How?

• Ways forward– Research agenda– Special Issue– CHI2009 Workshop (submitted)– FP7 Activities

• COST, ITN

• Limitations/Constraints as source of creativity– Lessons, work-arounds

• Attending to the display vs inattentive interaction

• Underlying physical/human models

• Precision, drift

• Multiple people – occlusion, model deformation

12

• Non-standing interaction– Feet as reference point

• MoCap infrastructure vs. in the field

• Micro-computers, SunSpots etc – in the field devices

• Experience of embodied interaction– Analysis software, filters

• How to study – lessons from sports science, biomechanics etc

13

• Vs – Emotional, subjective

• Quality, coordination of movement and experience – value judgement rather than motion analysis

• Contexts, maths models, environment, goals (if any) – complex framework

• Interactions, awareness of others

14

• Albrecht Schmidt Essen

• Eva Hornecker – Strathclyde

• Externals Paul Dourish

• Eindhoven ??

• European Network – Body Movement

• France, Cog. Sci Benoit Bardy Montepellier

• Euro Centre for movement science

15

• FP7 priorities and themes

• Does games fit? Games as a Lab environment

• Engaging

• Limited data, best fit – parameters

• Model/Middleware <- embodiment, biomechanics

• Cog Sci,

16

• Re-Representing data to users– End user programming– Adaptation– Context– Mutual emergent understanding– User tools

• Open source micro-platforms

• Standards, platforms and API’s, and data

17

• Forms of data

• Cross over from theory to practical use – e.g. Space theory

• Application drive?– Geospatial– Medical– Games– Security

• Existing areas augmented by WBI 18

• Negative – Privacy, tracking, ethics

• http://www.guardian.co.uk/uk/2008/jul/21/civilliberties.privacy

• http://news.bbc.co.uk/1/hi/magazine/7348164.stm

• Interventions

• Embodied education– Achievement, pre-verbal, imitation

• Limits of gesture recognition

19

• Embodied knowledge, intelligence– Teaching other knowledge – words etc

20