human body movement analysis decoding the movement and emotion yunyu wang, professor c. c. lin,...

23
Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor A three years research research and application development development project

Post on 22-Dec-2015

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

Human Body Movement Analysis Decoding the Movement and

Emotion

Yunyu Wang, Professor

C. C. Lin, Associate Professor

W. C. Chen, Professor

A three years researchresearch and application developmentdevelopment project

Page 2: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

2

Origin--2003Origin--2003 The Exchange/Discussion

PeoplePeople from Animation, Dance, Laban Movement Analysis, Computer Science and Sports Science.

TopicsTopics about Movement Quality, Emotion, Expression, Skill Analysis, Dance Innovation and LMA Application.

Page 3: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

3

Project DescriptionProject Description

Period:Three-year: 2006 to 2009First year: April 1, 2006

ParticipantsProfessors: 5Graduate students: 18Full time staffs and technicians: 5

Page 4: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

4

TNUATNUA

The College of DanceThe College of DanceGraduate School of Technology and ArtsGraduate School of Technology and ArtsCenter for Art and TechnologyCenter for Art and TechnologyThe E Motion LabThe E Motion Lab

Page 5: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

5

The E Motion LabThe E Motion Lab

Page 6: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

6

Partner Organizations and InstitutionsNCPESNCPES (National College of Physical Educatio

n and Sports)

ITRIITRI (Industrial Technology Research Institute)

Academia SinicaAcademia Sinica (http://www.sinica.edu.tw/as/intro/hist_e.html)

Page 7: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

7

WHY WHY ??

In DanceIn Dance In AnimationIn Animation In Exercise and SportsIn Exercise and Sports In health industryIn health industry

Page 8: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

8

Page 9: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

Sub-Project I Motion Database and Metadata

Page 10: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

10

Motion Database and MetadataProject Leadership and Project integrationTheory development, movement knowledge

analysisMovement Data Collection Motion Database Schema and StructureMetadata

Page 11: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

11

Page 12: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

Sub-project IIMotion Synthesis and Detection

Motion Synthesis and Detection

Page 13: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

13

Motion Synthesis and Detection A kernel Engine for Laban motion and emotio

n analysis Laban motion

Effort Shape Body

Emotion Cyclic Non-Cyclic

Page 14: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

14

Motion SynthesisLabanmocap

emotionalmocap

Construction of Basis Functions(LM and EM separately)

EmotionalMocap(EM)

LabanMocap(LM)

DdPCA FTDynamicSystems

Movement Primitive Lib.(LM and EM)

Motion compiler

Output Motion

LearningAlgorithm

Task Objective

Construction of Basis Functions

EM MotivesLM

Page 15: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

15

Motion Detection/Classification

Labanmocap

emotionalmocap

Construction of Basis Functions(LM and EMCAP)

EmotionalMocap

LabanMocap

DdPCA FT Neural Net

Movement Primitive Lib.(LM and EM)

Motion Classifier Construction

Motion DetectionLearningAlgorithm

Unclassified MotionUnclassified Motion

Motion Classifier Lib.

Page 16: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

16

Example Result: PCA elbow up

Page 17: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

17

Demo(Man’s arm up movement)

Mocap original motion PCA motion synthesis

Page 18: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

Sub-project III Industry Applications

Page 19: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

19

Application…Application…in Dance Dance

Dance engine for ChoreographyDance analysisDance creationInteractive Dance

Sub-3

Page 20: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

20

Application…Application…

in movie and animationMotion/Emotion Quantity Model

and Synthesis techniquesCommon Motion LanguageAnimation Plug-inGame engine

Sub-3

Page 21: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

21

Application…Application…In Exercise and Sports

Efficient and safe (Basketball shooting and Discus throwing)

Online instruction and learning Skill Analysis and diagnosis

Sub-3

Page 22: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

22

Application…Application…

In Health industry Better Rehab. --Motivating Moves

Janet Hamburg (University of Kansas)

Fitness Instructor ---My Best FriendOnline Stretching, exercise monitoring, …

Sub-3

Page 23: Human Body Movement Analysis Decoding the Movement and Emotion Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor researchdevelopment

The End

In describing movement, we must make a mental note of the most important intermediary positions.