greta mpeg-4 compliant script based behaviour generator system: script based behaviour generator...
Post on 02-Jan-2016
225 Views
Preview:
TRANSCRIPT
Greta
MPEG-4 compliant Script based behaviour Script based behaviour
generator system:generator system: input - BML or APMLinput - BML or APML output - MPEG-4 output - MPEG-4
animationanimation realistic multimodal
behaviour: uses gestures, gaze, head
nodes, facial expressions, intonation, torso movements
voice - external TTS Non-interactive
University Paris 8University Paris 8
Interface
1. choose language
2. choose APML/BML file
4. generate animation
5. see it
3. choose espressivity values
Greta tools: BML EditorUniversity Paris 8University Paris 8
BML
• behaviour mark-up language of SAIBA framework
• operates at signal level
• different channels of (non)verbal communication can be defined: head movements gaze facial expressions gestures speech
BML
<bml>
<head id='ex6h5' start='1.00' end='4.0'>
<description level="1" type="gretabml">
<reference>head=head_down</reference>
<SPC.value>1</SPC.value>
<TMP.value>1</TMP.value>
<FLD.value>-1.0</FLD.value>
<PWR.value>1</PWR.value>
</description>
</head>
<face id='ex3f2' start='4.10' end='1.4'>
<description level="1" type="gretabml">
<reference>affect=surprise</reference>
<SPC.value>0</SPC.value>
<TMP.value>0</TMP.value>
<FLD.value>0</FLD.value>
<PWR.value>0</PWR.value>
</description>
</face>
</bml>
BML
<bml>
<head id='ex6h5' start='1.00' end='4.0'>
<description level="1" type="gretabml">
<reference>head=head_down</reference>
<SPC.value>1</SPC.value>
<TMP.value>1</TMP.value>
<FLD.value>-1.0</FLD.value>
<PWR.value>1</PWR.value>
</description>
</head>
<face id='ex3f2' start='4.10' end='1.4'>
<description level="1" type="gretabml">
<reference>affect=surprise</reference>
<SPC.value>0</SPC.value>
<TMP.value>0</TMP.value>
<FLD.value>0</FLD.value>
<PWR.value>0</PWR.value>
</description>
</face>
</bml>
expressivity parameters
duration
class and instance
unique name
BML
<bml>
<head id='ex6h5' start='1.00' end='4.0'>
<description level="1" type="gretabml">
<reference>head=head_down</reference>
<SPC.value>1</SPC.value>
<TMP.value>1</TMP.value>
<FLD.value>-1.0</FLD.value>
<PWR.value>1</PWR.value>
</description>
</head>
<face id='ex3f2' start='4.10' end='1.4'>
<description level="1" type="gretabml">
<reference>affect=surprise</reference>
<SPC.value>0</SPC.value>
<TMP.value>0</TMP.value>
<FLD.value>0</FLD.value>
<PWR.value>0</PWR.value>
</description>
</face>
</bml>
expressivity parameters
duration
class and instance
unique name
BML
<bml>
<head id='ex6h5' start='1.00' end='4.0'>
<description level="1" type="gretabml">
<reference>head=head_down</reference>
<SPC.value>1</SPC.value>
<TMP.value>1</TMP.value>
<FLD.value>-1.0</FLD.value>
<PWR.value>1</PWR.value>
</description>
</head>
<face id='ex3f2' start='4.10' end='1.4'>
<description level="1" type="gretabml">
<reference>affect=surprise</reference>
<SPC.value>0</SPC.value>
<TMP.value>0</TMP.value>
<FLD.value>0</FLD.value>
<PWR.value>0</PWR.value>
</description>
</face>
</bml>
expressivity parameters
duration
class and instance
unique name
BML
<bml>
<head id='ex6h5' start='1.00' end='4.0'>
<description level="1" type="gretabml">
<reference>head=head_down</reference>
<SPC.value>1</SPC.value>
<TMP.value>1</TMP.value>
<FLD.value>-1.0</FLD.value>
<PWR.value>1</PWR.value>
</description>
</head>
<face id='ex3f2' start='4.10' end='1.4'>
<description level="1" type="gretabml">
<reference>affect=surprise</reference>
<SPC.value>0</SPC.value>
<TMP.value>0</TMP.value>
<FLD.value>0</FLD.value>
<PWR.value>0</PWR.value>
</description>
</face>
</bml>
expressivity parameters
duration
class and instance
unique name
BML Editor
• Different communication channels can be used simultaneously
• Each signal is defined in a separate « block »• Each block is defined by : unique name
class and instance of a signal according to Poggi`s taxonomy
start and end time
five expressivity parameters
BML Editor: expressivity
• The expressivity parameters can be defined for each nonverbal signal:
BML Editor: Feedback Window
• « feedback widow » allows for an immediate visualisation of animation
Greta tools: Gesture EditorUniversity Paris 8University Paris 8
Gesture Editor
• it is used to create and edit gestures• it uses a graphical interface, hiding the
gesture textual description
STARTFRAME 0.2 FRAMETYPE stroke_start ARM XC YCC ZNear HAND form_fist WRIST FBAway
PalmInwards ADDNOISEENDFRAME
STARTFRAME 0.2 FRAMETYPE stroke_start ARM XC YCC ZNear HAND form_fist WRIST FBAway
PalmInwards ADDNOISEENDFRAME
Gesture Editor
• It allows you to define:
arm position
hand shape
hand and fingers orientation
gesture phrasese.g.: stroke, hold hase
Gesture Editor
• Expressivity parameters can also be set for each gesture:
Gesture Editor
• Finally the gesture can be tested. The Greta agent performs it as it will be shown during animations:
top related