topic: morphingtensorverse.net/data/morphemt.pdf · morph data structure (similar to obj data...

11
Topic: Morphing

Upload: others

Post on 09-Oct-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Topic: Morphingtensorverse.net/data/morphemt.pdf · Morph Data structure (similar to obj data structure but bigger) Load all data Link attributes to shaders Compute difference vector

�Topic: Morphing

Page 2: Topic: Morphingtensorverse.net/data/morphemt.pdf · Morph Data structure (similar to obj data structure but bigger) Load all data Link attributes to shaders Compute difference vector

� Seamlessly changing from one mesh to another

� Combining vertices to find a point in between

� Given 2 mouth poses, a set of difference vectors is computed to control interpolation

� In morph targets, the difference vectors are used to add movement to the neutral face.

Page 3: Topic: Morphingtensorverse.net/data/morphemt.pdf · Morph Data structure (similar to obj data structure but bigger) Load all data Link attributes to shaders Compute difference vector
Page 4: Topic: Morphingtensorverse.net/data/morphemt.pdf · Morph Data structure (similar to obj data structure but bigger) Load all data Link attributes to shaders Compute difference vector
Page 5: Topic: Morphingtensorverse.net/data/morphemt.pdf · Morph Data structure (similar to obj data structure but bigger) Load all data Link attributes to shaders Compute difference vector
Page 6: Topic: Morphingtensorverse.net/data/morphemt.pdf · Morph Data structure (similar to obj data structure but bigger) Load all data Link attributes to shaders Compute difference vector

� Human Computer Interaction

� Understanding and Response� Inputs:

� Natural language (text and speech)� Vision (Images and Video)� Sensors (heart rate, temperature)� Other: smell??

� Understanding:� AI

� Response� Physical – Robots � Speech Synthesis� Virtual – Graphics (Facial Expressions of emotions)

Page 7: Topic: Morphingtensorverse.net/data/morphemt.pdf · Morph Data structure (similar to obj data structure but bigger) Load all data Link attributes to shaders Compute difference vector

� Use Morphing with shaders to render facial expressions and control via keyboard

� Use cube mapping to create a nice background to simulate Virtual World

Page 8: Topic: Morphingtensorverse.net/data/morphemt.pdf · Morph Data structure (similar to obj data structure but bigger) Load all data Link attributes to shaders Compute difference vector

� Create morph targets in blender (uses same mesh with different facial expressions)

� Morph Data structure (similar to obj data structure but bigger)

� Load all data

� Link attributes to shaders

� Compute difference vector between neutral pose and target

� Use Weights to adjust the deformation

� Render

Page 9: Topic: Morphingtensorverse.net/data/morphemt.pdf · Morph Data structure (similar to obj data structure but bigger) Load all data Link attributes to shaders Compute difference vector

� Only 16 attributes

Page 10: Topic: Morphingtensorverse.net/data/morphemt.pdf · Morph Data structure (similar to obj data structure but bigger) Load all data Link attributes to shaders Compute difference vector
Page 11: Topic: Morphingtensorverse.net/data/morphemt.pdf · Morph Data structure (similar to obj data structure but bigger) Load all data Link attributes to shaders Compute difference vector

� Real-time Rendering