8/16/99 experiments in motion (capture). 8/16/99 experiments in motion capture project course week...
Post on 21-Dec-2015
226 views
TRANSCRIPT
![Page 1: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/1.jpg)
8/16/99
Experiments in Motion (Capture)Experiments in Motion (Capture)
![Page 2: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/2.jpg)
8/16/99
Experiments in Motion CaptureExperiments in Motion Capture
• Project Course• Week 3-5: Motion Capture Pipeline Assignments• Then start group project (lots of experimenting)• In parallel lectures on other art / science projects• Everybody also does a 20min presentation on paper/project
![Page 3: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/3.jpg)
8/16/99
SyllabusSyllabus
• 01-26: Beliz on Dance / Mocap / Jitter• 02-02 / 02-09 /02-16: Mocap Pipeline Assignments• 02-23: More Project Examples• 03-02: Project Brainstorming (maybe Salie Lecture)• 03-09: Project Proposal due (+ Luke lecture / Chris gone)• 03-16: Spring Break• 03-23: Gaming + Mocap• 03-30: Vison based Mocap• 04-06: Progress Reports• 04-13: Art + Mocap• 04-20: Special Effects + Mocap• 04-27: Facial Capture• Final Slot: Project Presentations
![Page 4: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/4.jpg)
8/16/99
Motion Capture Based PuppetryMotion Capture Based Puppetry
Virtual Actor System by SimGraphics Popovic
![Page 5: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/5.jpg)
8/16/99
Characters to AnimateCharacters to Animate
Paul Kaiser / Merce Cunningham © Electronic Arts
![Page 6: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/6.jpg)
8/16/99
Visual TrackingVisual Tracking
Visual Tracking: Unsolved for general settings
![Page 7: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/7.jpg)
8/16/99
The Graphics ProblemThe Graphics Problem
![Page 8: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/8.jpg)
8/16/99
The Vision ProblemThe Vision Problem
![Page 9: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/9.jpg)
8/16/99
The Motion Capture ProblemThe Motion Capture Problem
ComputerModel
![Page 10: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/10.jpg)
8/16/99
Motion Capture: Standard PipelineMotion Capture: Standard Pipeline
Multi-View High-Speed Recording Image Feature Tracking
View 1 View 2
3
1 2
4
2D -> 3D Reconstruction
Camera 1 Camera 1
3D
Kinematic Model Fitting
![Page 11: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/11.jpg)
8/16/99
Expressive mocap shoot Expressive mocap shoot
![Page 12: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/12.jpg)
8/16/99
Motion Analysis Corp + Electronic ArtsMotion Analysis Corp + Electronic Arts
![Page 13: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/13.jpg)
8/16/99
The quest for RealismThe quest for Realism
© Warner Bros & DreamWorks© Warner Bros & DreamWorks
Pass the Turing Test ???Pass the Turing Test ??? Final Fantasy -- Final Fantasy -- Create Illusion on ScreenCreate Illusion on Screen
© Square© Square
![Page 14: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/14.jpg)
8/16/99
““Satan’s Rotoscope” ControversySatan’s Rotoscope” Controversy
Performance-Capture:Mocap / Rotoscoping
Traditional:Hand-Animated
Pixar Electronic Arts
![Page 15: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/15.jpg)
8/16/99
Most Characters are not realMost Characters are not real
![Page 16: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/16.jpg)
8/16/99
Disney: Expressive MotionDisney: Expressive Motion
![Page 17: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/17.jpg)
8/16/99
Motion ReferenceMotion Reference
![Page 18: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/18.jpg)
8/16/99
Motion ReferenceMotion Reference
![Page 19: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/19.jpg)
8/16/99
““Satan’s Rotoscope” ControversySatan’s Rotoscope” Controversy
![Page 20: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/20.jpg)
8/16/99
"Artistic Fact or Optical Delusion? Culture: David Hockney claims many famous paintings were traced using camera-like devices"
![Page 21: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/21.jpg)
8/16/99
Rotoscoping is everywhereRotoscoping is everywhere
• Disney:
Step-Mother Eleanor Audley
![Page 22: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/22.jpg)
8/16/99
““Satan’s Rotoscope” ControversySatan’s Rotoscope” Controversy
![Page 23: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/23.jpg)
8/16/99
Motion Capture Based Animation PipelineMotion Capture Based Animation Pipeline
Computer Computer VisionVision
![Page 24: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/24.jpg)
8/16/99
Motion Capture Based Animation PipelineMotion Capture Based Animation Pipeline
Computer Computer GraphicsGraphics
++
ArtArt
![Page 25: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/25.jpg)
8/16/99
Vision Based TrackingVision Based Tracking
![Page 26: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/26.jpg)
8/16/99
Tracking + Acquistion of KinematicsTracking + Acquistion of Kinematics
- Acquire Kinematic Chains.
Kathy Pullen
![Page 27: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/27.jpg)
8/16/99
Humans have no fixed axisHumans have no fixed axis
![Page 28: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/28.jpg)
8/16/99
Nonrigid ExamplesNonrigid Examples
Constrain
![Page 29: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/29.jpg)
8/16/99
Motion Capture
Modeling
Synthesis
From Pixels to 3D Blend Shapes From Pixels to 3D Blend Shapes (Torresani et al 2001)(Torresani et al 2001)
![Page 30: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/30.jpg)
8/16/99
Motion Capture
Modeling
Synthesis
From Pixels to 3D Blend Shapes From Pixels to 3D Blend Shapes (Torresani et al 2001)(Torresani et al 2001)
![Page 31: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/31.jpg)
8/16/99
Video Rewrite Video Rewrite (Bregler, Covell, Slaney, Interval)(Bregler, Covell, Slaney, Interval)
Pure Data
Learning Controller Sample Based
Pure Model
![Page 32: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/32.jpg)
8/16/99
Variations in Full-Body non-cyclic MotionsVariations in Full-Body non-cyclic Motions
Kathy Pullen
Motion Capture
Modeling
Synthesis
Example Motion-Capture
![Page 33: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/33.jpg)
8/16/99
Motion Texturing Key-Framed AnimationsMotion Texturing Key-Framed Animations
Kathy Pullen
Motion Capture
Modeling
Synthesis
Different Motion-Textured Paths
![Page 34: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/34.jpg)
8/16/99
Motion Capture Based Animation PipelineMotion Capture Based Animation Pipeline
ExpressiveExpressiveAnimationAnimation
![Page 35: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/35.jpg)
8/16/99
Turning to the Masters:Turning to the Masters:
Motion Capturing CartoonsMotion Capturing Cartoons
Chris Bregler, Lorie Loeb, Erika Chuang, Hrishi DeshpandeChris Bregler, Lorie Loeb, Erika Chuang, Hrishi Deshpande
Stanford UniversityStanford University
[CB: Other picture coming]
![Page 36: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/36.jpg)
8/16/99
Realm of Cartoon CaptureRealm of Cartoon Capture
![Page 37: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/37.jpg)
8/16/99
Turning to the Masters:Turning to the Masters:
Expressive AnimationsExpressive Animations
![Page 38: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/38.jpg)
8/16/99
Capture Cartoon MotionsCapture Cartoon Motions
Example
© Disney
![Page 39: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/39.jpg)
8/16/99
Retarget Cartoon MotionsRetarget Cartoon Motions
© Disney
![Page 40: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/40.jpg)
8/16/99
ExamplesExamples
© Disney
![Page 41: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/41.jpg)
8/16/99
ExamplesExamples
![Page 42: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/42.jpg)
8/16/99
ExamplesExamples
![Page 43: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/43.jpg)
8/16/99
Realm of Cartoon CaptureRealm of Cartoon Capture
![Page 44: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/44.jpg)
8/16/99
ExamplesExamples
© Disney
![Page 45: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/45.jpg)
8/16/99
ExamplesExamples
© Warner Bros.
![Page 46: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/46.jpg)
8/16/99
Cartoon Capture ChallengesCartoon Capture Challenges1. Can’t put optical markers on a cartoon2. Low frame rate (24-30 fps) + animating on 2’s = large changes between frames3. Often difficult to identify joint locations/large deformations
![Page 47: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/47.jpg)
8/16/99
Performance Capture based AnimationPerformance Capture based Animation
![Page 48: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/48.jpg)
8/16/99
Rotoscope / Mocap: HistoryRotoscope / Mocap: History
• Rebecca Allen / Twyla Tharp: The Catherine Wheel• Paul Kaiser / Merce Cunningham: “Biped”
![Page 49: 8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start](https://reader036.vdocuments.us/reader036/viewer/2022062320/56649d605503460f94a41f33/html5/thumbnails/49.jpg)
8/16/99
ProjectProject
• Start thinking about it now
• In-class brainstorming session
• Proposal with 2 Milestones
• Group work