temporally coherent completion of dynamic shapes
DESCRIPTION
Temporally Coherent Completion of Dynamic Shapes . Hao Li, Linjie Luo , Daniel Vlasic, Pieter Peers, Jovan Popović , Mark Pauly , Szymon Rusinkiewicz ACM Transactions on Graphics 31(1) , ( to be presented at SIGGRAPH 2012) Presenter: Kangxue Yin Apr. 20, 2012. outline. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Temporally Coherent Completion of Dynamic Shapes](https://reader035.vdocuments.us/reader035/viewer/2022062323/5681672f550346895ddbd62e/html5/thumbnails/1.jpg)
Temporally Coherent Completion of Dynamic Shapes
Hao Li, Linjie Luo, Daniel Vlasic, Pieter Peers, Jovan Popović, Mark Pauly, Szymon RusinkiewiczACM Transactions on Graphics 31(1) , ( to be presented at SIGGRAPH 2012)
Presenter: Kangxue YinApr. 20, 2012
![Page 2: Temporally Coherent Completion of Dynamic Shapes](https://reader035.vdocuments.us/reader035/viewer/2022062323/5681672f550346895ddbd62e/html5/thumbnails/2.jpg)
outline
• Introduction and Related Work• The proposed Method:
• Pairwise correspondence• Hole filling• Temporal filtering• Detail resynthesis
• Results and Conclusion
![Page 3: Temporally Coherent Completion of Dynamic Shapes](https://reader035.vdocuments.us/reader035/viewer/2022062323/5681672f550346895ddbd62e/html5/thumbnails/3.jpg)
Introduction and Related Work
The problem:How to obtain temporally coherent and watertight 3D meshes from scan sequences of dynamic performances?
Related topics:Space-time reconstructionNon-rigid registration
![Page 4: Temporally Coherent Completion of Dynamic Shapes](https://reader035.vdocuments.us/reader035/viewer/2022062323/5681672f550346895ddbd62e/html5/thumbnails/4.jpg)
• hole filling techniquesJU, T. 2009. Fixing geometric errors on polygonal models: A survey. Journal of Computer Science and Technology 24, 1, 19–29.
• Non-rigid registration: • template-based method• articulation-based method• consensus skeleton
Introduction and Related Work
fails with drastic topology changes
![Page 5: Temporally Coherent Completion of Dynamic Shapes](https://reader035.vdocuments.us/reader035/viewer/2022062323/5681672f550346895ddbd62e/html5/thumbnails/5.jpg)
The proposed Method: overview
Shape completion
![Page 6: Temporally Coherent Completion of Dynamic Shapes](https://reader035.vdocuments.us/reader035/viewer/2022062323/5681672f550346895ddbd62e/html5/thumbnails/6.jpg)
The proposed Method: Pairwise Correspondence
A two-scale registration: Coarse-scale and fine-scale.
Coarse-scale Registration Based on Deformation Graphs [Li et al. 2009]:
a non-rigid ICP algorithm
![Page 7: Temporally Coherent Completion of Dynamic Shapes](https://reader035.vdocuments.us/reader035/viewer/2022062323/5681672f550346895ddbd62e/html5/thumbnails/7.jpg)
The proposed Method: Pairwise Correspondence
Fine-scale alignment
a non-rigid locally weighted ICP algorithm based on [Brown and Rusinkiewicz 2007]
![Page 8: Temporally Coherent Completion of Dynamic Shapes](https://reader035.vdocuments.us/reader035/viewer/2022062323/5681672f550346895ddbd62e/html5/thumbnails/8.jpg)
The proposed Method: Pairwise Correspondence
![Page 9: Temporally Coherent Completion of Dynamic Shapes](https://reader035.vdocuments.us/reader035/viewer/2022062323/5681672f550346895ddbd62e/html5/thumbnails/9.jpg)
The proposed Method: Hole filling
visual Hull prior [Vlasic et al. 2009] + weighted Poisson surface reconstruction [Kazhdan et al. 2006]
Fairing: Minimizing bending energy of the patch’s vertices using bi-Laplacian
![Page 10: Temporally Coherent Completion of Dynamic Shapes](https://reader035.vdocuments.us/reader035/viewer/2022062323/5681672f550346895ddbd62e/html5/thumbnails/10.jpg)
The proposed Method : Temporal filtering
1. Warp two neighboring frames to current frame based on the pairwise correspondences
2. Combine them using Poisson reconstruction with different weight for different region
Poisson reconstruction
warp to warp to
![Page 11: Temporally Coherent Completion of Dynamic Shapes](https://reader035.vdocuments.us/reader035/viewer/2022062323/5681672f550346895ddbd62e/html5/thumbnails/11.jpg)
The proposed Method : Detail resynthesis
1. Acquire normal maps:Daniel Vlasic, Pieter Peers, Ilya Baran, Paul Debevec, Jovan Popović, Szymon Rusinkiewicz, and Wojciech Matusik. Dynamic Shape Capture using Multi-View Photometric Stereo. ACM Trans. Graphics (Proc. SIGGRAPH Asia) 28(5), December 2009.
2. Resynthesize high frequency detail from normal maps: Diego Nehab, Szymon Rusinkiewicz, James Davis, and Ravi Ramamoorthi. Efficiently Combining Positions and Normals for Precise 3D Geometry. ACM Transactions on Graphics (Proc. of ACM SIGGRAPH 2005) 24(3), August 2005.
![Page 12: Temporally Coherent Completion of Dynamic Shapes](https://reader035.vdocuments.us/reader035/viewer/2022062323/5681672f550346895ddbd62e/html5/thumbnails/12.jpg)
The proposed Method: summary
Shape completion
![Page 13: Temporally Coherent Completion of Dynamic Shapes](https://reader035.vdocuments.us/reader035/viewer/2022062323/5681672f550346895ddbd62e/html5/thumbnails/13.jpg)
The proposed Method: Results and Conclusion
![Page 14: Temporally Coherent Completion of Dynamic Shapes](https://reader035.vdocuments.us/reader035/viewer/2022062323/5681672f550346895ddbd62e/html5/thumbnails/14.jpg)
The proposed Method: Results and Conclusion
Contribution: the framework and some little improvements on previous algorithms ( too detailed )
Limitation:1. each frame should cover most part of the object surface ( limited to multi-view scans)2. Topology change problem was not solved fundamentally
Future work:To take physical properties into account
![Page 15: Temporally Coherent Completion of Dynamic Shapes](https://reader035.vdocuments.us/reader035/viewer/2022062323/5681672f550346895ddbd62e/html5/thumbnails/15.jpg)
1. registration of dynamic shape with drastic topology changed2. Reconstruction of interacting objects.
My Plan
topology change interacting objects