final presentation - cs.rpi.educutler/classes/advancedgraphics/s19/lectur… · final presentation...
TRANSCRIPT
![Page 1: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/1.jpg)
Computational Photography
Final Presentation• Summarize prior work as necessary
– You don’t need to discuss papers we covered in class• Be technical:
– What were the challenges?– How did you solve them?
– Live demo / video / lots of images (depends on project)– Use plenty of examples (both of success & failure)
• Teams of 2: – Both should present & make it clear who did what
• Practice! & time yourself!– We have a tight schedule – I will stop you mid-sentence if you run over
![Page 2: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/2.jpg)
Final Presentation Schedule 10 min (individual)+1 min questions/setup
20 min (team of 2)+2 min questions/setup
Tue Apr 252:00 Colin & Judy2:22 Audrey & Lorelei2:44 Fred2:55 Jason & Casey 3:17 Michael & Annie3:39 Abby3:50 Andrew & Alex4:12 Sol & Max4:34 John N.4:45 Glenn & Kevin5:07 done!
Fri Apr 282:00 Alec & Emilee2:22 Jordan & Dylan2:44 Leon2:55 Antonio & Matthew 3:17 Dhruv & Jonathan3:39 Daniel & John A.4:01 Jacob4:12 Etienne & Hector4:34 Chris & Owen4:56 Alexa & Stephen5:18 done!
Last Time?• Texture Synthesis• Markov Model• Image Completion• Volumetric Texture Synthesis
“I spent an interesting eveningrecently with a grain of salt.”
![Page 3: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/3.jpg)
“On Demand Solid Texture Synthesis Using Deep 3D Networks”, Gutierrez, Rabin, Galerne, and Hurtut, 2018, preprint.
“Non-photorealistic Camera: Depth Edge
Detection and Stylized Rendering using
Multi-Flash Imaging”, Raskar, Tan, Feris, Yu, & Turk, SIGGRAPH 2004.
![Page 4: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/4.jpg)
“Interactive Digital Photomontage”, Agarwala, Dontcheva, Agrawala, Drucker, Colburn, Curless,
Salesin, & Cohen SIGGRAPH 2004
Today• Structure From Motion• Multi-viewpoint Rendering• Matting & Compositing• Helmholtz Reciprocity• Light Fields
![Page 5: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/5.jpg)
Structure From Motion• Input: Sequence of frames (e.g., video) of a
moving object (or moving camera)• Output: Approximate geometry of object &
camera pose for each frame• How?
– Automatically detect features in each frame– Determine correspondences between features– Infer camera calibration & object geometry
• Humans do it all the time… but it’s a really hard problem!
Photo Tourism
Finding Paths through the World's Photos, Snavely, Garg, Seitz, & Szeliski, SIGGRAPH 2008 Photo tourism: Exploring photo collections in 3D,
Snavely, Seitz, & Szeliski, SIGGRAPH 2006
![Page 6: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/6.jpg)
Reading Comments• Finding Paths through the World’s Photos
– Computer vision + computer graphics– SIFT keypoints– What if people don’t take good photos?– Lighting adjustment & removal/separate
treatment of foreground would improve the overall quality of the results
– Resulting video is indeed helpful for exploring / understanding a new 3D enviornment
“Image Based Tree Modeling”, Tan et al., SIGGRAPH 2007
![Page 7: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/7.jpg)
“Approximate Image-Based Tree-Modeling using Particle Flows”, Neubert et al., SIGGRAPH 2007
Image-Based Modeling and Photo EditingOh, Chen, Dorsey, & Durand, SIGGRAPH 2001
![Page 8: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/8.jpg)
“Video Matching”, Sand & Teller, SIGGRAPH 2004
Today• Structure From Motion• Multi-viewpoint Rendering• Matting & Compositing• Helmholtz Reciprocity• Light Fields
![Page 9: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/9.jpg)
Multi-Viewpoint Panoramas“Photographing long scenes with multi-viewpoint panoramas”, Agarwala, Agrawala, Cohen, Salesin, & Szeliski, SIGGRAPH 2006
![Page 10: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/10.jpg)
Multi-Viewpoint Panoramas
• Like many non-photorealistic rendering methods, this paper aims to mimic the style of a particular artist or style of art
• Well designed user interface:– Most components automated– User can adjust dominant plane, view selection,
seams, & inpainting
![Page 11: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/11.jpg)
Portrait of Dora MaarPablo Picasso
Portrait of a WomanPablo Picasso
Multi-Perspective Rendering
J. Yu & L. McMillan“A Framework for Multiperspective Rendering”Eurographics Symposium on Rendering 2004
![Page 12: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/12.jpg)
Opening Scene from Disney’s Pinocchio
http://disney.wikia.com/wiki/PinocchioGustaf Tenggren
![Page 13: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/13.jpg)
Photo Montage• David Hockney
http://www.hockneypictures.com/photos/photos_collages_05_large.php
Questions?
Zac Bubnick http://www.princetonol.com/groups/iad/lessons/high/cubismphoto.htm
![Page 14: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/14.jpg)
Today• Structure From Motion• Multi-viewpoint Rendering• Matting & Compositing• Helmholtz Reciprocity• Light Fields
“Environment Matting and Compositing” Zongker, Werner, Curless, & Salesin, SIGGRAPH 1999
![Page 15: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/15.jpg)
“Environment Matting and Compositing” Zongker, Werner, Curless, & Salesin, SIGGRAPH 1999
Today• Structure From Motion• Multi-viewpoint Rendering• Matting & Compositing• Helmholtz Reciprocity• Light Fields
![Page 16: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/16.jpg)
Helmholtz Reciprocity• BRDF is symmetric: % of light reflected from
direction i off surface point p to direction j is the same as the % of light reflected from direction j off surface point p to direction i
p
j
i
p
j
i
Helmholtz Reciprocity
“Dual Photography”, Sen, Chen, Garg, Marschner, Horowitz, Levoy, & Lensch, SIGGRAPH 2005
cameraprojector
projectorcamera
real scene synthetic renderings
![Page 17: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/17.jpg)
“Dual Photography”, Sen, Chen, Garg, Marschner, Horowitz, Levoy, & Lensch, SIGGRAPH 2005
Today• Structure From Motion• Multi-viewpoint Rendering• Matting & Compositing• Helmholtz Reciprocity• Light Fields
![Page 18: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/18.jpg)
Light Fields
Plenoptic Modeling: An Image-Based Rendering System,
McMillan & Bishop, SIGGRAPH 1995
Dynamically reparameterized light fields, Isaksen, McMillan, & Gortler, SIGGRAPH 2000
Light Field Rendering,Levoy & Hanrahan, SIGGRAPH 1996
Unstructured Lumigraph Rendering” Buehler et al. SIGGRAPH 2001
![Page 19: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/19.jpg)
“Unstructured Lumigraph Rendering” Buehler et al. SIGGRAPH 2001
Light Field Camera• After taking the
photograph, we can:– Adjust focus– Change viewpoint– Change illumination– & more?
Light Field Photography with a Hand-Held Plenoptic Camera, Ng, Levoy, Bredif, Duval, Horowitz, & Hanrahan,
Stanford Tech Report, 2005
![Page 20: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/20.jpg)
Reminders• Quiz 2 is on Tuesday, April 16th
– Practice problems for Quiz 2 are posted on the calendar
– Optional makeup/extra credit reading (your choice) due on Submitty forum Tuesday April 16th @ 10am
• Friday April 19th is optional office hours/work-in-classon your final project. There will be an optional, makeup/extra-credit ‘pop worksheet’ that day.
• Tuesday Apr 23rd & Friday Apr 26th are mandatory attendance, Final Project Presentations 2-5:15pm If you will need to leave early @4pm, for another course, please send email ASAP
Final Presentation• Summarize prior work as necessary
– You don’t need to discuss papers we covered in class• Be technical:
– What were the challenges?– How did you solve them?
– Live demo / video / lots of images (depends on project)– Use plenty of examples (both of success & failure)
• Teams of 2: – Both should present & make it clear who did what
• Practice! & time yourself!– We have a tight schedule – I will stop you mid-sentence if you run over
![Page 21: Final Presentation - cs.rpi.educutler/classes/advancedgraphics/S19/lectur… · Final Presentation Schedule 10 min (individual) +1 min questions/setup 20 min (team of 2) +2 min questions/setup](https://reader034.vdocuments.us/reader034/viewer/2022043003/5f80f1128228882e3c00d850/html5/thumbnails/21.jpg)
Components of a well-written research paper
• Motivation/context/related work
• Contributions of this work
• Clear description of algorithm– Sufficiently-detailed to allow work to be reproduced
– Work is theoretically sound (hacks/arbitrary constants discouraged)
• Results– well chosen examples
– clear tables/illustrations/visualizations
• Conclusions– limitations of the method are clearly stated