wild dreams for cameras jack tumblin northwestern university [email protected]...
TRANSCRIPT
![Page 1: Wild Dreams for Cameras Jack Tumblin Northwestern University jet@cs.northwestern.edu jet@cs.northwestern.edu From May 24 Panel Discussion on cameras](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ebf5503460f94bc925c/html5/thumbnails/1.jpg)
..
Wild Dreams for CamerasWild Dreams for Cameras
Jack TumblinJack Tumblin
Northwestern University Northwestern University [email protected]@cs.northwestern.edu
From May 24 Panel Discussion on cameras atFrom May 24 Panel Discussion on cameras at
Symposium on Symposium on
Computational Photography & VideoComputational Photography & Video
May 23-25, 2005May 23-25, 2005
![Page 2: Wild Dreams for Cameras Jack Tumblin Northwestern University jet@cs.northwestern.edu jet@cs.northwestern.edu From May 24 Panel Discussion on cameras](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ebf5503460f94bc925c/html5/thumbnails/2.jpg)
DefinitionsDefinitions
Visual AppearanceVisual Appearance: : What we What we thinkthink we see. we see.
(Consciously-available estimates of our surroundings, (Consciously-available estimates of our surroundings, made from the light reaching our eyes) made from the light reaching our eyes)
Picture:Picture: A ‘container’ for visual appearance. A ‘container’ for visual appearance.
(something we make to hold what we see, (something we make to hold what we see, or what would like to see)or what would like to see)
Image:Image: A copy of light intensities. A copy of light intensities.
(Just (Just one kindone kind of picture, made by copying a scaled map of of picture, made by copying a scaled map of scene light intensities as a lens might)scene light intensities as a lens might)
![Page 3: Wild Dreams for Cameras Jack Tumblin Northwestern University jet@cs.northwestern.edu jet@cs.northwestern.edu From May 24 Panel Discussion on cameras](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ebf5503460f94bc925c/html5/thumbnails/3.jpg)
““Machine-Readable” Images?Machine-Readable” Images?
scenescene
displaydisplay
Scene Scene LightLightIntensitiesIntensities
DisplayDisplayLight Light IntensitiesIntensities
‘‘Pixel values’Pixel values’ (scene intensity? display intensity?(scene intensity? display intensity? perceived intensity? ‘blackness/whiteness’ ?)perceived intensity? ‘blackness/whiteness’ ?)
displaydisplay
![Page 4: Wild Dreams for Cameras Jack Tumblin Northwestern University jet@cs.northwestern.edu jet@cs.northwestern.edu From May 24 Panel Discussion on cameras](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ebf5503460f94bc925c/html5/thumbnails/4.jpg)
DisplayDisplayRGB(x,y,tRGB(x,y,tnn))
ImageImageI(x,y,I(x,y,λλ,t),t)
RenderingRendering3D Scene3D Scenelight sources,
BRDFs,shapes,
positions,movements,
…
EyepointEyepoint position,
movement,projection,
…
PHYSICALPHYSICAL
SceneScenelight sources,BRDFs,shapes,positions,movements,…
EyepointEyepointposition, movement,projection,…
PERCEIVEDPERCEIVED
VisionVision
Digital ImagesDigital Images
Exposure’ orExposure’ orTone MappingTone Mapping
![Page 5: Wild Dreams for Cameras Jack Tumblin Northwestern University jet@cs.northwestern.edu jet@cs.northwestern.edu From May 24 Panel Discussion on cameras](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ebf5503460f94bc925c/html5/thumbnails/5.jpg)
Something Something
Else?Else?
DisplayDisplayRGB(x,y,tRGB(x,y,tnn))
ImageImageI(x,y,I(x,y,λλ,t),t)
RenderingRendering3D Scene3D Scenelight sources,
BRDFs,shapes,
positions,movements,
…
EyepointEyepoint position,
movement,projection,
…
PHYSICALPHYSICAL
SceneScenelight sources,BRDFs,shapes,positions,movements,…
EyepointEyepointposition, movement,projection,…
PERCEIVEDPERCEIVED
VisionVision
‘‘Digital Pictures?’Digital Pictures?’
![Page 6: Wild Dreams for Cameras Jack Tumblin Northwestern University jet@cs.northwestern.edu jet@cs.northwestern.edu From May 24 Panel Discussion on cameras](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ebf5503460f94bc925c/html5/thumbnails/6.jpg)
Williams 1998: ‘Inflated Silhouettes’Williams 1998: ‘Inflated Silhouettes’
http://graphics.stanford.edu/workshops/ibr98/#Schedule%20of%20sessionshttp://graphics.stanford.edu/workshops/ibr98/#Schedule%20of%20sessions
2D Photo2D Photo
SilhouetteSilhouette‘Inflate’ Depth ‘Inflate’ Depth SymmetrySymmetry
![Page 7: Wild Dreams for Cameras Jack Tumblin Northwestern University jet@cs.northwestern.edu jet@cs.northwestern.edu From May 24 Panel Discussion on cameras](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ebf5503460f94bc925c/html5/thumbnails/7.jpg)
Williams`98: ‘Inflated Silhouettes’Williams`98: ‘Inflated Silhouettes’
Not bad! How can we do better?Not bad! How can we do better?
• http://graphics.stanford.edu/workshops/ibr98/#Schedule%20of%20sessionshttp://graphics.stanford.edu/workshops/ibr98/#Schedule%20of%20sessions
![Page 8: Wild Dreams for Cameras Jack Tumblin Northwestern University jet@cs.northwestern.edu jet@cs.northwestern.edu From May 24 Panel Discussion on cameras](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ebf5503460f94bc925c/html5/thumbnails/8.jpg)
Malzbender, HPlabs 2001
A A MostlyMostly 2-D Method2-D Method
Polynomial Texture MapsPolynomial Texture Maps
Store just Store just 66 coefficientscoefficients
at each pixel, at each pixel, get Interactive get Interactive
re-lighting...re-lighting...
![Page 9: Wild Dreams for Cameras Jack Tumblin Northwestern University jet@cs.northwestern.edu jet@cs.northwestern.edu From May 24 Panel Discussion on cameras](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ebf5503460f94bc925c/html5/thumbnails/9.jpg)
3D: Try image + other dimensions3D: Try image + other dimensions
• Halle: Multiple Viewpoint Rendering (SIGG98)Halle: Multiple Viewpoint Rendering (SIGG98)http://web.media.mit.edu/~halazar/sig98/halle98.pdfhttp://web.media.mit.edu/~halazar/sig98/halle98.pdf
![Page 10: Wild Dreams for Cameras Jack Tumblin Northwestern University jet@cs.northwestern.edu jet@cs.northwestern.edu From May 24 Panel Discussion on cameras](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ebf5503460f94bc925c/html5/thumbnails/10.jpg)
Oh et. al, 2001: 2DOh et. al, 2001: 2D3D3D
• Manually Guided—7 Hours! Manually Guided—7 Hours! • ? Would a more varied for camera pose help? ? Would a more varied for camera pose help?
http://graphics.lcs.mit.edu/ibedit/ibedit_s2001_cameraReady.pdfhttp://graphics.lcs.mit.edu/ibedit/ibedit_s2001_cameraReady.pdf
![Page 11: Wild Dreams for Cameras Jack Tumblin Northwestern University jet@cs.northwestern.edu jet@cs.northwestern.edu From May 24 Panel Discussion on cameras](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ebf5503460f94bc925c/html5/thumbnails/11.jpg)
BBixels ixels (bilinear)(bilinear)
Bixels: Picture Samples With Bixels: Picture Samples With Embedded Sharp BoundariesEmbedded Sharp Boundaries
Jack Tumblin and Prasun ChoudhuryJack Tumblin and Prasun Choudhury Northwestern University, Evanston IL, USANorthwestern University, Evanston IL, USA
PPixelsixels (bilinear)(bilinear)
![Page 12: Wild Dreams for Cameras Jack Tumblin Northwestern University jet@cs.northwestern.edu jet@cs.northwestern.edu From May 24 Panel Discussion on cameras](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ebf5503460f94bc925c/html5/thumbnails/12.jpg)
Results: boundary=depth discontinuityResults: boundary=depth discontinuity(Source data courtesy Ramesh Raskar, MERL)(Source data courtesy Ramesh Raskar, MERL)
Source Source (1100x800)(1100x800)
BoundariesBoundaries(50x65)(50x65)
![Page 13: Wild Dreams for Cameras Jack Tumblin Northwestern University jet@cs.northwestern.edu jet@cs.northwestern.edu From May 24 Panel Discussion on cameras](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ebf5503460f94bc925c/html5/thumbnails/13.jpg)
Results: boundary=depth discontinuityResults: boundary=depth discontinuity(Source data courtesy Ramesh Raskar, MERL)(Source data courtesy Ramesh Raskar, MERL)
BBixelsixels (bilinear)(bilinear)
50x6550x65
PPixelsixels (bilinear)(bilinear)
50x6550x65