eg 2011 | computational plenoptic imaging star | i. introduction1 computational plenoptic imaging...

8
EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 1 Computational Plenoptic Imaging don Wetzstein 1 Ivo Ihrke 2 Douglas Lanman 3 Wolfgang Heidr ersity of British Columbia 2 Saarland University 3 MIT Medi Eurographics 2011 – State of the Art Report I. Introduction

Upload: annabella-hoover

Post on 17-Jan-2018

231 views

Category:

Documents


0 download

DESCRIPTION

EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction3 Cameras are modeled as one Human Eye webvision.med.utah.edu [Williams 91] How would a camera look like if it was modeled as a mantis shrimp eye?

TRANSCRIPT

Page 1: EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction1 Computational Plenoptic Imaging Gordon Wetzstein 1 Ivo Ihrke 2 Douglas Lanman 3 Wolfgang

EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 1

Computational Plenoptic ImagingGordon Wetzstein1 Ivo Ihrke2 Douglas Lanman3 Wolfgang Heidrich1

1University of British Columbia 2Saarland University 3MIT Media Lab

Eurographics 2011 – State of the Art Report

I. Introduction

Page 2: EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction1 Computational Plenoptic Imaging Gordon Wetzstein 1 Ivo Ihrke 2 Douglas Lanman 3 Wolfgang

EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 2

The Mantis Shrimp

3 bands = trinocular visionwith each eye!

Up to 16 different photoreceptors:• 12 for color (4 UV, visible, IR)• 4 for polarization (linear & circular)

Page 3: EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction1 Computational Plenoptic Imaging Gordon Wetzstein 1 Ivo Ihrke 2 Douglas Lanman 3 Wolfgang

EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 3

Cameras are modeled as one Human Eye

http://en.wikipedia.org/wiki/Bayer_filter

webvision.med.utah.edu

[Williams 91]

How would a camera look like if it was modeled as a mantis shrimp eye?

Page 4: EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction1 Computational Plenoptic Imaging Gordon Wetzstein 1 Ivo Ihrke 2 Douglas Lanman 3 Wolfgang

EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 4

The Plenoptic Function

• Ray-based model for light• Includes variations in space, time,

wavelength, and directions( , , , , , , )x y zP P t V V V

[Adelson & Bergen 91]

( , , , )x yP P V V

xVyV

More common angular parameterization

• Light field is

Page 5: EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction1 Computational Plenoptic Imaging Gordon Wetzstein 1 Ivo Ihrke 2 Douglas Lanman 3 Wolfgang

EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 5

Plenoptic Information Sampled

Allan Brooks, EE421, 2003

HVSConsumer

Video Camera

1

continuous, ~30fps(band-limited)

3, Bayer color filter array

1920x1080 (HD)

4 Plenoptic Parameters Sampled (no Vx,y,z)

Page 6: EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction1 Computational Plenoptic Imaging Gordon Wetzstein 1 Ivo Ihrke 2 Douglas Lanman 3 Wolfgang

EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 6

Computational Photography and Plenoptic Imaging

• CPI: joint optical modulation & computational processing of plenoptic dimensions

• CP: computational optics, illumination, probes, reconstruction, image processing, sensors, etc.

[Ras

kar &

Tum

blin

]

Page 7: EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction1 Computational Plenoptic Imaging Gordon Wetzstein 1 Ivo Ihrke 2 Douglas Lanman 3 Wolfgang

EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 7

Taxonomy and Overview

II. High Dynamic Range Imaging – 10 minutes, Wetzstein

III. Spectral Imaging – 10 minutes, Wetzstein

IV. Light Field Acquisition – 25 minutes, Lanman

V. Space & Focal Surfaces – 15 minutes, Wetzstein

VI. Temporal Multiplexing – 10 minutes, Wetzstein

VII. Further Light Properties – 10 minutes, Wetzstein

VIII. Discussion – 5 minutes, Wetzstein

Page 8: EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction1 Computational Plenoptic Imaging Gordon Wetzstein 1 Ivo Ihrke 2 Douglas Lanman 3 Wolfgang

EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 8

Next: High Dynamic Range Imaging