![Page 1: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/1.jpg)
The Past and the Future of Light Field Imaging
Hendrik Schilling
08.11.2018
![Page 2: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/2.jpg)
Outline
What is Light Field Imaging
I. The Past History and Applications
Commercialization
II. The Present Light Fields are for Industry
III. A Glimpse in the Future VR and Deep Learning
2
![Page 3: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/3.jpg)
What is Light Field Imaging
Theoretical Foundations
1846 Faraday: “Thoughts on Ray Vibrations”
1936 Gershung: “The Light Field”
1991 Adelson: “The Plenoptic Function”
3
![Page 4: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/4.jpg)
What is Light Field Imaging
The Plenoptic Function
4
L(x,y,z, , )θ φ
![Page 5: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/5.jpg)
What is Light Field Imaging
The Plenoptic Function
5
L(x,y,z, , )θ φ
first
pla
ne
seco
nd p
lane
(u,v)
(s,t)
(α,β)(γ,δ)
reference sphere
![Page 6: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/6.jpg)
What is Light Field Imaging
Recording Light Field Data
6
SubjectMain lens
Microlens
Array
Photosensor
Translation Stage
Plentopic Camera Camera Array
![Page 7: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/7.jpg)
History
The First Application: Display and RecorderLippmann 1908:
7
… not quite ready for the market
![Page 8: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/8.jpg)
History
The First Application: Display and RecorderFurther Developements:1911 Sokolev:
1930 Ives:
Further works by Coffey 1935, Ivanov 1948, Gruetzner 1952, Chutjian 1968, Dudnikov 1970, Ivars 1988
8
![Page 9: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/9.jpg)
History
The Beginning of an Era
1996 Levoy and Hanrahan: “Light Field Rendering”1996 Gortler et al.: “The Lumigraph”
Generation of new viewpointsfrom a recorded light field
9
![Page 10: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/10.jpg)
Applications
Light Field ApplicationsSynthetic Aperture Imaging
10
![Page 11: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/11.jpg)
Applications
Light Field ApplicationsSynthetic Aperture Imaging
11
![Page 12: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/12.jpg)
Applications
Light Field ApplicationsSuperresolution
12
![Page 13: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/13.jpg)
Applications
Light Field Applications 3D Reconstruction
13
![Page 14: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/14.jpg)
Why? A Short History
Light Field ApplicationsSurface Properties
14
![Page 15: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/15.jpg)
Commercialization
Commercial UseLytro (2006-2018)
● Application: Refocusing
● first commercial Plenoptic Camera● researches were very happy!● consumers not so much...
15
![Page 16: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/16.jpg)
Commercialization
Never Released● Pelican Imaging (2006-2016)
refocusing, close range depthAcquired by Tessera
● LinX (2006-2016)refocusingAcquired by Apple
16
![Page 17: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/17.jpg)
The Present
Current Light Field products are for industry!● Raytrix (since 2009)
optical inspection
● HD Vision Systems (since 2017)robotics, optical inspection
● AITvery high speed inline inspection
17
![Page 18: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/18.jpg)
A Glimpse in the Future
We are just starting...… and will see many more applications based on
Light Field Imaging● depth estimation (already available!)
● image synthesis (coming next...)
● material properties (just wait and see...)
18
![Page 19: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/19.jpg)
A Glimpse in the Future
… future applications:
19
Light Fields for VR
![Page 20: The Past and the Future of Light Field Imaging · The Past and the Future of Light Field Imaging Hendrik Schilling 08.11.2018. Outline What is Light Field Imaging I. The Past History](https://reader035.vdocuments.us/reader035/viewer/2022062921/5f0508a47e708231d410eddb/html5/thumbnails/20.jpg)
A Glimpse in the Future
...future applications:
20
training data for Deep Learning
TrueLightstartup in founding phase
semantic annotationdepthscene