![Page 1: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/1.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
A study on resolution-improved volumetric computational reconstruction using stereo
matching in 3D integral imaging
Graduate school of Design & IT Dongseo Univ
Hwang Yong-Hyeonhttp://kowon.dongseo.ac.kr/~d0066042
![Page 2: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/2.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Contents
1. Introduction2. Conventional method3. Proposed method4. Experiment Results5. Future work
![Page 4: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/4.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
3D Display
Human Visual System
Stereo Disparity
![Page 5: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/5.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
3D Display
1.Stereoscopic display
2.Multi-view display
3.Integral imaging display
4.Holographic display
Leftcamera
Rightcamera
![Page 6: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/6.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
3D Display
1.Stereoscopic display
2.Multi-view display
3.Integral imaging display
4.Holographic display
<Cambridge Univ.>
![Page 7: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/7.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
3D Display
1.Stereoscopic display
2.Multi-view display
3.Integral imaging display
4.Holographic display
![Page 8: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/8.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
3D Display
1.Stereoscopic display
2.Multi-view display
3.Integral imaging display
4.Holographic display
![Page 9: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/9.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Integral imaging
Pickup Display3D 3D
Elemental images
Lenslet array
3D object 3D image
Elemental images
Lenslet array
![Page 10: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/10.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Optical vs Computational
Optical pickup
OpticalReconstruction
ComputationalReconstruction
Real 3D display(NHK,SNU, Connecticut Univ. etc)
Pattern recognition(Connecticut Univ., KWU etc)
VCR
![Page 11: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/11.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
CII system
Pickup process(optical)
Volumetric computational reconstruction (VCR)(computer)
plane by plane
VCR
<Computational integral imaging(CII) system>
![Page 12: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/12.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
VCR of 3D objects
Elemental image Reconstruction Object Pinhole array
Elemental image
![Page 14: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/14.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Conventional method
B. Javidi et al, R. Ponce-Diaz, and S.-H. Hong, Opt. Lett. 31, 1106-1108 (2006)
Reference plane image
z=zrz=0
Cross-correlation
z=zrz=0
Target plane image
Pickup device
Reference CII system
zr
Lenslet array3D object
Pickup device
Target CII
system
zr
Lenslet array
zo1
3D object occlusion
![Page 16: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/16.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Novel Proposed method
Sub-Imagetransformation
Segmentation using stereo matching
VCR
zr
Inverse Sub-Image
transformation
Pickup device
Lenslet array
3D objectOcclusi
on
zrzo
Elemental image
![Page 18: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/18.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Novel Proposed System
Sub-Imagetransforma
tion
Segmentation using stereo matching
VCR
zr
Pickup device
Lenslet array
3D objectOcclusi
on
zrzo
Inverse Sub-Image
transformation
Elemental image
![Page 19: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/19.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Sub-image transformation
Elemental image Sub-image
![Page 21: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/21.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Sub-image transformation
1 pixel sub-image transformation
Elemental imagesElemental images
![Page 22: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/22.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Sub-image transformation
900 x 900 1 pixel sub-image transformation
![Page 23: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/23.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Novel Proposed System
Segmentation using stereo matching
VCR
zr
Pickup device
Lenslet array
3D objectOcclusi
on
zrzo
Inverse Sub-Image
transformation
Elemental image
Sub-Imagetransforma
tion
![Page 24: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/24.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Stereo matching
PL = (X,Y,Z)OL
x
y
z (uL,vL)
OR
x
y
z
(uR,vR)
base
line B
![Page 25: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/25.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
feature-based method
Original image Feature image
![Page 26: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/26.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Matching window
area-based method
Left image Right image
![Page 27: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/27.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Stereo matching
SSD(Sum of square distance)
SAD(Sum of absolute distance)
NCC(Normalized correlation
coefficient)
![Page 28: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/28.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Disparity map
Right ImageLeft ImageDisparity
![Page 29: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/29.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Sub-image transformation
900 x900 5 pixel sub-image transformation
![Page 33: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/33.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Segmentation result
5 x 5 Sub-image Segmentation result
![Page 34: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/34.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Novel Proposed System
Segmentation using stereo matching
VCR
zr
Pickup device
Lenslet array
3D objectOcclusi
on
zrzo
Inverse Sub-Image
transformation
Elemental image
Sub-Imagetransforma
tion
![Page 35: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/35.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Inverse sub-image
5 x 5 Sub-image
Elemental image
![Page 36: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/36.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Novel Proposed System
Segmentation using stereo matching
VCR
zr
Pickup device
Lenslet array
3D objectOcclusi
on
zrzo
Inverse Sub-Image
transformation
Elemental image
Sub-Imagetransforma
tion
![Page 39: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/39.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
VCR of conventional method
Elemental image VCR image
![Page 40: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/40.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
VCR of proposed method
Segmentation elemental image VCR image
![Page 41: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/41.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
PSNR of conventional method
PSNR : 20.94db
Reference image Reconstruction image
![Page 42: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/42.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
PSNR of proposed method
PSNR : 29.61db
Reference image Reconstruction image
![Page 43: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/43.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Test image
Cow Toy Car Horse
Cow Toy Car Horse
![Page 44: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/44.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
PSNR
Conventional method
Proposed methodImproved
PSNR
Cow 20.94 29.61 8.67db
Toy 22.31 29.81 7.5db
Car 18.03 24.01 5.98db
Horse 13.78 23.19 9.41db
![Page 46: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/46.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Real image
Elemental image
Sub-image a die Toy
Segmentation result
![Page 47: Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching](https://reader031.vdocuments.us/reader031/viewer/2022013004/56649e7f5503460f94b82de2/html5/thumbnails/47.jpg)
Hwang Yong-Hyeon Dongseo Univ. E-mail:[email protected]
Future work
• Real image test• Segmentation using difference stereo
matching• Real image calibration