Stereoscopic 3D

Stereoscopic 3D2013/10/30Stereoscopic Image Transforms to Autostereoscopic Multiplexed ImageWei-Ming Chen, Chi-Hao Chiou and Sheng-Hao Jhang

Computer Science and Automation Engineering (CSAE), 2011OutlineIntroduction Related WorkProposed MethodExperimental ResultsConclusion3Introduction44Introduction3D technologies have become popular in recent years.Widely applied to movie, films and show.In early 3D vision technology:Anaglyph PolarizationShutter

5With special glasses

Anaglyph

Polarization LCD TV(Micro-retarder)

Shutter - 120Hz3D3D5Anaglyph Glass

Polarization Glass

Polarization GlassShutter Glass

IntroductionAutostereoscopic 3D displayNon-glass system

Propose a new technique for generating Autostereoscopic multiplexed content.

9Objective:Related Work1010DisparityVertical ParallaxUsually = 0focus on horizontal parallax

Horizontal ParallaxIdentify the distance of the object

Disparity

retina12Image RectificationZero Parallax

Zero parallax plane

Image RectificationSimplified to one dimension - horizontal

Solution : All epipolar lines are parallel in the rectified image plane.

Image Rectification

3D coordinate of real scene:Disparity to Depth

f : focal lengthb : the length of baselined : disparity(u0, v0) : coordinate of image center(camera intrinsic parameter matrix K)(u, v) : pixel coordinate

Du Xin, Zhu Yun-fimg, "A Flexible Method for 3D Reconstruction of Urban Building", ICSP 2008 proceedings.

BaselineEpipolar line3D ReconstructionWei-wei Ma, My-Ha Le, Kang-Hyun Jo, "3D Reconstruction and Measurement of Indoor Object Using Stereo Camera", The 6th International Forum on Strategic Technology, 2011.

Autostereoscopic 3D displayTime-multiplexedSwitch rapidly (left and right images)2D & 3D : same resolutionSpatial-multiplexedParallax barrierLenticular lensesLower resolution for 3D

18(Parallax barrier)(Lenticular lenses)18Autostereoscopic 3D displayParallax barrier

19Lenticular lenses

(Parallax barrier)(Lenticular lenses)19ProposedMethod2020System Flow of Depth-map Generation 21

Stereo matching21

Depth-map Generation1) Feature point detectionUse SURF algorithm[5] (based on SIFT)2) Epipolar GeometryMatching the feature points3) InterpolationEstimate the pixels which is not feature points4) GraphcutGrouping the close pixels (segmentation)

22Disparity between stereo images[5] H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, "Speeded-Up Robust Features (SURF)," Computer Vision and Image Understanding, vol. 110, pp. 346-359, 2008.22System Flow of Synthesis 23

23Zero-parallax settingThe most comfortably distance between user and display could be determined from Zc .

Zc (Base plane)

24

Zfar : the highest depth map valueZnear : the lowest depth map value 24Pre-processing the Depth MapMean filterGaussian filter

25253D-image WarpingMulti-ViewNeed large storage space use depth map to create virtual views

Warping Reference view Virtual view

26

warp2D 0 s 263D-image WarpingMulti-ViewNeed large storage space use depth map to create virtual views

27

Warping2D 0 s 273D-image WarpingLenticular autostereoscopic displayDIBR

28

2D 0 s 28Issues[*]: Disparity RangeLimitations of perception and technologyDisparity SensitivityMore sensitive to nearby objectsDisparity GradientDisparity VelocityTemporal information

3D-image Warping29[*] :Lang, M., Hornung, A., Wang, O., Poulakos, S., Smolic, A. & Gross, M. (2010, July).Nonlinear Disparity Mapping for Stereoscopic 3D.To appear inACM Transactions on Graphics (Proc. SIGGRAPH). 2D 0 s 29Disoccluded Regions-fillingDisoccluded Regions : regions without warped pixel

30warpReference viewVirtual view30Disoccluded Regions-fillingAssociated with DIBR:

31

Similar to occlusion handling31Disoccluded Regions-filling32

32ExperimentalResults3333Experimental ResultsDisoccluded Regions-filling:

34

Previous WorkProposedExperimental Results35The six warping views

Experimental Results36

Synthesized resultConclusion3737Conclusion3D-image generation of stereo images with good 3D effect was proposed.Future : using temporal information

Stereo images Disparity map 3D warping Hole fillingIssues:Zero-parallax setting Disparity Range / Disparity Velocity Hole filling

38ReferenceOptical Design, Fabrication, and Measurement 3D Introduction and Project (Dept. of Photonics & Display Institute,National Chiao Tung University)

Image Rectification (Stereo) , Guido Gerig

AGENCY1903 BLOG http://www.agency1903.com/blog/2010/8/18/z-axis-power

3D3D ()