Upload File

details: multiview video synthesis

1
Details: Multiview video synthesis Motion vector based video objects segmentation and tracking Feature based incomplete 3D structure video synthesizing Layered depth images based multiview video rendering Semi-immersive MultiView display environment High efficiency Multiview Video Coding Disparity based multiview video coding View dependent multiview video predicting codec Interactive multiview video streaming View switch Time frozen moment Time continuous sweep 交交交交交交交 (Interactive Multiview Video ) Introducti on 交交交交交交交（ Interactive Multiview Video ）： The next generation multimedia applications will be interactive and realistic based on network. In one hand, people want to be more active and participant to meet the requirement of personality, in the other hand, they hope to get realistic experience while viewing the scene or interacting with other people. This project is proposed to resolve the represent, interaction, codec and transmission of 3D interactive video, and implement the interactive network multimedia application in the near future with the stereo video and multi-view video technology putting into practicability. Objects: Viewpoint selecting and multi-view 3D image synthesizing High efficiency multi-view video codec algorithms Streaming technology for Multi-view video A prototype of multi-view video streaming system 交交交交交交交交交交交交交交 交交交交交交交交交交交交交交 交交交交交交交 交交交交交交交 featurepointmatching triangulation virtualvideo synthesizing by interpolation featurepointmatching triangulation virtualvideo synthesizing by interpolation PSNR + - + + Encoderside D ecoder side C oded leftim age C oded D isparity m ap C oded right im age PSNR + - + + Encoderside D ecoder side C oded leftim age C oded D isparity m ap C oded right im age M ultiview Video C oding w ith R egion based R ate A llocation PSNR + - + + Encoderside D ecoder side C oded leftim age C oded D isparity m ap C oded right im age PSNR + - + + Encoderside D ecoder side C oded leftim age C oded D isparity m ap C oded right im age PSNR + - + + Encoderside D ecoder side C oded leftim age C oded D isparity m ap C oded right im age Left-im age Right-im age D isparity M ap M PE G -4 Encoder MPEG -4 D ecoder R econstructed Right- im age PSNR + R esidual Texture - R econstructed R esidualTexture D isparity Estim ation Local- MPEG -4 Decoder R econstructed left-image R econstructed D isparity Map C om pensated Right -im age + Reconstructed left-im age Reconstructed Disparity Map Com pensated Right -im age + Encoderside D ecoder side C oded leftim age C oded D isparity m ap C oded right im age R ate Allocation R egion Segm entation M ultiview Video C oding w ith R egion based R ate A llocation video stream 1 video stream n video stream 2 video stream 3 View sw itching position View T i m e V iew G roup 1 P P P P P P P P P P P P I P P … … … … … P P P P P … … … … … Supported by NSFC, 863,CNGI

Upload: dyani

Post on 15-Jan-2016

45 views

Category:

Documents


4 download

Report

Tags:

DESCRIPTION

清华信息科学与技术国家实验室 普适计算研究部. 交互多视点视频 ( Interactive Multiview Video ). Supported by NSFC, 863,CNGI. Introduction. 交互多视点视频（ Interactive Multiview Video ）： - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Details: Multiview video synthesis

Details: Multiview video synthesis Motion vector based video objects segmentation and tracking Feature based incomplete 3D structure video synthesizing Layered depth images based multiview video rendering

Semi-immersive MultiView display environment High efficiency Multiview Video Coding Disparity based multiview video coding View dependent multiview video predicting codec

Interactive multiview video streaming View switch

Time frozen moment Time continuous sweep

交互多视点视频 (Interactive Multiview Video )

Introduction

交互多视点视频（ Interactive Multiview Video ）： The next generation multimedia applications will be interactive and realistic based on network. In one hand, people want to be more active and participant to meet the requirement of personality, in the other hand, they hope to get realistic experience while viewing the scene or interacting with other people. This project is proposed to resolve the represent, interaction, codec and transmission of 3D interactive video, and implement the interactive network multimedia application in the near future with the stereo video and multi-view video technology putting into practicability. Objects: Viewpoint selecting and multi-view 3D image synthesizing High efficiency multi-view video codec algorithms Streaming technology for Multi-view video A prototype of multi-view video streaming system

清华信息科学与技术国家实验室 清华信息科学与技术国家实验室 普适计算研究部普适计算研究部

feature point matching triangulation

virtual video synthesizing by interpolation

feature point matching triangulation

virtual video synthesizing by interpolation

Left - imageLeft - image

Right - imageRight - image

DisparityMap

DisparityMap MPEG - 4

Encoder

MPEG - 4Encoder

MPEG - 4Decoder

MPEG - 4Decoder

ReconstructedRight - image

ReconstructedRight - image

PSNR

+

Residual Texture

Residual Texture

-

ReconstructedResidual Texture

ReconstructedResidual Texture

DisparityEstimation

DisparityEstimation

Local -MPEG - 4Decoder

Local -MPEG - 4DecoderReconstructed

left- image

Reconstructedleft- image

ReconstructedDisparity Map

ReconstructedDisparity Map

CompensatedRight - image

CompensatedRight - image

+

Reconstructedleft- image

Reconstructedleft- image

ReconstructedDisparity Map

ReconstructedDisparity Map

CompensatedRight - image

CompensatedRight - image

+

Encoder side

Decoder side

Coded left image

Coded Disparity map

Coded right imageLeft - imageLeft - image

Right - imageRight - image

DisparityMap

DisparityMap MPEG - 4

Encoder

MPEG - 4Encoder

MPEG - 4Decoder

MPEG - 4Decoder

ReconstructedRight - image

ReconstructedRight - image

PSNR

+

Residual Texture

Residual Texture

-

ReconstructedResidual Texture

ReconstructedResidual Texture

DisparityEstimation

DisparityEstimation

Local -MPEG - 4Decoder

Local -MPEG - 4DecoderReconstructed

left- image

Reconstructedleft- image

ReconstructedDisparity Map

ReconstructedDisparity Map

CompensatedRight - image

CompensatedRight - image

+

Reconstructedleft- image

Reconstructedleft- image

ReconstructedDisparity Map

ReconstructedDisparity Map

CompensatedRight - image

CompensatedRight - image

+

Encoder side

Decoder side

Coded left image

Coded Disparity map

Coded right image

Rate AllocationRate Allocation

Region Segmentation Region Segmentation

Multiview Video Coding with Region based Rate Allocation

Left - imageLeft - image

Right - imageRight - image

DisparityMap

DisparityMap MPEG - 4

Encoder

MPEG - 4Encoder

MPEG - 4Decoder

MPEG - 4Decoder

ReconstructedRight - image

ReconstructedRight - image

PSNR

+

Residual Texture

Residual Texture

-

ReconstructedResidual Texture

ReconstructedResidual Texture

DisparityEstimation

DisparityEstimation

Local -MPEG - 4Decoder

Local -MPEG - 4DecoderReconstructed

left- image

Reconstructedleft- image

ReconstructedDisparity Map

ReconstructedDisparity Map

CompensatedRight - image

CompensatedRight - image

+

Reconstructedleft- image

Reconstructedleft- image

ReconstructedDisparity Map

ReconstructedDisparity Map

CompensatedRight - image

CompensatedRight - image

+

Encoder side

Decoder side

Coded left image

Coded Disparity map

Coded right imageLeft - imageLeft - image

Right - imageRight - image

DisparityMap

DisparityMap MPEG - 4

Encoder

MPEG - 4Encoder

MPEG - 4Decoder

MPEG - 4Decoder

ReconstructedRight - image

ReconstructedRight - image

PSNR

+

Residual Texture

Residual Texture

-

ReconstructedResidual Texture

ReconstructedResidual Texture

DisparityEstimation

DisparityEstimation

Local -MPEG - 4Decoder

Local -MPEG - 4DecoderReconstructed

left- image

Reconstructedleft- image

ReconstructedDisparity Map

ReconstructedDisparity Map

CompensatedRight - image

CompensatedRight - image

+

Reconstructedleft- image

Reconstructedleft- image

ReconstructedDisparity Map

ReconstructedDisparity Map

CompensatedRight - image

CompensatedRight - image

+

Encoder side

Decoder side

Coded left image

Coded Disparity map

Coded right image

Rate AllocationRate Allocation

Region Segmentation Region Segmentation

Left - imageLeft - image

Right - imageRight - image

DisparityMap

DisparityMap MPEG - 4

Encoder

MPEG - 4Encoder

MPEG - 4Decoder

MPEG - 4Decoder

ReconstructedRight - image

ReconstructedRight - image

PSNR

+

Residual Texture

Residual Texture

-

ReconstructedResidual Texture

ReconstructedResidual Texture

DisparityEstimation

DisparityEstimation

Local -MPEG - 4Decoder

Local -MPEG - 4DecoderReconstructed

left- image

Reconstructedleft- image

ReconstructedDisparity Map

ReconstructedDisparity Map

CompensatedRight - image

CompensatedRight - image

+

Reconstructedleft- image

Reconstructedleft- image

ReconstructedDisparity Map

ReconstructedDisparity Map

CompensatedRight - image

CompensatedRight - image

+

Encoder side

Decoder side

Coded left image

Coded Disparity map

Coded right imageLeft - imageLeft - image

Right - imageRight - image

DisparityMap

DisparityMap MPEG - 4

Encoder

MPEG - 4Encoder

MPEG - 4Decoder

MPEG - 4Decoder

ReconstructedRight - image

ReconstructedRight - image

PSNR

+

Residual Texture

Residual Texture

-

ReconstructedResidual Texture

ReconstructedResidual Texture

DisparityEstimation

DisparityEstimation

Local -MPEG - 4Decoder

Local -MPEG - 4DecoderReconstructed

left- image

Reconstructedleft- image

ReconstructedDisparity Map

ReconstructedDisparity Map

CompensatedRight - image

CompensatedRight - image

+

Reconstructedleft- image

Reconstructedleft- image

ReconstructedDisparity Map

ReconstructedDisparity Map

CompensatedRight - image

CompensatedRight - image

+

Encoder side

Decoder side

Coded left image

Coded Disparity map

Coded right image

Rate AllocationRate Allocation

Region Segmentation Region Segmentation

Multiview Video Coding with Region based Rate Allocation

video stream 1

video stream n

video stream 2

video stream 3

View switching position

View

Time

View Group 1

PP P PP

PP P PP

PP I PP

…

…

…

…

…

PP P PP

…

…

…

…

…

Supported by NSFC, 863,CNGI

TI-30XS MultiView™ and TI-30XB MultiView™ Scientific ... · examples that demonstrate the TI-30XS MultiView™ and TI-30XB MultiView functi ons. All references in this manual

Lecture Outline 2016w - University of British Columbiacourses.ece.ubc.ca/541/Lectures/LectureOutline2016_fall.pdf · 2016-09-20 · Outline • View Synthesis, multiview, free view,

Multiview Drawings

4.3 Multiview Setup - CCTV Camera Pros · 4.3 Multiview Setup Configure this section on remote PC. 4.3.1 Install Multiview Multiview can be obtained from one of the following locations:

Multiview Video

MultiView Terminal Emulator - FutureSoft Inc. mechanical, including ... MultiView DeskTop and Host Support Server are tradenames of ... MultiView 2007, also called MultiView Terminal

Multiview Image Matching Based on SURF (Speeded- Up …joics.org/gallery/[email protected] Abstract ... LITERATURE REVIEW 2.1 Multiview Image Multiview image is

Multiview short version

4.3 Multiview Setup - Ezwatch - Security Cameras · GeoVision Technical Handbook 46 4.3 Multiview Setup Configure this section on remote PC. 4.3.1 Install Multiview Multiview can

Uncalibrated Multiview Synthesis Based on Epipolar ...mcl.usc.edu/wp-content/uploads/2016/01/14.pdfUncalibrated Multiview Synthesis based on Epipolar Geometry Approximation Digest

Graph Multiview Canonical Correlation Analysis · Abstract—Multiview canonical correlation analysis (MCCA) seeks latent low-dimensional representations encountered with multiview

Multiview Drawing

Nanonics MultiView 2000™ Product Presentation. MultiView 2000 ™ Complete System MultiView 2000™ Product Presentation

Multipass/Multiview Interferometric SAR - NATO Educational Notes/STO-EN... · Via Diocleziano, 328 I-80124 Napoli ITALY ... Multipass/Multiview Interferometric SAR , Multipass/Multiview

Stereo and Multiview - New York University Tandon School ...eeweb.poly.edu/~yao/videobook/stereo.pdf · • Stereo and multiview video display • Stereo and multiview video compression

Multiview Users Manual

TI-30XS MultiView™ and TI-30XB MultiView™ … MultiView™ Scientific Calculator Important information .....2 Examples .....3 Switching the TI-30XS MultiView calculator on and

Multiview Rendering

Multiview Sketches

Blackmagic MultiView Manual

Multiview Drawing Exercises

MultiView 1000

Multiview Drawings. Multiview Drawing A multiview drawing is one that shows two or more two-dimensional views of a three- dimensional object. Multiview

Automatic Multiview Synthesis – Towards a Mobile …...Automatic Multiview Synthesis – Towards a Mobile System on a Chip Michael Schaffner 1;2, Frank K. Gurkaynak¨ 1, Hubert Kaeslin

Drawing multiview exercise

Stereo and Multiview Sequence Processing. Outline Stereopsis Stereo Imaging Principle Disparity Estimation Intermediate View Synthesis Stereo Sequence

Multiview Reconstruction

Software Distributed Shared Memory (SDSM): MultiView SDSM, false sharing. Solution: MultiView

A Survey on Multiview Video Synthesis and Editing › files › 27659659 › A_Survey_on_Multiview_Video... · A Survey on Multiview Video Synthesis and Editing Shaoping Lu, Taijiang

Multiview Methodology

Unit 2. Unit 2. Multiview Drawing Multiview Drawing After completing this unit, the student should be able to: Explain what multiview drawings are and

MultiView 1000™ Product Presentation Nanonics MultiView 1000™

MultiView Brochure

Semisupervised Multiview Distance Metric Learning for Cartoon Synthesis

Multiview Manual