1

Disoccluded Region Coding in Multiview Sequences

June 2015

Krzysztof Wegner

Chair of Multimedia Telecommunications and MicroelectronicsPoznań University of Technology, Poland

2

Background Disoccluded Region Coding is one of tools

from 3D Codec from Poznan University of Techology

Submitted in response to CfP on 3D Video codec in 2011

It was evaluated as one of the best 3D video coding technology

Goal Transmission of 3 views and 3 depth

maps

To be able to create many intermediate virtual views

3

Are the all views necessary?

4

Are the all views necessary?

5

Are the all views necessary?

6

Are the all views necessary?

7

Are the all views necessary?

8

Are the all views necessary?

9

Not all the samples from the left and the right view are used to synthesize virtual view

Only center view and disoccluded regions in side views

There is no need to transmit all of the views

10

Disoccluded regions coding

Disoccluded regions coding

11

Left view

Disoccluded regions map Disoccluded regions in left view

Transmitted CUs in left view

Disoccluded regions coding

Transmitted only disoccluded regions from the side views.

Not transmitted Coding Units are not signalized at all. Decoder can derive which Coding Units were

transmitted.

There is no need to signalize splitting of the Coding Units if it can be derived in the decoder.

12

Region that can be synthesized from base view

Region that cannot be synthesized from base view.

Transmitted region

Evaluation Implemented on top of reference HEVC

encoder (single view)

Three views and three depth maps Average quality of six virtual views

Subjectively (11 point MOS) Objectively (luminance PSNR )

4 multiview sequences Compared against MVC

13

Coding gains

14

Sequence

Bitrate reduction with respect to average quality of virtual

views

Objective(PSNR)

Subjective(MOS)

Poznan_Hall2 -20.3 -65.2

Poznan_Street -55.7 -67.5

Undo_Dancer -57.0 -52.3

GT_Fly -48.8 -62.0

Average -45.4 -61.7

15

Future Simplified version of the tool is under

standardization

Current work is focused on adapting the tool for circular camera arrangements