1 error concealment for shape in mpeg-4 object-based coding student: jieh-yuean hsu advisor: prof....
Post on 21-Dec-2015
218 views
TRANSCRIPT
![Page 1: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/1.jpg)
1
Error Concealment for Shape in MPEG-4 Object-Based
Coding
Student: Jieh-Yuean Hsu
Advisor: Prof. David W. Lin
![Page 2: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/2.jpg)
2
Reference
[1]Meng-Yuan Liu, “Real-Time Implementation of MPEG-4 Video Encoder Using SIMD-Enhanced Intel Process” , M.S. thesis, Department of Electrical Engineering, Nation Chiao Tung University, Hsinchu, Taiwan, July 2004
[2]Cheng Huang and Paul Salama,” Error Concealment for Shape in MPEG-4 Object-Based Video Coding”, IEEE Transactions on Image Processing, Vol. 14, No. 4, April 2005.
![Page 3: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/3.jpg)
3
Reference
[3]Guido M. Schuster, Aggelos K. Katsaggelos,” Motion Compensated Shape Error Concealment”, IEEE Transactions on Image Processing, Vol. 15, NO. 2, February 2006
![Page 4: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/4.jpg)
4
Outline Introduction of MPEG-4 Object-
Based Coding Error Concealment
Boundary Extraction Boundary patching Boundary Filling
Experimental Result Conclusion
![Page 5: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/5.jpg)
5
Outline Introduction of MPEG-4 Object-
Based Coding Error Concealment
Boundary Extraction Boundary patching Boundary Filling
Experimental Result Conclusion
![Page 6: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/6.jpg)
6
VO and VOP
VO: Video Objects VOP: Video Object Planes A sequence of VOPs is referred to as
a VO I-VOP: Intra-coded P-VOP: Predictive-coded B-VOP: Bidirectionally predictive-coded
![Page 7: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/7.jpg)
7
VO and VOP
![Page 8: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/8.jpg)
8
VOP information
Spatial (Intra) Shape (Object-Based Only) Texture
Temporal (Inter) Motion
![Page 9: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/9.jpg)
9
Structure of VO Encoder
![Page 10: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/10.jpg)
10
Shape Information
Alpha plane Binary alpha plane Gray scale alpha plane
![Page 11: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/11.jpg)
11
Binary Mask
16
16BAB
Transparent
Opaque
Boundary
![Page 12: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/12.jpg)
12
Outline Introduction of MPEG-4 Object-
Based Coding Error Concealment
Boundary Extraction Boundary patching Boundary Filling
Experimental Result Conclusion
![Page 13: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/13.jpg)
13
Basic Assumption The shape of the objects does not
drastically change between the current VOP and the reference VOP
It is assumed that the reference VOP is undamaged
![Page 14: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/14.jpg)
14
Boundary Extraction
Use the 8-neighborhood If any pixel in the 8-neighborhood of a
current pixel doesn’t belong the object boundary
The boundary will be 4-connected
![Page 15: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/15.jpg)
15
Boundary Extraction
![Page 16: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/16.jpg)
16
4-connected Boundary
![Page 17: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/17.jpg)
17
Boundary Patching Find the number of endpoints
A boundary pixel having only one 4-connected neighbor
The number of endpoints must be even
Partition the endpoints in the current VOP
![Page 18: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/18.jpg)
18
Boundary Patching
Endpoints
Aa
c
CB
b
![Page 19: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/19.jpg)
19
Boundary Patching Patching by Global Motion
Compensation Some parameter:
Scale:
Centroid:
,
,
2( 2)
( 1) 1
i ji j
i ji j
barea VOP
scalearea VOP b
( , )x y
,( )
( )
i ji jb j
xarea VOP
,( )
( )
i ji jb i
yarea VOP
![Page 20: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/20.jpg)
20
Boundary Patching orientation angle:
Rotation angle:
2, ,( )i j i ji j
a x x b , , ,( )( )i j i j i ji j
b x x y y b 2
, ,( )i j i ji jc y y b
1tan ( )( )ba c
cur ref
![Page 21: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/21.jpg)
21
Boundary Patching
Current VOP Reference VOP
[( ) cos( ) ( ) sin( )]cur cur cur curref ref
x x y yx x
scale
[( ) cos( ) ( ) sin( )]cur cur cur curref ref
y y x xy y
scale
![Page 22: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/22.jpg)
22
Boundary Patching
Reference VOP Current VOP
[( ) cos( ) ( ) sin( )]cur ref ref ref ref curx x x y y scale x
[( ) cos( ) ( ) sin( )]cur ref ref ref ref cury y y x x scale y
![Page 23: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/23.jpg)
23
Boundary Patching
Mapping
Aa
c
CB
b
A
a
c
CB
b
Current VOP Reference VOP
![Page 24: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/24.jpg)
24
Boundary Patching Traverse the boundary of the ref.
VOP, and record the order of endpoints
ex:
Map each pixel in curve whose endpoints belong to different pair
ex , ,
A a c C B b
a c C B b A
![Page 25: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/25.jpg)
25
Boundary Patching
Reference VOP Current VOP
a
A
c
C
B
b
Recovered pixel
![Page 26: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/26.jpg)
26
Boundary Filling Filling in the closed boundary of the
VOP with opaque pixels After filling, we can get the recovered
VOP
Recovered VOP
![Page 27: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/27.jpg)
27
Outline Introduction of MPEG-4 Object-
Based Coding Error Concealment
Boundary Extraction Boundary patching Boundary Filling
Experimental Result Conclusion
![Page 28: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/28.jpg)
28
Experimental Result brea_qcif, 30 fps
![Page 29: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/29.jpg)
29
Experimental Result
![Page 30: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/30.jpg)
30
Experimental Result Akiyo_cif, 10fps
![Page 31: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/31.jpg)
31
Experimental Result
![Page 32: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/32.jpg)
32
Experimental Result brea_qcif, 10 fps
![Page 33: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/33.jpg)
33
Outline Introduction of MPEG-4 Object-
Based Coding Error Concealment
Boundary Extraction Boundary patching Boundary Filling
Experimental Result Conclusion
![Page 34: 1 Error Concealment for Shape in MPEG-4 Object-Based Coding Student: Jieh-Yuean Hsu Advisor: Prof. David W. Lin](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649d625503460f94a454c4/html5/thumbnails/34.jpg)
34
Conclusion The method for shape concealment based on
global motion compensation It works well for video sequence with slow motion
and high frame rate It can achieve good result, even the shape is
severely damaged Extra information added resulted in 5% increase
for stream size, and it is acceptable