home gateway for three-screen tv using h.264 svc and raptor fec
DESCRIPTION
Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC. IEEE Transactions on Consumer Electronics, Vol. 57, No. 4, November 2011 Eun-Seok Ryu and Nikil Jayant. Outline. Background Introduction Proposed Method Experimental Results Recent Research Conclusion. Background. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/1.jpg)
1
Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC
IEEE Transactions on Consumer Electronics, Vol. 57, No. 4, November 2011
Eun-Seok Ryu and Nikil Jayant
![Page 2: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/2.jpg)
2
Outline
ه Backgroundه Introductionه Proposed Methodه Experimental Resultsه Recent Researchه Conclusion
![Page 3: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/3.jpg)
3
Background
ه Home Gatewayه The home gateway is an intelligent network interface device
located at the consumer premises.ه It enables residential user to access the internet services delivered
to home and also to access the different services offered by various smart devices located within home.
ه Three-screen Serviceه is a multimedia service and provides the right solution for
consumers to access rich multimedia resources on any device, anytime, and anywhere.
![Page 4: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/4.jpg)
4
Background
ه Scalable Video Codingه H.264/SVC is in particular of importance because it envisions
methods for controlling video characteristics such as resolution, quality, and frame rate according to the network condition. For this purpose, SVC uses a layered coding approach to provide combined spatial, temporal, and quality scalabilities.
![Page 5: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/5.jpg)
5
Background
ه Scalable Video Codingه SVC coding has several advantages :
1. reduce total bandwidth, storage, and computational complexity by supporting many clients with a single video content file.
2. applicable to many unequal error protection (UEP) methods using priorities of each layer.
3. SVC approach is inherently more robust because of its error resilient tools.
![Page 6: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/6.jpg)
6
Background
ه Raptor FECه The Raptor FEC was developed by Amin Shokrollahi as one of
fountain codes in 2001 and is also called a rateless code.
ه Several standards have adopted Raptor code as a standard: ى Multimedia broadcast and multicast services (MBMS) in the 3rd generation
partnership project (3GPP)ى DVB-Hى Reliable multicast transport (RMT) working group within the internet
engineering task force (IETF).
ه The Raptor FEC can be designed with both the systematic and non-systematic approaches.
![Page 7: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/7.jpg)
7
Background
ه Raptor FECه Encode
![Page 8: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/8.jpg)
8
Outline
ه Backgroundه Introductionه Proposed Methodه Experimental Resultsه Recent Researchه Conclusion
![Page 9: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/9.jpg)
9
Introduction
ه According to the annual Cisco visual networking index (VNI) forecast: ه 2009-2014, the sum of all forms of videos will continue to exceed
91 percent of global consumer traffic.ى TVى VoDى internet videoى peer-to-peer
ه These show the importance of home multimedia technology in near future.
![Page 10: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/10.jpg)
10
Introduction
ه Video service providers (VSP) are preparing premium services.
ه The home gateway and three-screen clients are as followed.
![Page 11: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/11.jpg)
11
Introduction
ه A traditional solution for source coding is to prepare separate pre-encoded video streams according to the capability of each targeted device.
ه Another advanced solution is transcoding one high resolution and high bit rate video sequence for targeted screen sizes and bit rates of TV clients.
![Page 12: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/12.jpg)
12
Introduction
ه This paper proposes an elastic video streaming solution for 3STV and home gateway.1. SVC source coding technology to support various device
capabilities with single bitstream.2. Raptor forward error correction technology to achieve strong
packet loss recovery feature in application layer.
![Page 13: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/13.jpg)
13
Introduction
ه This paper proposes optimized video streaming methods with SVC and Raptor FEC.1. adaptive SVC layer-switching method, which enables the server
to perform selecting appropriate according to bandwidth.2. adaptive Raptor FEC method, which controls the overhead of
Raptor FEC according to PLR.
ه The advantage of an efficient combination of (1) and (2) is that1. the optimal layer numbers to be sent under permitted bandwidth.2. the overhead of Raptor FEC to protect the packets of selected
layers according to link quality.
![Page 14: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/14.jpg)
14
Outline
ه Backgroundه Introductionه Proposed Methodه Experimental Resultsه Recent Researchه Conclusion
![Page 15: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/15.jpg)
15
Adaptive SVC Layer-switching with Raptor FEC Overhead Control
ه Conceptual procedures of the proposed methodه Received Signal Strength Indicator (RSSI)-based feedback
![Page 16: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/16.jpg)
16
Adaptive SVC Layer-switching with Raptor FEC Overhead Control
ه System architecture of implemented home gateway
![Page 17: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/17.jpg)
17
Adaptive SVC Layer-switching with Raptor FEC Overhead Control
ه Adaptive SVC Layer-switchingه is a reliable method for automatic switching between the several
spatial/temporal layers.ه is the easiest natural bandwidth adaptation method in the middle of
streaming.
![Page 18: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/18.jpg)
18
Adaptive SVC Layer-switching with Raptor FEC Overhead Control
ه Adaptive Raptor FECه Raptor FEC shows excellent packet loss recovery results in
various PLR conditions, for any given overall FEC overhead rate.ه The proposed method determines the Raptor overhead according
to feedback of channel condition based on these experimental results as an overhead adaptation method.
![Page 19: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/19.jpg)
19
Adaptive SVC Layer-switching with Raptor FEC Overhead Control
ه The flow chart of algorithm for SVC layer and Raptor overhead adaptation
![Page 20: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/20.jpg)
20
Outline
ه Backgroundه Introductionه Proposed Methodه Experimental Resultsه Recent Researchه Conclusion
![Page 21: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/21.jpg)
21
Experimental Results
ه Implementationه The implemented environment for the 3STV home gateway
includes: ى two laptops with one large size TV, and one personal digital assistant (PDA). ى 802.11b wireless LAN is used for the in-home wireless network. ى TCP is used for sending control messages such as the feedback of channel
condition.ى Real-time Transport Protocol over UDP is used for streaming video sequence.
![Page 22: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/22.jpg)
22
Experimental Results
ه Sample video sequences for three-screen TV
![Page 23: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/23.jpg)
23
Experimental Results
ه Overall bit rate gains
![Page 24: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/24.jpg)
24
Experimental Results
ه Performance of adaptive Raptor FEC and SVC layer-switching
![Page 25: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/25.jpg)
25
Experimental Results
ه Comparison of video quality by streaming methods (from left 3%, 5%, 10%, and 15% PLR condition).
![Page 26: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/26.jpg)
26
Experimental Results
ه Moving traces with mobile TV on building map
![Page 27: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/27.jpg)
27
Experimental Results
ه Reactions of the proposed method in real moving experimentation using implemented home gateway system
![Page 28: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/28.jpg)
28
Outline
ه Backgroundه Introductionه Proposed Methodه Experimental Resultsه Recent Researchه Conclusion
![Page 29: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/29.jpg)
29
Multilevel Diversity Coding via Rateless Codes for Reliable and Scalable Video Multicasting
IEEE Communications Letters, Vol. 17, No. 5, May 2013
Mohsen Sardari, Eun-Seok Ryu, Faramarz Fekri, and Nikil Jayant
![Page 30: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/30.jpg)
30
Multi-gateway Structure
ه Clients in different coverage regions can connect to a number of gateways (top).
ه Association of each client to more gateways result in higher quality (bottom).
![Page 31: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/31.jpg)
31
Multi-gateway Optimization
ه Benefit : reducing the load on the backbone network.
ه This paper formulates the problem as an optimization problem with the objective of minimizing the total bandwidth of the scalable video delivery.
![Page 32: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/32.jpg)
32
Multi-gateway Optimization
ه This paper first introduces an abstract model and describe the optimal solution for multi-gateway multicast of scalable content.
ه And demonstrates that traditional multicast, which requires all the gateways in the network fully deliver all the layers of a SVC content, is not optimal.
![Page 33: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/33.jpg)
33
Multi-gateway Optimization
ه Consider a source node S which provides scalable video with L layers l1, . . . , lL .
ه This paper optimize for the total output rate of the S such that connection to any Nα number of gateways should enable the client to successfully receive layers {l1, . . . , lα}.
![Page 34: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/34.jpg)
34
Multi-gateway Optimization
ه Consider the n-th gateway and let r1n , r2
n , . . . , rLn be the
rate of the layers 1 through L provided by S to the n-th gateway.
ه The total rate sent to n-th gateway :
![Page 35: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/35.jpg)
35
Multi-gateway Optimization
ه To successfully recover a layer α, the sum of the rates rα ≥ 0 received by a client from all the gateways should be lα.
ه Therefore, constraints on successful recovery of layers result in the following optimization problem :
![Page 36: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/36.jpg)
36
Multi-gateway Optimization
ه Thus, the dual problem of optimization with variables p1, . . . , pL, is
![Page 37: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/37.jpg)
37
Multi-gateway Optimization
ه The solution of the optimization problem :
![Page 38: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/38.jpg)
38
Multi-gateway Optimization
ه In [10], it is shown that given enough budget for storing a file in a distributed network, spreading of the budget maximizes the recovery probability for a collector with random access to a set of storage nodes.
[10] D. Leong, A. Dimakis, and T. Ho, “Distributed storage allocations,”IEEE Trans. Inf. Theory, vol. 58, no. 7, pp. 4733–4752, July 2012.
![Page 39: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/39.jpg)
39
Achieving the Optimal Solution with Rateless Coding
ه Source S should provide every gateway the whole of layer 1, and 1/i of the layer i.
ه The property of rateless coding provides the flexibility to encode data on the fly and proves to be useful in achieving the optimal solution.
![Page 40: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/40.jpg)
40
Comparison of the Optimal Solution with Simple Multicast
ه Gain of various layer growths
![Page 41: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/41.jpg)
41
Experimental Results
ه Performance evaluationه Overhead r = 12%
![Page 42: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC](https://reader036.vdocuments.us/reader036/viewer/2022062315/56816384550346895dd46b81/html5/thumbnails/42.jpg)
42
Conclusion
ه Adaptive SVC layer-switching selects appropriate layers to be sent according to ABW by RSSI-based feedback.
ه Raptor FEC overhead control method controls its overhead according to PLR.
ه The proposed method outperforms traditional methods and enhances video quality from 2dB to 5dB while simultaneously reducing bitrates from 28% to 36% .