1/16
Uncompressed 4K Live Streaming of 23rd Kyoto Prize Events from Kyoto to Stockholm
Daisuke ShiraiNTT Network Innovation Laboratories
Nippon Telegraph and Telephone [email protected]
Kunitake KanekoResearch Institute for Digital Media and Content
Keio [email protected]
2/16
Outline
What is 4K?
Kyoto Prize 4K Live Transmission
Technology details of 4K Video Stream Switching
3/16
4K images : with roughly 4000 horizontal and 2000 vertical pixels 3840x2160 (Quad HDTV), 4096x2160 (DCI Digital Cinema Standard), 3840x2400 (WQUXGA)
4K image can surpass the quality of 35-mm film
Instant Film
35mm film&
Digital Camera
3024
60mm filmLaser PrinterPrinting/Medicine
2000
1000
0
35mmMovie
HDTV1080p720p SDTV(480i)
HDTV(1080i)
Movie TV
Still Images Motion Pictures
0
3000
4K video with8M (3840x2160) pixels
(frame/sec.)
(vertical lines)
Temporal Resolution
Spat
ial R
esol
utio
n
Legacy Media
Introduction: Positioning of 4K Resolution Images
4/16
What is Kyoto Prize (京都賞)?
The Kyoto Prize, awarded annually since 1985, is an international award to honor those who have contributed significantly to the scientific, cultural, and spiritual betterment of mankind. The Prize is presented annually in each of the following three categories: Advanced Technology, Basic Sciences, and Arts and Philosophy. The Prize is managed by the Inamori Foundation founded in 1984 by Kazuo Inamori (now Chairman Emeritus of Kyocera Corporation).
2007 LaureatesFor the category of Advanced Technology, Dr. HirooInokuchi (age 80, Japan, Materials Science and Engineering).For the category of Basic Sciences, Dr. HirooKanamori (age 71, Japan, Earth and Planetary Sciences, Astronomy and Astrophysics).For the category of Arts and Philosophy, Ms. PinaBausch (age 67, Germany,Theater and Cinema).
5/16
The overview of Kyoto Prize 4K transmission (1/2)
4K uncompressed live streaming (6 Gbit/s)from Kyoto to Stockholm
Via 10Gbit Ethernet connections over 21,000kmwith switching b/w 2 cams in IP domainJ2K Recording at Stockholm for the further event in Karlsruhe(4k Internet Streaming)
4K compressed multicast live streaming (500 Mbit/s)from Kyoto to three different places in Japan, and to Stockholmmulticast realized by Flexcast technology
AcknowledgementThis project was supported by
GLIF (JGN2, Starlight, CESnet, IRNC, Netherlight, SURFnet, NORDUnet)Japanese Ministry of Internal Affairs and CommunicationsJapanese Ministry of Education, Culture, Sports, Science and Technology
10-11, Nov., 2007
6/16
The overview of Kyoto Prize 4K transmission (2/2)
The 23rd Kyoto Prize Events atKyoto Int’l Conference Center (Kyoto)
4K Camera (Olympus)4K uncompressedstreaming server
Close-up shot
Wide shot
Terminal PCRemote switching control signals
The Royal Institute of Technology, KTH(Stockholm)
streaming receiverImage switchingon network
4K JPEG 2000Codec
NTT Lab. (Yokosuka)
Keio Univ. (Tokyo)
Stream duplicatorw/ Flexcast technology
Tohoku Univ. (Sendai)
6 Gbit/s
500 Mbit/s
storage
9/16
Why Uncompressed Streaming?
uncompressed image is indispensable Highest Quality: Essential for video editing and production
For SD, HD, even when 4KLow Latency: minimize codec delay
For bi-directional communication
6 Gbit/s
Carrying disks Carrying using network
3TB / hour
10/16
Based on HD-SDI over IP transmission system (i-Visto)
Uncompressed 4K Video Transmission System (1/2)
10Gbps Ethernet
HDSDI in/out board (2)
HDSDI in/out board (1)
Sync Control Ethernet
outoutthroughthrough--outout
ininrefref--inin
Uncompressed 4K video transmission system
11/16
4x HD-SDI over IP (HD-SDI transparent)4x UDP streams over IPJumbo frame(9000B)Streaming controlled by terminal PCFrame sync over EthernetFour output HD-SDI signals are synchronized by a master signal
Uncompressed 4K Video Transmission System (2/2)
UDP(1.5Gbps)UDP(1.5Gbps)
UDP(1.5Gbps)UDP(1.5Gbps)
frame sync frame syncHD-SDI
signal sync
sync master
10G Ethernet4Kimage
4x HD-SDI
12/16
4K Video Stream Switching Concept
Achieving 6 Gbit/s uncompressed 4K video stream switching on a 10 Gbit/s shared line
Location A
Location C
10G NW
10G NW
10G NW
HD-SDI signal switcher
Video switching
Conventional Configuration
Sender side Receiver side
6Gbps
6Gbps
6Gbps
4K Server 4K Receiver
Location B
10G NW
Video switching(by stopping/starting stream)
10GbE SW
Target Configuration
6Gbps
6Gbps
4K Server
4K Receiver
Reducing the cost for a networkReducing the cost for a networkProviding a network with scalabilityProviding a network with scalability
Location A
Location C
Location B
Sender side
Receiver side
13/16
Issue : Momentary bandwidth overflow by overlapping two streams
Due to phase difference of two video sources, jitter of the network and processing time
Server A
Server B10GbE SW
6Gbps
Request to start
Request to stop
Time
Bit rate BandwidthTotal bit rate
Stream A Stream B
Bandwidth overflowBandwidth overflow
OverflowingOverflowing
Approach: Preventing bandwidth overflow with stream crossfading
Difficulties in 4K Video Stream Switching
14/16
Gradually changing the sending bit rate when stopping/starting stream
When stopping the video stream, the server decrease the sending bit rate frame by frame, and vice versa.The receiver needs buffers for each stream
Approach: Stream Crossfading
Server A
Server BL2 switch
Time
Bit rate
Video Stream A
ETA2 frames
Time
Bit rate
STB 2 frames
Video Stream B
STB
ETA
Time
Bit rate
2 frames
Total bit rate
Streaming fade-out
Streaming fade-in
Video Stream A
Video Stream B
corresponding to the last frame
corresponding to the first frame
Playing Stream A
Playing Stream B
buffered
15/16
Results (with maximum video phase difference)
Where the period of crossfading is N frames, the maximum increase in the total bit rate is 1 / (N+1) of the bit rate of one video stream
The result shows the total bit rate was held to 8.6 Gbit/s(133% of the bit rate of one video stream), where the crossfading period is 2 frames
0
2
4
6
8
10
1.34 1.36 1.38 1.4 1.42 1.44 1.46 1.48
time(sec)
bit r
ate(
Gbi
t/s)
0
2
4
6
8
10
3.98 4 4.02 4.04 4.06 4.08 4.1 4.12
time(sec)
bit r
ate(
Gbi
t/s)
Switching stream A to stream B Total
Stream B
Stream A
Stream A
Stream B
Total
Switching stream B to stream A
6.4 Gbit/s
8.6 Gbit/s