Sura/Vide 2004 Workshop
Using a Grid of Servers for Using a Grid of Servers for Distributing High Quality Video Distributing High Quality Video
over IP Networksover IP Networks
March 2004
Digital Video Working Group – RNP - Brazil
Guido Lemos de Souza Filho, PhDDepartamento de InformáticaUniversidade Federal da Paraíba
OutlineOutline
GTVD context Server Grid Architecture Implementation Issues Initial Results Conclusion
GTVD ContextGTVD Context
Brazilian digital video working group main goals: Structure the Brazilian digital video community in a way
that promotes cooperation Set up a “Digital Video Network” over the RNP backbone
Computers, network resources, and software to provide a video distribution service
We have technical cooperation projects involving: Loci-University of Tennessee, Canal Saúde, Mast
(Astronomy Museum), Educational TV Networks, UFRN, UFPE, UFBA, UNIFACS, PUC-Rio, USP-SP, UFSC.
Telemedicine, Digital Television, Communication in Mixed Reality Environments
We are sponsored by RNP (Rede Nacional de Ensino e Pesquisa – National Research and Education Network)
Servers Grid ArchitectureServers Grid Architecture
AS AS
Client Client
IBP Server
CS CS
Client Client
Storage Layer
Access Layer
Coordination Layer
AS AS
IBP Server IBP Server IBP Server
Web clients find videos by accessing applications with Web clients find videos by accessing applications with relevant metadata and URLs...relevant metadata and URLs...
Video Distribution SchemVideo Distribution Schemee
RNPRNP Digital Video Working GroupDigital Video Working Group
Video AccessLayer
StorageLayer
Web ClientSearchEngine
Application
CoordinationLayer
The client activates the URL that is processed by the The client activates the URL that is processed by the coordination layer, which redirects the client to the coordination layer, which redirects the client to the nearest video servernearest video server......
Video Distribution SchemVideo Distribution Schemee
RNPRNP Digital Video Working GroupDigital Video Working Group
Video AccessLayer
StorageLayer
CoordinationLayer
Web ClientCoordination
Server
The URL used in the redirection includes the video identifier The URL used in the redirection includes the video identifier and a route to the server with a persistent copy of the and a route to the server with a persistent copy of the videovideo......
Video Distribution SchemVideo Distribution Schemee
RNPRNP Digital Video Working GroupDigital Video Working Group
Video AccessLayer
StorageLayer
CoordinationLayer
Web Client
Video Access Server
Video Access Server
Video Access Server
The last video access server in the chain interacts with the IBP The last video access server in the chain interacts with the IBP network to recover the stored video. The data stream then flows network to recover the stored video. The data stream then flows through the chain of access servers and is stored in each server´s through the chain of access servers and is stored in each server´s cache while being playedcache while being playedby the clientby the client......
Video Distribution SchemaVideo Distribution Schema
RNPRNP Digital Video Working GroupDigital Video Working Group
Video AccessLayer
StorageLayer
coordinationLayer
Video Access Server
IBP
IBP
IBP
Implementation Issues - Implementation Issues - Video ServersVideo Servers
UDP
Controller
RTSP/RTP
HTTP
Cache
IBP
File
UDP
HTTP
Source Target
RTSP/RTP
OthersOthers
Implementation Issues – Implementation Issues – Source ComponentSource Component
File
- RootDir
Cache
- TableOfSources- Cache
RealTimeStreaming
- Buffer
CacheSource<<interface>>
+ ReadBlock()
Cache_t
- Blocks: list<Bock>
+ addBlock()+ readBlock()- remBlock()
UDPSource
- ListOfSources
HTTPSource
- ListOfSources
Source<<interface>>
TableOfParameters
+ Open()+ Read()+ Seek()+ Close()+ GetParameter()+ SetParameter()Disk
Device
HTTP
UDP
IBPIBP
- xmlData
RNPRNP Digital Video NetworkDigital Video Network
DV-Net:DV-Net: DV-Net:DV-Net:
Storage Servers (2) Video Access Servers (7)
Link Bandwidth
CE RJ CE SP RN RJ RN SP PB RJ PB SP PE RJ PE SP DF RJ DF SP SC RJ SC SP RS RJ RS SP
6 MBps4 MBps4 MBps4 MBps2 MBps2 MBps8 MBps5 MBps
22 MBps20 MBps24 MBps12 MBps25 MBps15 MBps
Initial ResultsInitial Results
min med max min med maxBrasília 5.202 0.001s 0.292s 0.861s 6Mbps 55Mbps 102Mbps
Paraíba 4.120 1,79s 20,44s 551,9s 60bps 21Kpbs 57Kbps
Santa
Catarina
13.859 0,213s 2,136s 1047,7s 100bps 104Kbps 618Kbps
Rio de
Janeiro
38.695 0,188s 1,948s 12,189s 680bps 156Kbps 1Mbps
São Paulo 367.338 0,056s 0,085s 3,942s 1Kbps 1,5Mbps 1,8Mbps
Server Sample Delay Throughput
ConclusionConclusion
We have implemented and tested a nation-wide video distribution service
The initial results have shown that the service is able to provide high-quality video, in spite of the low- speed network used
On-going ActivitiesOn-going Activities
Integration with IBP network of storage servers
Integration of real time (already implemented) and VoD servers
Implementation of a scheduler application in order to organize the use and configuration of the backbone
Sura/Vide 2004 Workshop
Using a Grid of Servers for Using a Grid of Servers for Distributing High Quality Video Distributing High Quality Video
over IP Networksover IP Networks
March 2004
Digital Video Working Group – RNP - Brazil
Guido Lemos de Souza Filho, PhDDepartamento de InformáticaUniversidade Federal da Paraíba