sura/vide 2004 workshop using a grid of servers for distributing high quality video over ip networks...

Sura/Vide 2004 Workshop

Using a Grid of Servers for Using a Grid of Servers for Distributing High Quality Video Distributing High Quality Video

over IP Networksover IP Networks

March 2004

Digital Video Working Group – RNP - Brazil

Guido Lemos de Souza Filho, PhDDepartamento de InformáticaUniversidade Federal da Paraíba

OutlineOutline

GTVD context Server Grid Architecture Implementation Issues Initial Results Conclusion

GTVD ContextGTVD Context

Brazilian digital video working group main goals: Structure the Brazilian digital video community in a way

that promotes cooperation Set up a “Digital Video Network” over the RNP backbone

Computers, network resources, and software to provide a video distribution service

We have technical cooperation projects involving: Loci-University of Tennessee, Canal Saúde, Mast

(Astronomy Museum), Educational TV Networks, UFRN, UFPE, UFBA, UNIFACS, PUC-Rio, USP-SP, UFSC.

Telemedicine, Digital Television, Communication in Mixed Reality Environments

We are sponsored by RNP (Rede Nacional de Ensino e Pesquisa – National Research and Education Network)

Servers Grid ArchitectureServers Grid Architecture

AS AS

Client Client

IBP Server

CS CS

Client Client

Storage Layer

Access Layer

Coordination Layer

AS AS

IBP Server IBP Server IBP Server

Web clients find videos by accessing applications with Web clients find videos by accessing applications with relevant metadata and URLs...relevant metadata and URLs...

Video Distribution SchemVideo Distribution Schemee

RNPRNP Digital Video Working GroupDigital Video Working Group

Video AccessLayer

StorageLayer

Web ClientSearchEngine

Application

CoordinationLayer

The client activates the URL that is processed by the The client activates the URL that is processed by the coordination layer, which redirects the client to the coordination layer, which redirects the client to the nearest video servernearest video server......

Video Distribution SchemVideo Distribution Schemee

RNPRNP Digital Video Working GroupDigital Video Working Group

Video AccessLayer

StorageLayer

CoordinationLayer

Web ClientCoordination

Server

The URL used in the redirection includes the video identifier The URL used in the redirection includes the video identifier and a route to the server with a persistent copy of the and a route to the server with a persistent copy of the videovideo......

Video Distribution SchemVideo Distribution Schemee

RNPRNP Digital Video Working GroupDigital Video Working Group

Video AccessLayer

StorageLayer

CoordinationLayer

Web Client

Video Access Server

Video Access Server

Video Access Server

The last video access server in the chain interacts with the IBP The last video access server in the chain interacts with the IBP network to recover the stored video. The data stream then flows network to recover the stored video. The data stream then flows through the chain of access servers and is stored in each server´s through the chain of access servers and is stored in each server´s cache while being playedcache while being playedby the clientby the client......

Video Distribution SchemaVideo Distribution Schema

RNPRNP Digital Video Working GroupDigital Video Working Group

Video AccessLayer

StorageLayer

coordinationLayer

Video Access Server

IBP

IBP

IBP

Implementation Issues - Implementation Issues - Video ServersVideo Servers

UDP

Controller

RTSP/RTP

HTTP

Cache

IBP

File

UDP

HTTP

Source Target

RTSP/RTP

OthersOthers

Implementation Issues – Implementation Issues – Source ComponentSource Component

File

- RootDir

Cache

- TableOfSources- Cache

RealTimeStreaming

- Buffer

CacheSource<<interface>>

+ ReadBlock()

Cache_t

- Blocks: list<Bock>

+ addBlock()+ readBlock()- remBlock()

UDPSource

- ListOfSources

HTTPSource

- ListOfSources

Source<<interface>>

TableOfParameters

+ Open()+ Read()+ Seek()+ Close()+ GetParameter()+ SetParameter()Disk

Device

HTTP

UDP

IBPIBP

- xmlData

RNPRNP Digital Video NetworkDigital Video Network

DV-Net:DV-Net: DV-Net:DV-Net:

Storage Servers (2) Video Access Servers (7)

Link Bandwidth

CE RJ CE SP RN RJ RN SP PB RJ PB SP PE RJ PE SP DF RJ DF SP SC RJ SC SP RS RJ RS SP

6 MBps4 MBps4 MBps4 MBps2 MBps2 MBps8 MBps5 MBps

22 MBps20 MBps24 MBps12 MBps25 MBps15 MBps

Initial ResultsInitial Results

min med max min med maxBrasília 5.202 0.001s 0.292s 0.861s 6Mbps 55Mbps 102Mbps

Paraíba 4.120 1,79s 20,44s 551,9s 60bps 21Kpbs 57Kbps

Santa

Catarina

13.859 0,213s 2,136s 1047,7s 100bps 104Kbps 618Kbps

Rio de

Janeiro

38.695 0,188s 1,948s 12,189s 680bps 156Kbps 1Mbps

São Paulo 367.338 0,056s 0,085s 3,942s 1Kbps 1,5Mbps 1,8Mbps

Server Sample Delay Throughput

ConclusionConclusion

We have implemented and tested a nation-wide video distribution service

The initial results have shown that the service is able to provide high-quality video, in spite of the low- speed network used

On-going ActivitiesOn-going Activities

Integration with IBP network of storage servers

Integration of real time (already implemented) and VoD servers

Implementation of a scheduler application in order to organize the use and configuration of the backbone

Sura/Vide 2004 Workshop

Using a Grid of Servers for Using a Grid of Servers for Distributing High Quality Video Distributing High Quality Video

over IP Networksover IP Networks

March 2004

Digital Video Working Group – RNP - Brazil

Guido Lemos de Souza Filho, PhDDepartamento de InformáticaUniversidade Federal da Paraíba