Digital Video Research at LAVID – CI - UFPB

MsC. Lucenildo Aquino Júnior(LAVID/CI/UFPB)

A – Campus I

B – Campus Linaldo Cavalcanti

Where we are...

João Pessoa - PB

Who we are...

• 15 Researchers

• 20 Graduate

• 60 Undergraduate

– Ciência da Computação

– Engenharia da Computação

– Matemática Computacional

– Comunicação

– Mídias Digitais

– Artes

– Direito

Lavid History Highlights

• Started in 1997 working on the high speed metropolitan area project for CNPq and RNP– Development of live and VoD MPEG-2 servers

• Deployment of the RNP Digital Video Network (2000)– At least one server per RNP PoP in Brazil

• Design and implementation of Ginga, the Brazilian middleware for digital television, in collaboration with PUC-Rio– Ginga is now used in SBTVD, ITU-T, ITU-R, ISDB-T

standards, was adopted by 10 Latin American countries and is standard candidate in African countries

Digital Video Current Activities

• Digital Television– Ginga certification tools– Advanced interactive applications

• Multidevice, second screen etc.

• Digital Cinema– Understanding the systems and developing technology

• Connected Theaters– Developing technology– Supporting collaborative distributed performances

• Telemedicine – Developing technology– Supporting collaborative distributed performances

What is cloud computing ?

• What is cloud computing ? [Vaquero et al. 2009]

- "Cloud computing is a set of virtual resources

easily usable and accessible such as hardware,

development platforms and services. these

Resources can be dynamically re-configured

to adjust to a variable load, allowing

optimizing the use of resources. This set of

resources is typically operated by a

model pay-per-use with guarantees offered by

provider through service level agreements

(Service Level Agreements, SLAs). "

Digital Cinema Current Activities

• Advanced Visualization Working Group (RNP)– LAVID-UFPB budget in this project was R$ 150K

(US$ 85K) for equipment and human resources

• The project started in April/2011– Computers and graphic cards arrived at

August/2011

• So, we faced a lot of huge problems in the development and test of a 4K-3D video system that we call “Fogo”

The First Problem

• As the equipments were not at the lab when we started the project, the first problem we faced was:

How to store a 3.2 TB video file without having 3.2 TB available in one computer in the lab?

• What we did? We used a “JitCloud” (just in time cloud) to store the “sliced video”

– JitCloud uses amortized resources, that is, resources bought and used for different purposes, such as, other lab projects

Video SlicerRaw Video

Source

Video Archiving in the JitCloud

Storage CloudPre-processing

The 3.2 TB of the movie were sliced and stored in the Jitcloud

The Second Problem

• As we did not had budged to by a 4K 3D video encoder, the second problem was:

How to encode a 4K 3D video file without a suitable encoder?

• What we did? We used again the “JitCloud” (just in time cloud)

Video Encoding in the JitCloud

Storage Cloud Processing Cloud

H.264

WMV

JPEG 2000H.264

Encoding of video files in the Jitcloud

The Third Problem

• As we did not had budged to by a 4K 3D video player, the third problem was:

How to play a 4K 3D video file without an appropriate player?

• Again we used the “JitCloud” (just in time cloud) combined with a previous LAVID research result

– In 2000 we developed one HD encoder using four SD encoders.

Playing from the JitCloud

Cloud Storage

Player

Player

Player

Player

Player

Scen

ario

1 –

Sin

gle

Pla

yer

Scen

ario

2–

Mu

ltip

le P

laye

rs

The Solution

FOGO Player– The system composed by a:

• Slicer component

• Distribution component

• Distributed Streamer component

• Distributed Player component

– It is based on a triple software synchronization strategy• Network sync

• Decoder sync

• Exhibition sync

Questions that still open…

• It is possible to encode one video using encoders in different equipments with different clock references?

• It is possible to synchronize the transmission, decoding and exhibition of one video using only software based mechanisms?

• Lets see what we did in the first eight months of our research…

– We will play a sample of “StereoEssays” from “Joao Pessoa – Brazil” using Fogo Player.

Next steps

Development

Testing

Deployment

Phase I

• Enhance the developmentinfrastructure

• Setup at least 3 advancedvisualization centers withstate of the art equipment(camera, projectors, storage,network and humanresources)

• Find industrial partners

Next steps

Development

Testing

Deployment

Phase II

• Setup a network ofuniversity cinemas in Brazil(2K, 2K-3D, 4K, 4K-3D andbeyond)

• Support the definition of aBrazilian Digital CinemaSystem

Next steps

Development

Testing

Deployment

Phase III

• At least one cinema per city inBrazil

• We have more then 4800 citieswithout cinemas in Brazil

Next steps

Development

Testing

Deployment

Connected Cinemas

• Content storage and distribution using ICD

– Media assets management

– Interchange platform

– Based on open technologies

ICD Nodes

ABTU (4)

TV Escola (3)

TV Brasil (7)

SECOM/PR (1)

Rede IFES (8)

RUTE (2)

Who uses ICD• EBC São Paulo• EBC Brasília• EBC Rio de Janeiro• EBC São Luis• IRDEB - Instituto de Rádio Difusão Educativa da Bahia• FUNTELPA – Fundação de Telecomunicações do Pará• Radioagência Nacional • Rádio Nacional AM Brasília • Rádio Nacional FM Brasília • Rádio Nacional AM Rio de Janeiro • Rádio MEC AM • Rádio MEC FM • Rádio Nacional do Alto Solimões • Rádio Nacional AM Amazônia• UFG – Universidade Federal de Goiás• UFMG - Universidade Federal de Minas Gerais• UFPR - Universidade Federal do Paraná• UFRGS - Universidade Federal do Rio Grande do Sul• UFRN - Universidade Federal do Rio Grande do Norte• UFU - Universidade Federal de Uberlândia• UFSCAR - Universidade Federal de São Carlos• UNICAMP – Universidade de Campinas• DOCTUM – Rede de Ensino • UNIMEP - Universidade Metodista de Piracicaba• PUC-RJ – Pontifícia Universidade Católica do RJ• USP – Universidade de São Paulo• Rede Universitaria de Telemedicina• Associação Brasileira de Televisão Universitária• Secretaria de Comunicações da Presidência da República• Cinemateca Brasileira – Banco de Conteúdos Culturais

23

Parc

eiro

Cinemateca Brasileira

24

Connected Theaters

ExecutionTestCreation

ExecutionTestCreation

ExecutionTestCreation

People

Theaters

Network

e-Pormundos Afeto (piloto)

Profanações

Interactive Digital Cinema

• Acessibility

• Ginga

Conclusions

• Cinema– Low cost is very important for us in Brazil because we

have 4800 cities without a cinema in our country

– So, Try to find the right tradeoff between quality and cost, considering the context of small and medium cities, is the main goal of our research

• Television– Multi device integration is the way

– Next year 75% of the TV receiver will embed Ginga

• Theaters– Connected for supporting live, collaborative and

distributed performances

Contact

• Lucenildo – lucenildo@lavid.ufpb.br

• Lavid: http://www.lavid.ufpb.br/en