medialab

Future Television Production – Proof of Concept

PISA - Production, Indexing and Search of Audiovisual Material

2medialab

PISA - Positioning

VRT-Medialab (medialab.vrt.be) - technical R&D

IBBT (www.ibbt.be) – Interdisciplinary Research Institute

PISA – Research Project on Production and Indexing of Audiovisual Media 30 Man-year Video Search Technology Unsupervised Feature Extraction Computer Assisted Manufacturing

3medialab

Digital Media Production

Production Platform

Suprastructure – Metadata Mgnt

Production and distribution

Infrastructure - Networks and Storage

Ingest

Media Asset Mgnt

Editing

Playout

Mastering

FC-AL loops(disk connection

network)

Harddisk

Client(local file system

+ I/O stack)

IP network(SUPERNET II)

GPFSFile systemCluster node

FC network(SAN)

Storagecontroller(DS4500)

4medialab

Digital Media Production

Production Platform

Suprastructure – Metadata Mgnt

Production and distribution

Infrastructure - Networks and Storage

Production and distribution

Ingest

Media Asset Mgnt

Editing

Playout

Mastering

5medialab

Product Engineering

Production Platform

Suprastructure – Metadata Mgnt

Infrastructure - Networks and Storage

Production and distribution

6medialab

Production Platform

D a t a G e n e r a l

D a t a G e n e r a l

D a t a G e n e r a l

D a t a G e n e r a l

D a t a G e n e r a l

D a t a G e n e r a l

MetaData

MetaData

Communication(Information)

Suprastructure – Metadata Mgnt

Infrastructure - Networks and Storage

Production and distribution

D a t a G e n e r a l

Data

Broadcast via DVB, DSL or Cable

Video Audio

Distribution Platform

Digital Media Distribution

medialab

Digital Asset Management, Content Management…

The NEXTMAM SYSTEM

8medialab

9medialab

User Expectations

“Configurable” Content Scalable content served by multiple distribution channels Hybrid formats complementary using multiple distribution channels Value added applications (EPG, Favorites, MyChannel,…) relie on

various metadata sources Online offering is characterised by personalisation

10medialab

medialab

11

Future television Production – Solution Space

Assessements Concurrent Engineering (Collaborative production) increases productivity Modular production apparatus enables a configurable product A Digital Supply Chain Manager should ensure overall consistency and performance Individual Media Asset Management systems don’t match this requirement Ad hoc plumbing (“best of breed”) compromises stability and quality of the product

Supply Chain Engine

More, better and structured metadata will enable an evolution from bare application integration to information integration and supply chain

optimisation.

medialab

12

SOA - Some Overstretched Assumptions

Supply Chain Engine

More, better and structured metadata will enable an evolution from bare application integration to information integration and supply chain

optimisation.

An SOA may “provide the ability to manage the complexity” but it usually increases it; It is not true that an “ESB should replace all application specific interfaces by an general

purpose abstract interface”. It should implement some major interfaces without further custom development (NewsML-G2, TVAnytime, Mpeg7,…);

It is assumed that “the SOA and the ESB simplify your service portfolio” (e.g. a single video transcoder), but this may lead to massive overconsumption of IT infrastructure(!);

A Service Oriented Architecture is only part of the solution: Stability and performance Intellectual Property Management Routing and resource scheduling …

13medialab

Use Cases - Logging, Disclosure, Annotation,…

archiefnummer : ALG 20010813 1fragmentnummer : 1 reeks : 1000 ZONNEN EN GARNALENbandnummer : E03024404formaat : DBCMfragmenttitel : 1000 ZONNEN & GARNALENbeeld : KL/PALPLUSfragmentduur : 18 20 tekst : 0'00" TOERISTISCH REPORTAGEMAGAZINE OVERZICHT ONDERWERPEN GENERIEK TOERISTISCH REPORTAGEMAGAZINE, OVERZICHT ONDERWERPEN 0'50" VANDAAG : KUNSTENAAR LUC HOFKENS ONTWIERP EEN OASE OP ZIJN DAKTERRAS IN BORGERHOUT DIE DOET DENKEN AAN DE GRAND CANYON INTERVIEW MET LUC EN ZIJN VROUW MARILOU BUITENBEELD DAK MET OMGEVING BUITENKANT ARBEIDERSWONING, PANO OVER ROTSWANDEN, KRATEN MET WATER, BEPANTING, FOTOALBUM MET VERLOOP WERKEN 4'00" JUNIOR : KLAARTJE ALAERTS, 13 JAAR WIL ASTRONAUTEN WORDEN ZE BEZOEKT HETEUROSPACE CENTER METRUIMTEVEREN, RAKETTEN SIMULATIE IN RUIMTEVEER, INTERVIEW, HEEFT EEN UFO GEZIEN MAAKT ZELF KLEIN RAKETJE, SCHIET HET AF 7'50" DE SCHEURKALENDER : ARCHIEF RECLAMEFILM IBM INTERVIEW MAURICE DE WILDE, EERSTE PERSOONLIJKECOMPUTER trefwoorden : BELGIE; BORGERHOUT; ARTIEST; OASE; KUNST; GRAND CANYON (NATUURGEBIED); DAK; TERRAS; INTERVIEW; EURO SPACE CENTER; RUIMTEVAART; PC; BOOTTOCHT; RIJKDOM; PASSAGIER; GASTRONOMIE; RESTAURANT; PERSONEEL; VAKANTIE; BINNENBEELD; SCHIP; BECKERS LEEN; VRT; LOTTO; RADIOOMROEPSTER; KLANKSTUDIO; UITVINDING; BARBECUE; BETONMOLEN; IBM; RECLAMESPOTrechthebbende : VRT

Opzoekscherm FILM Set: 16 Aantal: 1blz 1 van 3 trefwoorden: ibm and vrt archiefnummer: - uitzendjaar: maand: dag: fragmentnummer: fragmentduur: reeks: formaat: bandnummer: aflevering: afleveringsnummer: programma: uitzenddatum: fragmenttitel: tekst: kategorie: opnamedatum: opnamenummer: journalist: rechthebbende:

SETS The strings required for the operation are not defined

F11 F12 F13 F14 F17 F18 F19 F20 Ent Eindigen Sets Refset Toon Vorige Volg/Leeg Thesaurus Commando Opzoeken

15medialab

Shot Segmentation and Scene Recognition

16medialab

Computer Assisted Analysis

17medialab

Proof of Concept - Computer Assisted Annotation

18medialab

Proof of Concept - The Search Engine

19medialab

Future - From « Metadata » to CAD/CAM

?

medialab

Challenge – Human-Computer Interface

21medialab

Proof of Concept – Model Driven Development

Demo

http://www.youtube.com/watch?v=lx39IHUZyA4

22medialab

Conclusions

User Expectations The notion of a configurable product enables hybrid formats and personalisation These require concurrent engineering and(!) collaborative production Value added services for the consumer relie on more and better metadata as well

State-of-the-Art The lack of metadata understanding inhibits collaborative production MAM Systems as such are not scalable in terms of implementing new services « Best-of-breed » approach has lead to plumber’s architecture

• Conclusions• Collaborative production will be a process implemented by a distributed environment of equal

and collaborative components;• Next generation Media Asset Management will be based on information integration as

opposed to application integration and the result of consistent and sound system engineering;• While semantic technologies (web 3.0) may help to harvest unstructured information and to

process natural language-based sources, model-driven development and structured meta-data are a critical succes factor for successfully deploying Computer Integrated Manufacturing.

23medialab

http://medialab.vrt.be/pisa http://projects.ibbt.be/pisa maarten.verwaest@limecraft.com