bridging the gap between web and television

Download Bridging the gap between web and television

Post on 10-Feb-2017

521 views

Category:

Engineering

3 download

Embed Size (px)

TRANSCRIPT

bridging

Bridging the gap between web and television

Marius Preda, MPEG 3DG CHAIR, Institut Mines telecom, France

www.slideshare.net/MariusPreda

Smart TV Global Summit 2015

Seoul

Then why the Web - the world of words- is becoming more successful than the Television - the world of videos ?

What are the Web key-concepts that can be adapted to the Television?

Is the Television only a follower or it may become a leader?

This talk is also about rivers and lands

Almost all the big cities are built on riverbanks

The reason is simple: access to water

OK, however this is not a talk about geography or hydrology, but it is about technology

You probably figured out that our river today is the TELEVISION

Same as the rivers in the old time, television attracted the masses (and still attracts)

But also as for the rivers, when water became available in the fields, people migrate to larger spaces

our river is the TELEVISION but the large fields around are the WEB

TV vs WEB, we are actually comparing a line with connected dots!

Which one is better covering the region?

Of course, today TV and Web co-exist

but TV becomes more and more invisible

TV strategies to become more visible

Increase the number of channels

TV strategies to become more visible

Create thematic channels

TV strategies to become more visible

Play with the temporal aspects: VoD, TimeShift

TV strategies to become more visibleTelevision already starts to dotify itself

TV strategies to become more visibleThe 1st lesson: the space near the river is limited, space in the lands is (almost) infinite

TV strategies to become more visibleThe 1st Web lesson revisited: the important is the content and not how it is distributed

Still, there are differencesThe missing links

Connecting pixels

From letters to pixels

Classic Book: the value is in the content as a whole

From letters to pixelsOn the Web: the value is in the content and in the link

From letters to pixelsAny word is now an entry in the online world: the words are connected mainly because of the search engines

Connecting pixelsAppling the successful stories of textual information to the visual space

From letters to pixelsClassic video content: the value is in the content as a whole

From letters to pixelsVideo linked content

From letters to pixels

++ =

From a link to a set of links and to the 3D reconstruction of objects and scenes

MPEG offer for connecting pixels

Technology Time Line

MPEG CDVS

State of the art technology for providing links between images

The 2nd Web lesson: the value of the link is at least as important as the value of the content

Still, there are differencesOk, we have links. And now what?

- Able to search, find content and consume it in the traditional linear way

Still, there are differencesPersonalized user experience

The notion of bridgetA bridget is a link from the program being watched to (combinations of) external interactive media elements such as web pages, images, audio clips, different types of video (2D, multi-view, 3D free viewpoint) and synthetic 3D models

Palazzo vecchio in Florence is one of the most famous Monuments. It was built in 1299 Time synchronisation

Main TV screenPersonalized and interactive, synchronized content

Second Screen Application is not a new idea, then how the Web can inspire us here?

39

Who is able to create the dots?Anyone!

40

Who is able to create the second screen applications?Developers

41

MPEG offer for personalized companion screen experience

The 3rd Web lesson: the creativity may come from anywhere

MPEG MLAF Multimedia Linking Application Format

MPEG vision on Linking Format

MPEG-4 + MPEG-7 + MPEG-21 ++ MPEG-U+ MPEG-V= MLAF

MPEG Player

CompressionAuthoring ToolProduce

Download

Making Second Screen Sustainable in Media Production: the BRIDGET ApproachThe Authoring EnvironmentUsing visual technologies to reduce the production time of rich multi-media and multi-screen content

User Experience and the BRIDGET PlayerInteractive second screen content synchronized with the main screen

Enabling TechnologiesVisual Search3D A/V reconstructionMedia Structure Analysis

45

The Authoring Tool

The Player

Native support for MPEG-4 BIFSHTML 5 is also supported

Making Second Screen Sustainable in Media Production: the BRIDGET Approach

MPEG MLAF Multimedia Linking Application Format

The 4th Web lesson: there is a big variety of the users profiles, they should be served differently

OK for the lessons from the Web but is the Television able to bring a new dimension?

From centuries, we are building two different types of worlds

PhysicalInformationalImmersion, from a human user point of view, is making abstraction of the Physical world (remove all possible connection to it) and have stimuli only from the Informational one

Immersion, presence, stimuli, perception,

storiesmusicfilmsknowledge

In which world our users are?

The stimuli from physical worlds are familiar or at very low intensities

We intentionally block our interfaces with the physical world Improving immersion feeling

Strategies for blocking the interfaces with the Physical world Improving immersion feeling

Strategies for extending the space of the Informational world stimuli

Improving immersion feeling

Television is expected to build multi-sensory experiences

MPEG offer for multi-sensory experiences

MPEG technologies related to multi-sensory experiencesMPEG-V - Media Context and Control

2011 2nd Edition: - GPS - Biosensors - 3D Camera

2014 Compression of video + depth

2015MPEG-V- 3D Video 1st Edition - Sensors and actuators - Interoperability between Virtual Worlds

MPEG-U Advanced User Interface

2012

A rich set of sensors and actuators- 3D AudioMPEG-H2016MPEG-V 3rd Edition: - 4D theater - various camera sensor types

58

MPEG-V Media Context and ControlMPEG technologies related to multi-sensory experiences

ActuatorsLight Flash Heating Cooling Wind Vibration Sprayer Scent Fog Color correction Initialize color correction parameter Rigid body motion Tactile Kinesthetic Global position command

SensorsLight Ambient noise Temperature Humidity Distance Atmospheric pressure Position Velocity Acceleration Orientation Angular velocity Angular acceleration Force Torque Pressure Motion Intelligent camera typeMulti Interaction point Gaze tracking Wind Dust Body height Body weight Body temperature Body fat Blood type Blood pressure Blood sugar Blood oxygen Heart rate Electrograph EEG , ECG, EMG, EOG , GSR Weather Facial expression Facial morphology Facial expression characteristics Geomagnetic Global position Altitude Bend Gas

MPEG technologies related to multi-sensory experiencesMPEG-V Media Context and Control

ConclusionsWeb development should be an inspiration for the Television developmentAnyone should be able to become a sourceAnyone should be able to link content to another contentThe user profile fragmentation is much higher that television is considering it todayHowever, the Television has its own missionThe multi-sensory experience