bridging the gap between web and television

BRIDGING THE GAP BETWEEN WEB AND TELEVISION

MARIUS PREDA, MPEG 3DG CHAIR, INSTITUT MINES TELECOM, FRANCE

www.slideshare.net/MariusPreda

SMART TV GLOBAL SUMMIT 2015

SEOUL

Then why the Web - the world of words- is becoming more

successful than the Television - the world of videos ?

What are the Web key-concepts that can be adapted to the

Television?

Is the Television only a follower or it may become a leader?

This talk is also about rivers and lands

Almost all the big cities are built on riverbanks

The reason is simple: access to water

OK…, however this is not a talk about geography or hydrology, but it is about

technology

You probably figured out that our river today is the …

… TELEVISION

Same as the rivers in the old time, television attracted the masses (and

still attracts)

But also as for the rivers, when “water” became available in the fields, people

migrate to larger spaces

… our river is the TELEVISION

… but the large fields around are the WEB

TV vs WEB, we are actually comparing a line with connected dots!

Which one is better covering the region?

Of course, today TV and Web co-exist

but TV becomes more and more invisible

TV strategies to become more visible

Increase the number of channels

TV strategies to become more visible

Create “thematic” channels

TV strategies to become more visible

Play with the “temporal” aspects: VoD, TimeShift

TV strategies to become more visible

Television already starts to “dotify” itself

TV strategies to become more visible

The 1st lesson: the space near the river is limited, space in the lands is (almost) infinite

TV strategies to become more visible

The 1st Web lesson revisited: the important is the content and not how it is distributed

Still, there are differences

The missing links …

Connecting pixels

From letters to pixels

Classic Book: the value is in the content as a whole

From letters to pixels

On the Web: the value is in the content and in the link

From letters to pixels

Any word is now an entry in the online world: the words are connected mainly because of the search engines

Connecting pixels

Appling the successful stories of textual information to the visual space

From letters to pixels

Classic video content: the value is in the content as a whole

From letters to pixels

Video linked content

From letters to pixels

+ + … =

From a link to a set of links and to the 3D reconstruction of objects and scenes

MPEG offer for connecting pixels

Technology Time Line

MPEG CDVS

State of the art technology for providing links between images

The 2nd Web lesson: the value of the link is at least as important as the value of the content

Still, there are differences

Ok, we have links. And now what?- Able to search, find content and consume it in the traditional linear way …

Still, there are differences

Personalized user experience

The notion of bridget

A bridget is a link from the program being watched to (combinations of) external interactive media elements such as web pages, images,

audio clips, different types of video (2D, multi-view, 3D free viewpoint) and synthetic 3D models

Palazzo vecchio in Florence

is one of the most famous

Monuments. It was built in 1299

Time synchronisation

Main TV screen

Personalized and interactive, synchronized content

Second Screen “Application” is not a new idea, then how the Web can

inspire us here?

Who is able to create the “dots”?

Anyone!

Who is able to create the second screen applications?

Developers

MPEG offer for personalized companion screen experience

The 3rd Web lesson: the creativity may come from anywhere

MPEG MLAF – Multimedia Linking Application Format

MPEG vision on Linking Format

MPEG-4 + MPEG-7 + MPEG-21 ++ MPEG-U+ MPEG-V

= MLAF MPEG Player

CompressionAuthoring Tool

Produce

Download

Making Second Screen Sustainable in Media Production: the BRIDGET Approach

• The Authoring Environment– Using visual technologies to reduce the production time

of rich multi-media and multi-screen content

• User Experience and the BRIDGET Player– Interactive second screen content synchronized with the

main screen

• Enabling Technologies– Visual Search– 3D A/V reconstruction– Media Structure Analysis

The Authoring Tool

The Player

Native support for MPEG-4 BIFS

HTML 5 is also supported

Making Second Screen Sustainable in Media Production: the BRIDGET Approach

MPEG MLAF – Multimedia Linking Application Format

The 4th Web lesson: there is a big variety of the users’ profiles, they should be served differently

OK for the lessons from the Web but is the Television able to

bring a new dimension?

From centuries, we are building two different types of worlds

PhysicalInformational

Immersion, from a human user point of view, is making abstraction of the Physical world (remove all possible connection to it) and have stimuli only from the Informational one

Immersion, presence, stimuli, perception, …

stories

music

films

knowledge

In which world our users are?

The stimuli from physical worlds are familiar or at very low intensities

We intentionally block our interfaces with the physical world

Improving immersion feeling

Strategies for blocking the interfaces with the Physical world

Improving immersion feeling

Strategies for extending the space of the Informational world stimuli

Improving immersion feeling

Television is expected to build multi-sensory experiences

MPEG offer for multi-sensory experiences

MPEG technologies related to multi-sensory experiences

MPEG-V - Media Context and Control

2011

• 2nd Edition: - GPS - Biosensors - 3D Camera

2014

• Compression of video + depth

2015

MPEG-V

- 3D Video

• 1st Edition - Sensors and actuators - Interoperability between Virtual Worlds

MPEG-U – Advanced User Interface

2012

A rich set of sensors and actuators

- 3D Audio

MPEG-H

2016

MPEG-V• 3rd Edition: - 4D theater - various camera sensor types

MPEG-V – Media Context and Control

MPEG technologies related to multi-sensory experiences

ActuatorsLight Flash Heating Cooling Wind Vibration Sprayer Scent Fog Color correction Initialize color correction parameter Rigid body motion Tactile Kinesthetic

Global position command

SensorsLight Ambient noise Temperature Humidity Distance Atmospheric pressure Position Velocity Acceleration Orientation Angular velocity Angular acceleration Force Torque Pressure Motion Intelligent camera typeMulti Interaction point Gaze tracking Wind

Dust Body height Body weight Body temperature Body fat Blood type Blood pressure Blood sugar Blood oxygen Heart rate

Electrograph EEG , ECG, EMG, EOG , GSR Weather Facial expression Facial morphology Facial expression characteristics Geomagnetic

Global position Altitude Bend Gas

MPEG technologies related to multi-sensory experiences

MPEG-V – Media Context and Control

Conclusions

• Web development should be an inspiration for the Television development– Anyone should be able to become a source– Anyone should be able to link content to another

content– The user profile fragmentation is much higher that

television is considering it today• However, the Television has its own mission

– The multi-sensory experience