bridging the gap between web and television
TRANSCRIPT
BRIDGING THE GAP BETWEEN WEB AND TELEVISION
MARIUS PREDA, MPEG 3DG CHAIR, INSTITUT MINES TELECOM, FRANCE
www.slideshare.net/MariusPreda
SMART TV GLOBAL SUMMIT 2015
SEOUL
Then why the Web - the world of words- is becoming more
successful than the Television - the world of videos ?
What are the Web key-concepts that can be adapted to the
Television?
Is the Television only a follower or it may become a leader?
This talk is also about rivers and lands
Almost all the big cities are built on riverbanks
The reason is simple: access to water
OK…, however this is not a talk about geography or hydrology, but it is about
technology
You probably figured out that our river today is the …
… TELEVISION
Same as the rivers in the old time, television attracted the masses (and
still attracts)
But also as for the rivers, when “water” became available in the fields, people
migrate to larger spaces
… our river is the TELEVISION
… but the large fields around are the WEB
TV vs WEB, we are actually comparing a line with connected dots!
Which one is better covering the region?
Of course, today TV and Web co-exist
but TV becomes more and more invisible
TV strategies to become more visible
Increase the number of channels
TV strategies to become more visible
Create “thematic” channels
TV strategies to become more visible
Play with the “temporal” aspects: VoD, TimeShift
TV strategies to become more visible
Television already starts to “dotify” itself
TV strategies to become more visible
The 1st lesson: the space near the river is limited, space in the lands is (almost) infinite
TV strategies to become more visible
The 1st Web lesson revisited: the important is the content and not how it is distributed
Still, there are differences
The missing links …
Connecting pixels
From letters to pixels
Classic Book: the value is in the content as a whole
From letters to pixels
On the Web: the value is in the content and in the link
From letters to pixels
Any word is now an entry in the online world: the words are connected mainly because of the search engines
Connecting pixels
Appling the successful stories of textual information to the visual space
From letters to pixels
Classic video content: the value is in the content as a whole
From letters to pixels
Video linked content
From letters to pixels
+ + … =
From a link to a set of links and to the 3D reconstruction of objects and scenes
MPEG offer for connecting pixels
Technology Time Line
MPEG CDVS
State of the art technology for providing links between images
The 2nd Web lesson: the value of the link is at least as important as the value of the content
Still, there are differences
Ok, we have links. And now what?- Able to search, find content and consume it in the traditional linear way …
Still, there are differences
Personalized user experience
The notion of bridget
A bridget is a link from the program being watched to (combinations of) external interactive media elements such as web pages, images,
audio clips, different types of video (2D, multi-view, 3D free viewpoint) and synthetic 3D models
Palazzo vecchio in Florence
is one of the most famous
Monuments. It was built in 1299
Time synchronisation
Main TV screen
Personalized and interactive, synchronized content
Second Screen “Application” is not a new idea, then how the Web can
inspire us here?
Who is able to create the “dots”?
Anyone!
Who is able to create the second screen applications?
Developers
MPEG offer for personalized companion screen experience
The 3rd Web lesson: the creativity may come from anywhere
MPEG MLAF – Multimedia Linking Application Format
MPEG vision on Linking Format
MPEG-4 + MPEG-7 + MPEG-21 ++ MPEG-U+ MPEG-V
= MLAF MPEG Player
CompressionAuthoring Tool
Produce
Download
Making Second Screen Sustainable in Media Production: the BRIDGET Approach
• The Authoring Environment– Using visual technologies to reduce the production time
of rich multi-media and multi-screen content
• User Experience and the BRIDGET Player– Interactive second screen content synchronized with the
main screen
• Enabling Technologies– Visual Search– 3D A/V reconstruction– Media Structure Analysis
The Authoring Tool
The Player
Native support for MPEG-4 BIFS
HTML 5 is also supported
Making Second Screen Sustainable in Media Production: the BRIDGET Approach
MPEG MLAF – Multimedia Linking Application Format
The 4th Web lesson: there is a big variety of the users’ profiles, they should be served differently
OK for the lessons from the Web but is the Television able to
bring a new dimension?
From centuries, we are building two different types of worlds
PhysicalInformational
Immersion, from a human user point of view, is making abstraction of the Physical world (remove all possible connection to it) and have stimuli only from the Informational one
Immersion, presence, stimuli, perception, …
stories
music
films
knowledge
In which world our users are?
The stimuli from physical worlds are familiar or at very low intensities
We intentionally block our interfaces with the physical world
Improving immersion feeling
Strategies for blocking the interfaces with the Physical world
Improving immersion feeling
Strategies for extending the space of the Informational world stimuli
Improving immersion feeling
Television is expected to build multi-sensory experiences
MPEG offer for multi-sensory experiences
MPEG technologies related to multi-sensory experiences
MPEG-V - Media Context and Control
2011
• 2nd Edition: - GPS - Biosensors - 3D Camera
2014
• Compression of video + depth
2015
MPEG-V
- 3D Video
• 1st Edition - Sensors and actuators - Interoperability between Virtual Worlds
MPEG-U – Advanced User Interface
2012
A rich set of sensors and actuators
- 3D Audio
MPEG-H
2016
MPEG-V• 3rd Edition: - 4D theater - various camera sensor types
MPEG-V – Media Context and Control
MPEG technologies related to multi-sensory experiences
ActuatorsLight Flash Heating Cooling Wind Vibration Sprayer Scent Fog Color correction Initialize color correction parameter Rigid body motion Tactile Kinesthetic
Global position command
SensorsLight Ambient noise Temperature Humidity Distance Atmospheric pressure Position Velocity Acceleration Orientation Angular velocity Angular acceleration Force Torque Pressure Motion Intelligent camera typeMulti Interaction point Gaze tracking Wind
Dust Body height Body weight Body temperature Body fat Blood type Blood pressure Blood sugar Blood oxygen Heart rate
Electrograph EEG , ECG, EMG, EOG , GSR Weather Facial expression Facial morphology Facial expression characteristics Geomagnetic
Global position Altitude Bend Gas
MPEG technologies related to multi-sensory experiences
MPEG-V – Media Context and Control
Conclusions
• Web development should be an inspiration for the Television development– Anyone should be able to become a source– Anyone should be able to link content to another
content– The user profile fragmentation is much higher that
television is considering it today• However, the Television has its own mission
– The multi-sensory experience