Where we are in the FP7Brief on Call results

Future Work Programme “Networked Media & 3D Internet”

Luis Rodríguez-RosellóHead of Unit “Networked Media Systems” DG-INFSO

NEM Open ForumSaint Malo, September 29th

EU R&D on Networked MediaThe current project portfolio and clusters

• Media Delivery Platforms and Content Delivery Networks: High quality TV via P2P; Digital Cinema, Next generation of P2P; IPTV and VoIP over IMS; Seamless content delivery; Scalable video coding

• User Centric Media: Shared interactive experiences; Community content (including co-creation); Dynamic personalisation and interaction; Seamless integration of UGC and professional content; Real-time context-aware media streaming; New forms of mobile music; Networked games environments; Interactive multimedia experiences

• 3D Media: Mobile 3D TV over DVB-H; Digital Cinema; Content generation and delivery of 3D digital TV; Spatial sound and vision; Feeling of physical presence

• Multimedia Search: P2P search; P2P tagged media; Multimedia content analysis; Automated annotation; Mixed-media queries; Data fusion; Location-based; Retrieval of 3D objects; Direct Search

“Networked Media & 3D Internet”

The Work Programme 2009-10: context and focus

Context: • Creation of multimedia content is evolving at a fast pace akin to new ways of media delivery, including 3D Media and Ultra HDTV. Both are relying on the Internet as a key infrastructure. • The Internet has revolutionised access to multimedia content and ever increasing data traffic creates new demands and places constraints to network platforms.•Search and retrieval are essential tools in the new media landscape• Dual role of users as producers/consumers and the combination of virtual and/or augmented reality has the potential to generate innovative business models and new economic activities.

R&D focus: “Networked Media and 3D Internet” as one of the pillars of the Future Internet. Significant research results are expected in the areas:

a) Content-aware Networks and Network-aware Applicationsb) 3D Media Internetc) Networked Search and Retrievald) Immersive Media Experiences beyond HDTV and Electronic Cinema

The Work Programme:The Work Programme:what was called for what was called for

• Content-aware Networks and Network-aware ApplicationsContent-aware Networks and Network-aware Applications

Mass distribution, real time delivery and rendering, Mass distribution, real time delivery and rendering, representation, augmented worlds.representation, augmented worlds.

User generated content/social networks, Enriched media User generated content/social networks, Enriched media experiences (at the “Extended Home”, experiences (at the “Extended Home”, content and context-aware, content and context-aware, personalised, social media, real time). Optimal QoE. Users as producers, personalised, social media, real time). Optimal QoE. Users as producers, consumers, managers of content.consumers, managers of content.

• 3D Media Internet3D Media Internet

• Networked Search and RetrievalNetworked Search and Retrieval Large scale distributed MM content, interaction, dynamic Large scale distributed MM content, interaction, dynamic adaptation to context and application, personalised searchadaptation to context and application, personalised search

• Immersive Media Experiences beyond HDTV and Electronic CinemaImmersive Media Experiences beyond HDTV and Electronic Cinema Next generation MM and cinema: higher QoE (frame rates, contrast Next generation MM and cinema: higher QoE (frame rates, contrast range, colour, resolution, “spacialised” sound, 3D, innovative range, colour, resolution, “spacialised” sound, 3D, innovative 3D/multi-viewpoint coding…)3D/multi-viewpoint coding…)

The outcomeSelected proposals overview

Number of selected proposals addressing the target outcome

IP + STREP(17)

NoE(1)

CSA(5)

a) Content aware nets 11 0 3

b) 3D Media Internet 7 1 3

c) Networked search 6 * 1

d) Immersive media 6 0 *

• Overall very good coverage of the Work Programme

• Extensive coverage of Content-aware Networks and Network-aware Applications

• Good integration potential and complementarities with current portfolio and clusters

• Smooth continuity in relation to ongoing networked search projects.

• 5 CSA projects to Support the coordination of the area

• Adequate participation balance:– 47% Industrial partners (19% SME)– 28% Academia – 21% Research Centres.

Upcoming R&D on Networked Media and 3D Upcoming R&D on Networked Media and 3D Internet (1/2)Internet (1/2)

• Content-aware Networks and Network-aware Applications:Content-aware Networks and Network-aware Applications: Networked Media “ecosystem”Networked Media “ecosystem”

Content-centric network architecture Content-centric network architecture

P2P architecture for User Generated ContentP2P architecture for User Generated Content

Network-controlled adaptive content deliveryNetwork-controlled adaptive content delivery

Optimization of bandwidth of HD-SD IPTV and Internet TV streamingOptimization of bandwidth of HD-SD IPTV and Internet TV streaming

Collaborative, social, context-aware and scalable media distributionCollaborative, social, context-aware and scalable media distribution

Optimization of content source selection and distribution (user Optimization of content source selection and distribution (user preferences, network statepreferences, network state

Compression and delivery of multi-view video and multi-channel audioCompression and delivery of multi-view video and multi-channel audio

European reference architecture for Future Media Internet

Contribution of Networked Media community to Web standards Contribution of Networked Media community to Web standards

Upcoming R&D on Networked Media and 3D Upcoming R&D on Networked Media and 3D Internet (2/2)Internet (2/2)

New paradigms for realistic 3D communication over the New paradigms for realistic 3D communication over the Internet Virtual instantaneous transportation of peopleInternet Virtual instantaneous transportation of people Real time interaction between humans and virtual humansReal time interaction between humans and virtual humans Immersive and interactive TV (live events, ultra-high Immersive and interactive TV (live events, ultra-high resolution panoramas…)resolution panoramas…) 3D display and transmission of multi-view signals3D display and transmission of multi-view signals New forms for the creation and delivery of live media New forms for the creation and delivery of live media content (automatic capturing of the events in 3D, realistic, content (automatic capturing of the events in 3D, realistic, interactive and immersive play-back…)interactive and immersive play-back…) Virtual Centre of ExcellenceVirtual Centre of Excellence

• 3D Media Internet & Immersive Media Experiences3D Media Internet & Immersive Media Experiences

• Networked Search and RetrievalNetworked Search and Retrieval Open platform for multimedia and multimodal content Open platform for multimedia and multimodal content indexing, sharing, search and retrievalindexing, sharing, search and retrieval Use of events as the primary means to organise and index Use of events as the primary means to organise and index media: experiential, new social networking (event-based media: experiential, new social networking (event-based communities), personalised, automated media search and communities), personalised, automated media search and content retrievalcontent retrieval European coordination actionEuropean coordination action

Future Research Preparatory work for the Work Programme 2011-2013 in

Networked Media Systems

• Public consultation (open until December 2009)• Workshop on future R&D challenges in the

Networked Media Systems (19th of January 2010) based on the results of a public consultation;

• Topical Workshops – Immersive media experiences (inc Games)– Convergence Internet/Broadcasting+ …/ The Future of Digital

Broadcasting

• Future Internet (R&D agenda, Public Private Partnership…)

• NEM Strategic R&D Agenda• NEM Open Forum to provide strategic direction