iminds the conference 2012: adrian munteanu
DESCRIPTION
Next Generation Media TechnologiesTRANSCRIPT
![Page 1: iMinds The Conference 2012: Adrian Munteanu](https://reader030.vdocuments.us/reader030/viewer/2022020115/54b5e3b04a79591a7f8b4596/html5/thumbnails/1.jpg)
Multimedia RepresentationsAdrian Munteanu
![Page 2: iMinds The Conference 2012: Adrian Munteanu](https://reader030.vdocuments.us/reader030/viewer/2022020115/54b5e3b04a79591a7f8b4596/html5/thumbnails/2.jpg)
2
Multimedia
Research Activities
Multimedia Representations
Compression Technologies(Images, Video, 3D Graphics, 3D textures)
Development of new algorithms, customized solutions
In-depth know-how of various standards: JPEG-2000, H.26x, MPEG-4, VCEG, etc.
Focus on various application domains for a broad range of imaging modalities
![Page 3: iMinds The Conference 2012: Adrian Munteanu](https://reader030.vdocuments.us/reader030/viewer/2022020115/54b5e3b04a79591a7f8b4596/html5/thumbnails/3.jpg)
What are meshes? Representations of 3D virtual objects Set of points Set of triangles, quads, …
MESHES
called polygons
Scalable Compression of Meshes
3
![Page 4: iMinds The Conference 2012: Adrian Munteanu](https://reader030.vdocuments.us/reader030/viewer/2022020115/54b5e3b04a79591a7f8b4596/html5/thumbnails/4.jpg)
Resolution scalability
Example:
Resolution level 1(original)
Resolution level 2
Resolution level 3 Resolution level 4
Scalable Compression of Meshes
4
![Page 5: iMinds The Conference 2012: Adrian Munteanu](https://reader030.vdocuments.us/reader030/viewer/2022020115/54b5e3b04a79591a7f8b4596/html5/thumbnails/5.jpg)
Why scalability? Progressive reconstruction Level-Of-Detail (LOD)
LOD calls for resolution scalability!
Scalable Compression of Meshes
5
![Page 6: iMinds The Conference 2012: Adrian Munteanu](https://reader030.vdocuments.us/reader030/viewer/2022020115/54b5e3b04a79591a7f8b4596/html5/thumbnails/6.jpg)
Rabbit Igea
+30% compression
Provides state-of-the-art compression performance Resolution scalable!
3xC Codec (Context-conditioned Composite Coding of meshes)
Scalable Compression of Meshes
6
+30% compression
![Page 7: iMinds The Conference 2012: Adrian Munteanu](https://reader030.vdocuments.us/reader030/viewer/2022020115/54b5e3b04a79591a7f8b4596/html5/thumbnails/7.jpg)
7
Compressed 140 KB (206:1)
Original Semi-regular “Bob” Mesh (© Alcatel-Lucent)
28.13 MB
Real world compression performance Scalable Compression of Meshes
![Page 8: iMinds The Conference 2012: Adrian Munteanu](https://reader030.vdocuments.us/reader030/viewer/2022020115/54b5e3b04a79591a7f8b4596/html5/thumbnails/8.jpg)
Right
StereoEncoding
Left
3D video: from stereo to multi-view
8
![Page 9: iMinds The Conference 2012: Adrian Munteanu](https://reader030.vdocuments.us/reader030/viewer/2022020115/54b5e3b04a79591a7f8b4596/html5/thumbnails/9.jpg)
3D video: from stereo to multi-view
Right
MultiviewEncodingCenter
Left Autostereoscopic display
9
![Page 10: iMinds The Conference 2012: Adrian Munteanu](https://reader030.vdocuments.us/reader030/viewer/2022020115/54b5e3b04a79591a7f8b4596/html5/thumbnails/10.jpg)
Free Viewpoint Television
![Page 11: iMinds The Conference 2012: Adrian Munteanu](https://reader030.vdocuments.us/reader030/viewer/2022020115/54b5e3b04a79591a7f8b4596/html5/thumbnails/11.jpg)
3D Video: Compression
Encode a pair of depth and texture information of extreme left and extreme right cameras;
Synthesize all middle views
11
![Page 12: iMinds The Conference 2012: Adrian Munteanu](https://reader030.vdocuments.us/reader030/viewer/2022020115/54b5e3b04a79591a7f8b4596/html5/thumbnails/12.jpg)
iMinds-FMI: hybrid 3D coding system → based on H.264/AVC and HEVC
3D video: from stereo to multi-view
multi-view coding of
texture and depthcompatible
with installed
base layersupport for stereo and autostereogains of
35% compared to current MVC technology
0%
20%
40%
60%
80%
100%3D overhead
12
![Page 13: iMinds The Conference 2012: Adrian Munteanu](https://reader030.vdocuments.us/reader030/viewer/2022020115/54b5e3b04a79591a7f8b4596/html5/thumbnails/13.jpg)
13
![Page 14: iMinds The Conference 2012: Adrian Munteanu](https://reader030.vdocuments.us/reader030/viewer/2022020115/54b5e3b04a79591a7f8b4596/html5/thumbnails/14.jpg)
Segmentation-based 3D Depth coding
Encoding time: ~5 times smaller Subjective tests:
Alternative for high-complexity codecs
14
![Page 15: iMinds The Conference 2012: Adrian Munteanu](https://reader030.vdocuments.us/reader030/viewer/2022020115/54b5e3b04a79591a7f8b4596/html5/thumbnails/15.jpg)
Challenges for the future The imaging modalities are getting highly diversified
HolographyHolographyHolography3D Video3D Video
Multiview videoMultiview videoMultiview video
Depth mapsDepth mapsDepth maps
High-quality 3D graphicsHigh-quality 3D graphicsHigh-quality 3D graphicsCapsule endoscopyCapsule endoscopyCapsule endoscopy