1. 1. JPEG Business plan Prof. Touradj Ebrahimi JPEG Convener 27 June 2015 1www.jpeg.org
2. 2. JPEG Family of Standards 27 June 2015 www.jpeg.org 2
3. 3. JPEG a strong and fast growing ecosystem 27 June 2015 www.jpeg.org 3 Source: KPCB 2014 Internet Trends, estimates based on publicly disclosed company data. 1995-96 Technology and Engineering Emmy award (together with MPEG-2)
4. 4. JPEG 2000 great impact on professional markets 27 June 2015 www.jpeg.org 4 2015 Technology and Engineering Emmy award (JPEG 2000 interoperability)
5. 5. JPEG 2000 framework 27 June 2015 www.jpeg.org 5 Part 1/13 Core Codec Part 2 Extensions Part 10 3D Extensions Part 9 JPIP Part 3 MJPEG 2000 Part 6 JPM Image Codec Tools File Format Part 8 JPSEC Part 11 JPWL Part 14 JPXML E2E Toolset Extra Functionality Codec Tools Part 4 Compliance Testing Part 5 Reference Software Part 12 ISO Base Media
6. 6. JPEG XR bridging a gap 27 June 2015 www.jpeg.org 6 Complexity Performance JPEG JPEG XR
7. 7. JPEG vs JPEG 2000 vs JPEG XR 27 June 2015 www.jpeg.org 7
8. 8. JPEG XR not widely used! 27 June 2015 www.jpeg.org 8
9. 9. JPSearch 27 June 2015 www.jpeg.org 9 F. Temmermans, F. Dufaux and P. Schelkens, JPSearch: Metadata Interoperability During Image Exchange, IEEE Signal Processing Magazine, vol.29, no. 5, pp.134-139, 2012
10. 10. Other standards in Progress 27 June 2015 www.jpeg.org 10 Advanced Image Coding (AIC) Evaluation methodologies and metrics JPEG AR Image exchange in Augmented Reality JPEG Systems Consolidated system layer structure JPEG XT JPEG forward/backward compatible HDR compression
11. 11. Advanced Image Coding (AIC) Advanced Image Coding Part 1: Guidelines for codec evaluation Part 2: Evaluation procedure for assessing visually lossless coding Call for information issued in February 2015 to receive information on next generation still image compression with superior compression efficiency, as well as other useful features needed in future multimedia applications PCS2015 Feature Event - Evaluation of current and future image compression technologies Further contributions received on 69th WG1 meeting in Warsaw, Poland 27 June 2015 www.jpeg.org 11
12. 12. Advanced Image Coding (AIC) 27 June 2015 www.jpeg.org 12 woman
13. 13. JPEG XT backward compatible HDR 27 June 2015 www.jpeg.org 13 A JPEG legacy backward & forward compatible HDR image compression standard
14. 14. JPEG XT design principles Exif and JFIF use APP marker of JPEG Reserved for application segments 27 June 2015 www.jpeg.org 14 APP marker (0 to 15) Format APP0 JFIF, JFXX APP1 Exif APP2 ICC Profile APP3 JPSearch Part2 APP14 Adobe SOI APP1 DQT DHT SOF streamSOS EOI WG1N5725 Start of Image (SOI) APP11 (Residual JPEG XT) JPEG-1 Code-stream End of Image (EOI) JPEG XT File
15. 15. JPEG XT design principles Two-layer coding, with base layer a legacy JPEG coded LDR and enhancement layer the residual to produce the HDR Enhancement layer uses a maximum of JPEG Legacy coding tools 27 June 2015 www.jpeg.org 15
16. 16. JPEG XT profiles 27 June 2015 www.jpeg.org 16
17. 17. JPEG XT compression efficiency 27 June 2015 www.jpeg.org 17
18. 18. JPEG XT status 27 June 2015 www.jpeg.org 18 Part Title WD CD DIS FDIS IS 1 Core Coding System 13/01 13/07 14/01 - 14/10 2 Coding of High Dynamic Range Images 13/10 14/01 14/04 - 14/10 3 Box File Format 14/05 14/07 15/02 - 15/06 4 Conformance Testing 15/02 15/10 16/02 - 16/06 5 Reference Software 14/07 15/06 16/02 - 16/06 6 IDR Integer Coding 14/05 14/07 15/02 15/06 15/10 7 HDR Floating-Point Coding 14/05 14/07 15/02 15/06 16/02 8 Lossless and Near-lossless Coding 14/07 15/02 15/06 - 16/02 9 Alpha Channel Coding 14/10 15/02 15/06 - 16/02
19. 19. JPEG Privacy & Security Features: Access control to specific images is defined with rules (privacy policies). Policies are defined either by the service provider or by the image owner. Policies define conditional access to information based on User: individual, group, location, role, Context: date and time, number of accesses, action (view, download, ), etc. Image: quality, geolocation, author, date, semantic information, etc. Action: read, update, delete, etc. 27 June 2015 www.jpeg.org 19
20. 20. JPEG Privacy & Secuity App11 27 June 2015 www.jpeg.org 20 SOI APP1 (Exif) EOI SOI APP1 (Exif) EOI APP11 (protected metadata) JPEG-1 decoder JPEG Privacy & Security decoder APP1 (Exif) APP1 (Exif) original JPEG codestream JPEG compatible codestream with data protection Image Data Image data APP11 (protected image data) Image Data APP11 (protected metadata) Image data APP11 (protected image data) APP3 (JPSearch) APP3 (JPSearch) APP3 (JPSearch)
21. 21. Should pictures be flat? 27 June 2015 www.jpeg.org 21
22. 22. JPEG PLENO JPEG PLENO targets a standard framework for the representation and exchange of new imaging modalities such as light- field, point-cloud and holographic imaging. 27 June 2015 www.jpeg.org 22
23. 23. Plenoptic representation of visual information 7D function P(a,q,l,t,x,y,z) view point wavelength time 27 June 2015 www.jpeg.org 23
24. 24. JPEG PLENO design principles One or limited number of representation models Well defined, specific and useful milestones Backward compatible with legacy JPEG 27 June 2015 www.jpeg.org 24 Panorama 360 degree Spatial photo Point cloud Light field Holography
25. 25. Spatial Photography Motion parallax 27 June 2015 www.jpeg.org 25
26. 26. Point-cloud Photography 27 June 2015 www.jpeg.org 26
27. 27. Light-field Photography 27 June 2015 www.jpeg.org 27
28. 28. Light-field Photography 27 June 2015 www.jpeg.org 28
29. 29. Light-field Photography 27 June 2015 www.jpeg.org 29
30. 30. Holography 27 June 2015 www.jpeg.org 30 LIGHT-FIELD Rays with position + orientation HOLOGRAM Interference = superposition of waves
31. 31. JPEG PLENO Workshop Warsaw, Poland June 23rd, 2015 Marriott Hotel Warsaw 14:00 Touradj Ebrahimi (JPEG Convenor - EPFL): "JPEG PLENO - Introduction and Scope" Light-fields 14:15 Christian Perwa (Raytrix GmbH, Germany): "Metrically Calibrated Multi-focus Plenoptic Camera and its Applications" 14:40 Joachim Keinert (Fraunhofer IIS, Germany): "Lightfield media production using camera arrays - use cases and requirements" 14:55 Peter Kovacs (Holografika, Hungary): "Light Field Displays" 15:20 Atanas Gotchev (Tampere University of Technology): "Content creation for light-field displays" 15:35 Roger Olsson (Mid Sweden University): "Objective evaluation and SotA compression solutions for plenoptic image content" 15:50 Discussion on compression of light field data (Requirements, use cases, technologies) Point-clouds 16:30 Rufael Mekuria (CWI Netherlands): "Point Cloud Compression" 16:45 Discussion on compression of point cloud data (Requirements, use cases, technologies) Holography 16:55 Magorzata Kujawinska (Warsaw University of technology): "Holographic capturing and rendering systems, suitable data representations for phase and amplitude" 17:10 Frederic Dufaux (TELECOM ParisTech, France): "Digital Holography Compression" 17:35 Discussion on compression of holographic data (Requirements, use cases, technologies) 17:50 Conclusions 27 June 2015 www.jpeg.org 31
32. 32. JPEG XS Light weight / Low Latency Image Coding Modest compression Transparent quality Low complexity 27 June 2015 www.jpeg.org 32
33. 33. JPEG XS Light weight / Low Latency Image Coding Already several solutions around: TICO VC-2DiracPro LowLatencyVideoCodec(LLVC) LowComplexityCodec(LLC) LS/NLS-Encoder/Decoder TITC ARMFrameBufferCompression(AFBC) CompactFrameBufferTechnology(CFrame) Oz2 EVLC DSC&A-DSC 27 June 2015 www.jpeg.org 33 New Work Item
34. 34. Conclusions JPEG is exploring several paths to serve future imaging needs Privacy and security solutions in progress New imaging modalities started Activities in Advanced Still Image Coding JPEG PLENO JPEG XS JPEG Privacy Workshop planned at 70th ISO/IEC JTC1/SC29/WG1 (JPEG) Meeting Brussels, Belgium October 12, 2015 - October 16, 2015 27 June 2015 www.jpeg.org 34
35. 35. More information 27 June 2015 www.jpeg.org 35 Prof. Touradj Ebrahimi JPEG Convener cole Polytechnique Fdrale de Lausanne (EPFL) Touradj.Ebrahimi@epfl.ch Prof. Peter Schelkens JPEG Public Relations Chair JPEG Coding & Analysis Chair Vrije Universiteit Brussel - iMinds Peter.Schelkens@vub.ac.be www.jpeg.org/contact.html
36. 36. Acknowledgements Tim Bruylants, Antonin Decampe, Jamie Delgago, Karel Fliegel, Philippe Hanhart, Takaaki Ishikawa, Lukas Krasula, Fernando Pereira, Antonio Pinheiro, Martin Rerabek, Thomas Richter, Gael Rouvroy, Peter Schelkens, Frederik Temmermans 27 June 2015 www.jpeg.org 36
37. 37. Questions? 27 June 2015 www.jpeg.org 37