jpeg2000

12/01/2010 | pag. 1

JPEG 2000 Software Licensing

Peter Schelkens, Tim Bruylants

Department of Electronics and Informatics (ETRO)

Vrije Universiteit Brussel (VUB)

Interdisciplinary Institute for Broadband Technology (IBBT)

JPEG

• The Joint Photographic Experts Group (JPEG)

– Working group of the International Standardization Organization

(ISO) and the International Electrotechnical Commission (IEC) –

ISO/IEC JTC1/SC29/WG1

– “Joint” refers to the additional collaboration with the International

Telecommunication Union (ITU)

• Compression standards

– JBIG-1 & JBIG-2

– JPEG

– JPEG-LS

– JPEG 2000

– JPEG XR

– AIC (Upcoming)

Peter.Schelkens@vub.ac.be

12/01/2010 | pag. 2

Why JPEG 2000

• The incentive behind the development of the JPEG 2000 system

was not just to provide higher compression efficiency than the

baseline JPEG system, but also to provide a rich set of features:

– Improved compression efficiency

– Lossy to lossless compression

– Multiple resolution representation

– Embedded bit-stream, including progressive decoding and signal-to-noise (SNR)

scalability

– Tiling

– Region-of-interest (ROI) coding

– Error resilience

– Random codestream access and processing

– Improved performance to multiple compression/decompression cycles

– Flexible file format

Peter.Schelkens@vub.ac.be

12/01/2010 | pag. 3

Wavelet-based scalable

coding

Resolution Scalability

Peter.Schelkens@vub.ac.be

12/01/2010 | pag. 4

Wavelet-based scalable

coding

Quality Scalability

Peter.Schelkens@vub.ac.be

12/01/2010 | pag. 6

JPEG 2000 Technology

, 0iB i N

TilingDiscrete

Wavelet

Transform

Split into

codeblocks

Embedded

Bit-plane

Coding

Codeblock Context-based

adaptive

arithmetic coding Embedded bit-stream

Maximum quality

, 0iC i N

Tier 2: Layer formation

Tier 1: Low-level embedded block coding

EBCOT: Embedded block coding by optimized trucation

Peter.Schelkens@vub.ac.be

12/01/2010 | pag. 7

The JPEG 2000 Suite

Peter.Schelkens@vub.ac.be

12/01/2010 | pag. 9

Part 1/13

Core Codec

Part 2

Extensions

Part 10

3D Extensions

Part 9

JPIP

Part 3

MJPEG 2000

Part 6

JPM

Image Codec

ToolsFile Format

Part 8

JPSEC

Part 11

JPWL

Part 14

JPXMLE2E Toolset

Extra Functionality

Codec Tools

Part 4

Compliance Testing

Part 5

Reference Software

Part 12ISO Base Media

Check also SC29 status pages: http://www.itscj.ipsj.or.jp/sc29/

Peter.Schelkens@vub.ac.be

12/01/2010 | pag. 10

Markets: Digital Cinema

StorageDCP

Digital CinemaPackage

Key

Image

Audio

Subtitles

Captions

Auxiliary

Data

Digital Cinema Distribution Master* (DCDM*)

JPEG2000

DecompressionDecryption

Dencryption

Decryption

Decryption

Security

Manager

Watermarking

Watermarking

Overlay

Projector

Sound System

Automation System

Secure Media Block

Markets: File-based Cross-

media Production in

Broadcasting

Peter.Schelkens@vub.ac.be

12/01/2010 | pag. 11

(EBU/VRT, 2009)

JPEG 2000 Products

• Hardware

– Analog Devices (ADV202)

– Barco Silex (FPGA)

– …

• Software

– Kakadu

– LuraTech

– Aware Inc.

– Dolby

– Lead technologies

– OpenJPEG

– …Slide 12

Sold AS IS, closed design

Complex code

Highly optimized code

Closed source

Support/No support

…

Complete packages to be used as

component in an end product

Our Product

Peter.Schelkens@vub.ac.be

12/01/2010 | pag. 13

Part 1/13

Core Codec

Part 2

Extensions

Part 10

3D Extensions

Part 9

JPIP

Part 3

MJPEG 2000

Part 6

JPM

Image Codec

ToolsFile Format

Part 8

JPSEC

Part 11

JPWL

Part 14

JPXMLE2E Toolset

Extra Functionality

Codec Tools

Part 4

Compliance Testing

Part 5

Reference Software

Part 12ISO Base Media

Check also SC29 status pages: http://www.itscj.ipsj.or.jp/sc29/

Our Product

• ETRO designed/wrote a software package that:

– Delivers JPEG 2000 Part 1 compatibility

– Delivers JPEG 2000 Part 10 (JP3D) compatibility• It is the official JPEG 2000 reference software of JP3D

• Currently the ONLY available software package that has JP3D functionality

– High and competitive compression performance

– Simple design• This makes it also interesting to hardware chip designers and researchers

– Easy to use, modify, learn from• This makes it also interesting to hardware chip designers and researchers

– Originally intended for internal research and as reference

software for the JPEG 2000 Part 10 standard

Slide 14

Our Problem

• Numerous requests from companies and academic

institutions for our code (often in research context)

• Non-commercial vs. commercial use policies?

– Can we create some kind of revenue?

• How to provide access to the code? (NDA?)

• Licenses?

• Warranties?

• Support?

Slide 15

File-based Cross-media

Production in Broadcasting

Peter.Schelkens@vub.ac.be

12/01/2010 | pag. 16

(EBU/VRT, 2009)

To learn more

on JPEG 2000 ...

SPIE Electronic Imaging 2009

Peter.Schelkens@vub.ac.be

12/01/2010 | pag. 17