jpeg 2000 extensions - itu · 2 itu-t vica workshop dates 22-23 july 2005 - itu headquarter -...
TRANSCRIPT
![Page 1: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/1.jpg)
ITU-T VICA Workshop22-23 July 2005 - ITU Headquarter - Geneva
International Telecommunication Union
JPEG 2000 ExtensionsJPEG 2000 ExtensionsFrédéric Dufaux
Ecole Polytechnique Fédérale de Lausanne (EPFL)Institut de Traitement des Signaux
![Page 2: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/2.jpg)
2ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
ISO/IEC 15444 – JPEG 2000
o Part 1 - Core coding systemo Part 2 - Extensionso Part 3 - Motion JPEG 2000 o Part 4 - Conformance o Part 5 - Reference softwareo Part 6 - Compound image file format o Part 8 - JPSEC: Secure JPEG 2000o Part 9 - JPIP: Interactivity tools, APIs and protocols o Part 10 - JP3D: Extensions for 3D datao Part 11 - JPWL: Wireless o Part 12 - ISO Base Media File Formato Part 13 – An entry level JPEG 2000 encoder
![Page 3: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/3.jpg)
3ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
Work Plan
05/1105/0705/0304/0703/0702/07JPWL
06/0706/0305/1105/0702/1002/03JP3D
04/1004/0403/0703/0302/0702/03JPIP
05/1105/0704/1104/0402/1002/03JPSEC
ISFDISFCDCDWDCFP
![Page 4: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/4.jpg)
4ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPSEC: Secure JPEG 2000
Services addressed:o Confidentiality
• Encryption or ciphering to conceals original contento Integrity verification
• Image data integrity: bit exact verification• Image content integrity: perceptual meaning verification
o Source authentication• Identity of the party which generated the content
o Conditional access• Restrict access to image data or parts of it
o Secure scalable streaming and transcoding• Streaming and transcoding without unprotecting the content
o …
![Page 5: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/5.jpg)
5ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPSEC Framework
Open and flexible framework
JPSEC codestream
Proprietary Tool ID
JPSEC Syntax Parser
JPSEC Unprotection
Tools
JPSEC Syntax Writer
JPSEC Protection
Tools
JPSEC protector JPSEC unprotector
Security Services: • Confidentiality • Integrity Verification • Source Authentication• �
JPSEC Registration
Authority
Tool Description
JPSEC Tools: • Encryption (AES, DES, �) • Digital Signature (RSA, �) • Message Auth. Code • Watermarking • Proprietary Tools • �
![Page 6: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/6.jpg)
6ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPSEC Framework
Creation and consumption of JPSEC content
JPEG-2000codestream
JPSEC codestream
JPEG-2000codestream
JPEG-2000 Decoder
JPSEC Unprotector
JPSEC Protector
JPEG-2000 Encoder
JPSEC codestream Image Image
Image
JPSECEncoder & Protector
JPSECUnprotector & Decoder
Case 1
Case 2
Case 3 JPEG-2000or JPSEC
codestream
JPSEC Protector 1
JPSEC’ JPSEC
Protector 2
JPSEC” JPSEC
Protector 3
JPSEC* JPSEC
Unprotector 3
JPSEC”
JPSEC Unprotector 2
JPSEC’
JPSEC Unprotector 1
JPEG-2000or JPSEC
codestream
Image
![Page 7: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/7.jpg)
7ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPSEC ROI-Scrambling
o Add pseudo-random noiseo Performed in the wavelet
domaino Based on ROI mechanisms in
JPEG 2000o Efficient for arbitrary-shape
regionso Adjust distortion from
fuzziness to noiseo Application
• Video surveillance preserving privacy
![Page 8: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/8.jpg)
8ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPIP: Interactivity tools, APIs and Protocols
o Tools for supporting image and metadata delivery in a networked environment
o Exploit JPEG 2000 properties• Random access • Codestream reordering• Incremental decoding
![Page 9: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/9.jpg)
9ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPIP: Interactivity tools, APIs and Protocols
Protocol overview
Protocol stack
Cache
Client
Cache Model*
Server
HTTP, TCP, UDP
*Only if State is present
Image Metatdata Server Capabilities JPP- or JPT-streams
Display Metatdata Client Capabilites Data Limits Multiple Server Responses
Multiple Client Requests
JPIP
IP
TCP UDP
HTTP
![Page 10: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/10.jpg)
10ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JP3D: Extensions for 3D Data
o Extension of JPEG 2000 parts 1 and 2o Compress samples along all three dimensionso Targets applications:
• Medical Imaging (MRI, CAT, PET scans)• Scientific Modeling and Simulation• Remote Sensing (hyperspectral imagery,
geophysical/astrophysical measurements)• …
![Page 11: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/11.jpg)
11ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JP3D: Extensions for 3D Data
o Extends standard JPEG 2000 technology from two to three dimensions
• Wavelet transform• Quantization• Coefficient bit modeling
o New technologies• 3D context probability models for entropy
coding• Variable resolution sampling grids• Coding of floating point data
![Page 12: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/12.jpg)
12ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPWL: Wireless
o Multimedia wireless applications are becoming ubiquitous• Sales of camera-equipped cell phones exceed those of
standalone digital cameras• Importance of efficient and robust wireless imaging solutions
o JPEG 2000 is well-suited for wireless applications• High coding efficiency → good visual quality• Seamless scalability → quality of service and pricing strategies
o JPEG 2000 Wireless (JPWL)• Efficient transmission over error-prone networks• Normative and information tools for error protection and
correction• Forward Error Correcting (FEC) codes• Header protection• Unequal Error Protection (UEP)• Data partitioning and interleaving• Robust arithmetic coding
![Page 13: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/13.jpg)
13ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPWL: Wireless
o Headers are most important part of code stream• FEC for strong protection of Main and Tile-part headers• Add redundancy bits while keeping backward
compatibilityo Progressive quality transmission
• Layered code stream: each layer contributes to improve quality
• UEP: decreasing protection as layer importance decreases
Mai
n H
eade
r
Tile
-par
t H
eade
r
Pack
et
Pack
et
Pack
etLayer 1
high importance
……
Pack
et
Pack
et
Pack
et
Layer 2medium importance
…
Pack
et
Pack
et
Pack
et
Layer nlow importance
…
Headerscritical importance
![Page 14: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/14.jpg)
14ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPWL Unequal Error Protection
384 kb/s, CIF, 15 f/s, 3 quality layersBER=10-3 (WCDMA error patterns)
JPEG 2000
JPWL
26.0324.18average
29.8027.35Soccer
18.6317.71Mobile
22.6021.19Harbor
28.0725.73Foreman
30.4328.09Crew
26.6524.98City
PSNRJPWL
PSNRJPEG 2000sequence
![Page 15: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/15.jpg)
15ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
Motion JPEG 2000 vs MPEG-4
InaccurateAccurateRate control
HighLowCoding Delay
HighLowEncodercomplexity
MC DCTIntra-frameWaveletCoding
BlockRinging
Blur RingingArtifacts
MPEG-4Motion JPEG 2000
InefficientEfficientScalability
LowHighError resilience
![Page 16: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/16.jpg)
16ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
Motion JPEG 2000 vs MPEG-4
128 kb/s, QCIF, 6 f/sBER=10-4 (WCDMA error patterns)
30.01
27.75
36.82
30.21
31.29
25.34
33.36
24.67
34.25
26.44
PSNRMPEG-4IPP..IPP
PSNRMotion
JPEG2000
30.32average
26.69Tempest
38.25Suzie
32.48Football
29.62Waterfall
26.90Letters
33.63Animals
22.87Mobile
35.06New York
27.41Balloons
JPEG 2000
MPEG-4
![Page 17: JPEG 2000 Extensions - ITU · 2 ITU-T VICA Workshop dates 22-23 July 2005 - ITU Headquarter - Geneva ITU-T ISO/IEC 15444 – JPEG 2000 o Part 1 - Core coding system o Part 2 - Extensions](https://reader030.vdocuments.us/reader030/viewer/2022040402/5e81abf1a52c5b7aaa7c1325/html5/thumbnails/17.jpg)
17ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
The End !
o Questions?