special module on media processing and communicationpkalra/siv864/pdf/lec2.pdf · • interpixel...
TRANSCRIPT
![Page 1: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/1.jpg)
Special Module on Media Processing and
Communication
Dayalbagh Educational Institute (DEI)
Dayalbagh Agra
PHM 961
Indian Institute of Technology Delhi (IITD)
New Delhi
SIV 864
![Page 2: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/2.jpg)
Recap! Lecture 1
l Overview l Digital Representation
• Audio • Image • Video • Geometry
l Need of Compression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
![Page 3: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/3.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Compression Ratio
Cr = no/nc no = Number of carrying units (bits) in the original
data (image) nr = Number of carrying units (bits) in the compressed
data (image) Also,
Rd = 1 – 1/ Cr Rd = Relative data redundancy
![Page 4: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/4.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Fidelity Criteria Measure of loss or degradation • Mean Square Error (MSE)
• Signal to Noise Ratio (SNR) • Subjective Voting
![Page 5: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/5.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Compression Techniques • Loss-less Compression
Information can be compressed and restored without any loss of information
• Lossy Compression Large compression, perfect recovery is not possible
![Page 6: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/6.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Compression Techniques Symmetric • Same time for compression (coding) and decompression (decoding) • Used for dialog (interactive) mode applications Asymmetric • Compression is done once so can take longer • Decompression is done frequently so should be fast • Used for retrieval model applications
![Page 7: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/7.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Data Redundancy
• Coding Variable length coding with shorter codes for frequent symbols
• Interpixel Neighboring pixels are similar
• Psychovisual Human visual perception - limited
![Page 8: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/8.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Coding Redundancy
variable length coding Avg length=2.7 bits
fixed length coding Avg length=3 bits
Example: (from Digital Image Processing by Gonzalez and Woods)
![Page 9: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/9.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Interpixel Redundancy
Image Histogram
Example: (from Digital Image Processing by Gonzalez and Woods)
![Page 10: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/10.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Interpixel Redundancy
Image Histogram
Example: (from Digital Image Processing by Gonzalez and Woods)
High interpixel correlation
![Page 11: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/11.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Psychovisual Redundancy
Original 256 levels 16 level quantization IGS quantization
Example: (from Digital Image Processing by Gonzalez and Woods)
![Page 12: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/12.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Loss-less Techniques • Coding redundancy
Variable length coding
• Interpixel redundancy Run length coding Predictive coding
![Page 13: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/13.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Variable Length Coding (Huffman Coding) Sequence of symbols (a1, a2, a3, a4, a5) with associated probabilities (p1, p2, p3, p4, p5) • Start with two symbols of the least probability
a1:p1 a2:p2
• Combine (a1 or a2) with probability (p1+p2) • Do it recursively (sort and combine) • A binary tree construction
![Page 14: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/14.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Variable Length Coding (Huffman Coding)
a2 (0.4) a1(0.2) a3(0.2) a4(0.1) a5(0.1)
Sort in probability
Symbols and their probabilities of occurrence a1 (0.2), a2 (0.4), a3 (0.2), a4 (0.1), a5 (0.1)
Example:
![Page 15: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/15.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Variable Length Coding (Huffman Coding)
a2 (0.4) a1(0.2) a3(0.2) a4(0.1) a5(0.1)
Sort
![Page 16: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/16.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Variable Length Coding (Huffman Coding)
a2 (0.4) a1(0.2) a3(0.2) a4(0.1) a5(0.1)
Sort
0.2
combine
![Page 17: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/17.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Variable Length Coding (Huffman Coding)
a2 (0.4) a1(0.2) a3(0.2) a4(0.1) a5(0.1)
Sort
0.2
combine Sort
0.4
0.2
0.2
0.2
![Page 18: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/18.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Variable Length Coding (Huffman Coding)
a2 (0.4) a1(0.2) a3(0.2) a4(0.1) a5(0.1)
Sort
0.2
combine Sort
0.4
0.2
0.2
0.2
0.4
combine Sort
0.4
0.2
0.4 0.6
combine
0.6
0.4
Sort
1
combine
![Page 19: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/19.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Variable Length Coding (Huffman Coding)
a2 (0.4) a1(0.2) a3(0.2) a4(0.1) a5(0.1)
Sort
0.2
combine Sort
0.4
0.2
0.2
0.2
0.4
combine Sort
0.4
0.2
0.4 0.6
combine
0.6
0.4
Sort
1
combine
Assign code
0
1
1
00
01
1
000
001
01
1
000
01
0010
0011
1
000
01
0010
0011
![Page 20: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/20.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Variable Length Coding (Huffman Coding)
Avg length code: 0.4x1 + 0.2x2 + 0.2x3 + 0.1x4 + 0.1x4
= 2.2 bits
Example:
![Page 21: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/21.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Variable Length Coding (Huffman Coding) Example:
Entropy A measure of information that captures uncertainity [I(e) = log (1/P(e))]
![Page 22: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/22.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Variable Length Coding (Huffman Coding)
Decoding Example:
00111010001
?
![Page 23: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/23.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Variable Length Coding (Huffman Coding)
Decoding Example:
00111010001
0 1
a2
a1
a3
a4 a5
0
0
1
1
1
0
Root
![Page 24: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/24.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Variable Length Coding (Huffman Coding)
Decoding Example:
00111010001
0 1
a2
a1
a3
a4 a5
0
0
1
1
1
0
Root
a5
a2 a1
a3 a2
![Page 25: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/25.jpg)
ImageCompression
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
![Page 26: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/26.jpg)
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
AudioDigital Representation Audio (Sound): continuous signal (wave form) in time 1D function f(x)
Con3nuous
Slide7Lecture1 Discrete
![Page 27: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/27.jpg)
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
Image
x
y
2D function f(x,y)
Sampling: Discretization in x and y Quantization
Slide16Lecture1
![Page 28: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/28.jpg)
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
VideoVideo is a sequence of images in time
Slide23Lecture1Time
Image (Frame)
![Page 29: Special Module on Media Processing and Communicationpkalra/siv864/pdf/lec2.pdf · • Interpixel Neighboring pixels are similar • Psychovisual Human visual perception - limited](https://reader034.vdocuments.us/reader034/viewer/2022042214/5ebadd5c1fed5719c12b166b/html5/thumbnails/29.jpg)
Special Module on Media Processing and Communication http://www.cse.iitd.ac.in/~pkalra/sil864
GraphicsGeometryData:Meshes
• Points• Connec3vity
Slide26Lecture1