video compression: performance evaluation of available codec software sridhar godavarthy
TRANSCRIPT
Video Compression: Performance evaluation
of available codec software
Sridhar Godavarthy
Introduction
04/20/23 3
What is Video? Series of framed images, put together one after the other to
simulate motion.
Takes advantage of the spatio-temporal properties of the human eye to simulate continuity in motion.
Several standards for television exist, which define the frame rate of the video being displayed.
e.g.: NTSC, PAL
The frame rate varies from 25fps to 60fps depending on the standard.
04/20/23 4
Compression - Why
Staggering amount of data.
Uncompressed data for 1.5hrs exceeds DVD.
Human eye does not recognize.
Waste of Bandwidth.
04/20/23 5
Lossy Lossless
General • Run Length, Huffman
Psychovisual• Lossy
• WMV, MPEG
Intraframe• Subsampling, Quantization,Transforms
Interframe• Difference Coding, Motion compensation
Compression - How
04/20/23 6
Video Encoding Formats
1) MPEG-1
2) MPEG-2
3) MPEG-4
4) H.263
5) ASF
6) WMV
and lots more…
04/20/23 7
What is a Codec? Coder Decoder.
Capable of encoding and decoding.
H/W or S/W.
Several codecs for each format.
Separate for audio/video.
04/20/23 8
Containers
Used to hold combination of video and audio ( also subtitles and other meta data).
Some formats are capable of holding different formats of audio and video but mostly fixed.
Decide the extensions.
.avi, .mov, .mp4
04/20/23 9
Evaluation Parameters
• Video Quality- MSE
- PSNR
- Absolute Colour Distance
- Structural Similarity
• Codec Performance- File Size
- Compression/Decompression time
Data Sets
04/20/23 11
Resolution Evaluation
04/20/23 12
Performance Evaluation
04/20/23 13
Evaluation Parameters Contd…
• Mean Squared Error- Measure of amount by which result differs from original.
- Second moment and indicates variance.
04/20/23 14
Evaluation Parameters Contd…
• Peak Signal to Noise Ratio- Measure of peak signal to the noise introduced by compression.
- High dynamic range. Expressed in db.
04/20/23 15
Evaluation Parameters Contd…
• Mean Absolute Difference of colour components
04/20/23 16
Evaluation Parameters Contd…
• Structural Similarity(SSIM)
– Function of luminance, contrast and structural similarity.
04/20/23 17
Evaluation Parameters Contd…
• Bitrates
- 600 kbps
- 1000kbps
- 3000kbps
04/20/23 18
Evaluation Parameters Contd…
• Size of compressed video
• Time for compression (encoding)
• Time for decompression (decoding)
04/20/23 19
Mean Squared ErrorF ootball MS E
0
1
2
3
4
5
6
7
8
9
10
600 1000 3000
wmv2
Theora
as f
mpeg4
Qt
mpeg1
Akio MSE
0
0.5
1
1.5
2
2.5
600 1000 3000
wmv2
theora
asf
mpeg4
qt
mpeg1
F oreman MS E
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
5
600 1000 3000
wmv2
Theora
as f
mpeg4
Qt
mpeg1
Stephan MSE
0
2
4
6
8
10
600 1000 3000
wmv2
theora
asf
mpeg4
qt
mpeg1
04/20/23 20
Peak Signal to Noise Ratio
F ootball P S NR
36
37
38
39
40
41
42
43
600 1000 3000
wmv
Theora
as f
mpeg4
Qt
mpeg1
Akio PSNR
43
44
45
46
47
48
600 1000 3000
wmv2
theora
asf
mpeg4
qt
mpeg1
F oreman P S NR
39
40
41
42
43
44
45
46
47
600 1000 3000
wmv2
Theora
as f
mpeg4
Qt
mpeg1
Stephan PSNR
36373839404142434445
600 1000 3000
wmv2
theora
asf
mpeg4
qt
mpeg1
04/20/23 21
Absolute Color Distance
F ootball Abs olute C olor Dis tanc e
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
5
600 1000 3000
wmv2
theora
as f
mpeg4
Qt
mpeg1
Akio Absolute Color Distance
0
0.2
0.4
0.6
0.8
1
1.2
600 1000 3000
wmv2
theora
asf
mpeg4
qt
mpeg1
F oreman Abs olute C olor Dis tanc e
0
0.5
1
1.5
2
2.5
3
600 1000 3000
wmv2
theora
as f
mpeg4
Qt
mpeg1
Stephan Absolute Color Distance
0
1
2
3
4
5
600 1000 3000
wmv2
theora
asf
mpeg4
qt
mpeg1
04/20/23 22
Structural SimilarityF ootball S S IM
0.88
0.9
0.92
0.94
0.96
0.98
1
600 1000 3000
wmv2
Theora
as f
mpeg4
Qt
mpeg1
Akio SSIM
0.996
0.9965
0.997
0.9975
0.998
0.9985
0.999
0.9995
1
600 1000 3000
wmv2
theora
asf
mpeg4
qt
mpeg1
F oreman S S IM
0.975
0.98
0.985
0.99
0.995
1
1.005
600 1000 3000
wmv2
Theora
as f
mpeg4
Qt
mpeg1
Stephan SSIM
0.88
0.9
0.92
0.94
0.96
0.98
1
1.02
600 1000 3000
wmv2
theora
asf
mpeg4
qt
mpeg1
04/20/23 23
File Sizes
0 100 200 300 400
Size in KB
1
W-W File Sizes
mpeg-1
Qt
mpeg-4
asf
theora
w mv2
0 200 400 600 800 1000 1200 1400 1600
Size in KB
1
B-W File Sizes
mpeg-1
Qt
mpeg-4
asf
theora
wmv2
0 500 1000 1500 2000 2500 3000
Size in KB
1
C-C File Sizes
mpeg-1
Qt
mpeg-4
asf
theora
w mv2
0 5000 10000 15000 20000
Size in KB
1
C-N File Sizes
mpeg-1
Qt
mpeg-4
asf
theora
wmv2
04/20/23 24
Conclusion• Selection of format depends on
- Application Transmission Video Conferencing Archiving - Bandwidth Availability Internet Video Over IP Disc Viewing
- Performance Requirements Real time video processing for UAVs etc. Video Viewing
- Quality requirements Entertainment Conferencing Surgical procedures
04/20/23 25
Things I wanted to doMSE
PSNR
Blocking
Blurring
Encoding Time
Size
Vary Bitrates
SSIM
Absolute Color Distance
Decoding Time
Vary FrameCount
Vary FrameSize
Operating Characteristics
√
√
√
√
√
√
1
3
4
5
7
6
8
2
9
10
11
12
13
Merci Beaucoup