video encoding: basic principles - xiph.org foundation · video encoding: basic principles wavelet...
TRANSCRIPT
![Page 2: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/2.jpg)
Video encoding: basic principles
Color coding
![Page 3: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/3.jpg)
Video encoding: basic principles
Color coding
Human eye color perception
![Page 4: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/4.jpg)
Video encoding: basic principles
Color coding
Human eye Colour x Luminance perception
![Page 5: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/5.jpg)
Video encoding: basic principles
Color coding
Human eye Colour x Luminance perception
R (8 bits) G (8 bits) B (8 bits)
Each color is coded separately
Y (8 bits) Cb (4 bits) Cr (4 bits)
Y : LuminanceCb : Blue colorCr : Red color
Green color is presense of luminance and absence of Blue and Red color
![Page 6: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/6.jpg)
Video encoding: basic principles
Digital signals / sampling
![Page 7: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/7.jpg)
Video encoding: basic principles
Digital signals / sampling
![Page 8: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/8.jpg)
Video encoding: basic principles
Sampling Aliasing:
Sample rate must be twice as input bandwidth
Digital signals / sampling
![Page 9: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/9.jpg)
Video encoding: basic principles
Sampling images
Digital signals / sampling
![Page 10: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/10.jpg)
Video encoding: basic principles
7 possible quantized amplitude values: need 3 bits to represent
Quantizing
![Page 11: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/11.jpg)
Video encoding: basic principles
Multiplexing
![Page 12: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/12.jpg)
Video encoding: basic principles
Fourrier Transform
![Page 13: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/13.jpg)
Video encoding: basic principles
Fourrier Transform
![Page 14: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/14.jpg)
Video encoding: basic principles
Fourrier Transform
The transform must consider the complete signal historyto get the exact frequencies in the signal.
To apply the transform we must known the signal behavior since -∞ to +∞
Is it possible ?
And, what if the signal behaves like this :
![Page 15: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/15.jpg)
Video encoding: basic principles
Windowing
The windowing must be applied in the signal beforethe Fourrier transform, to focalize the analysis
![Page 16: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/16.jpg)
Video encoding: basic principles
Windowing
The windowing can be used to divide the signal in small pieces, and transform them separately
![Page 17: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/17.jpg)
Video encoding: basic principles
Windowing
Another way to view:
![Page 18: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/18.jpg)
Video encoding: basic principles
Windowing
The Heisenberg uncertainty principle states that: the knowledge of the position of a particle is inversely proportional to the knowledge of its energy
It is the same to say:knowledge about time is inversely proportional toknowledge about frequency
Position knowledge is relative to time
Energy knowledge is related to frequency
![Page 19: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/19.jpg)
Video encoding: basic principles
Windowing
![Page 20: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/20.jpg)
Video encoding: basic principles
Pre-echo
![Page 21: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/21.jpg)
Video encoding: basic principles
Fourrier Transform in a image
![Page 22: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/22.jpg)
Video encoding: basic principles
Fourrier Transform in a image
![Page 23: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/23.jpg)
Video encoding: basic principles
Fourrier Transform in a image
![Page 24: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/24.jpg)
Video encoding: basic principles
Fourrier Transform in a image
![Page 25: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/25.jpg)
Video encoding: basic principles
Fourrier Transform in a image
This picture is the cover of book: MPEG-2 , John Watkinson , Focal Press
![Page 26: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/26.jpg)
Video encoding: basic principles
Wavelet transform
Wavlet dont use endless sine wave functions as its basis, but instead, use functions that are finite on time axis.
The window lenght is variable and is inversely proportional to the frequency.
High frequencies are transformed with short basis functionsand therefore are accurately located. Low frequencies are transformed with long basis functions which have good frequencyresolution.
![Page 27: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/27.jpg)
Video encoding: basic principles
Frame subdivision
![Page 28: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/28.jpg)
Video encoding: basic principles
Frame subdivision
Subdivision of a Frame into blocks and super blocksEach color plane has its own set of blocks and super blocks
![Page 29: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/29.jpg)
Video encoding: basic principles
Intra Frame
Intra-coding explores redundancy within a picture
![Page 30: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/30.jpg)
Video encoding: basic principles
Inter Frame
Inter-coding explores redundancy between pictures
![Page 31: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/31.jpg)
Video encoding: basic principles
Inter Frame
Golden Frame (intra)
Inter Frames
Coded frame
Inter Frames
![Page 32: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/32.jpg)
Video encoding: basic principles
Inter Frame
![Page 33: Video encoding: basic principles - Xiph.Org Foundation · Video encoding: basic principles Wavelet transform Wavlet dont use endless sine wave functions as its basis, but instead,](https://reader035.vdocuments.us/reader035/viewer/2022063010/5fc2a4122df656188f6772d2/html5/thumbnails/33.jpg)
Video encoding: basic principles
References
● Theora I Specification; Xiph.org Foundation
● John Watkinson; MPEG-2 ; Focal Press
● Martin Ruckert; Understanding MP3: Syntax, Semantics,
Mathematics, and Algorithms ; Viewg
● http://www.animemusicvideos.org/guides/avtech/video3.htm
● http://www.complextoreal.com/tutorial.htm
● http://cns-alumni.bu.edu/~slehar/fourier/fourier.html