![Page 1: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/1.jpg)
Motion Vector Refinement for High-Performance Transcoding
Jeongnam Youn, Ming-Ting Sun, Fellow,IEEE, Chia-Wen Lin
IEEE TRANSACTIONS ON MULTIMEDIA, MARCH 1999
![Page 2: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/2.jpg)
Introduction Transcoding, a process of converting a prev
iously compressed bit-stream into a lower bit-rate bit-stream.
![Page 3: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/3.jpg)
simply reusing the motion vectors extracted from an incoming video bit stream may not result in the best quality.
We propose a fast-search adaptive motion vector refinement scheme that is capable of providing video quality comparable to that can be achieved by performing a new full-scale motion estimation but with much less computation.
![Page 4: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/4.jpg)
Motion Estimation in Transcoding
![Page 5: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/5.jpg)
Structure of a cascaded transcoder
![Page 6: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/6.jpg)
![Page 7: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/7.jpg)
Motion Vector Refinement (MVR)
Refining the incoming motion vector within a small range.
(Bx,By) : base motion vector obtained from the incoming bit stream.
(Dx,Dy) : delta motion vector estimated within a new search window SR.
![Page 8: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/8.jpg)
The performance of motion vector refinement.
Degradation0.45 dB
![Page 9: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/9.jpg)
Motion Vector Refinement in Frame-Rate Conversion To transport video over low bandwidth cha
nnels, a high transcoding ratio is required. Frame-rate reduction is often used as an eff
icient scheme to allocate more bits to the remaining frames.
When some incoming frames are dropped for the frame rate conversion, the incoming motion vectors are not valid.
![Page 10: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/10.jpg)
![Page 11: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/11.jpg)
Forward dominant vector selection (FDVS) Select one dominant motion vector from th
e four neighboring macroblocks. The dominant macroblock is a macroblock
that has the largest overlapping segment with the block pointed by the incoming motion vector.
A dominant motion vector is defined as the motion vector carried by a dominant macroblock.
![Page 12: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/12.jpg)
![Page 13: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/13.jpg)
![Page 14: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/14.jpg)
Performance comparison of the proposed FDVS and the bilinear interpolation motion vector composition
![Page 15: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/15.jpg)
Foreman 1.7 dB
Carphone 0.8dB
Performance comparison of motion vector composition methods (constant bitrate)
![Page 16: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/16.jpg)
Motion Vector Refinement for the Composed Motion Vector
(Vx,Vy) : the dominant motion vector at the frame (n-d)
(Ix,Iy) :theincoming motion vector of the frame (n)
![Page 17: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/17.jpg)
![Page 18: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/18.jpg)
Full-scale ME (29.29dB)
FDVS with MVR (28.90 dB)
Quality of the picture with the worst PSNR drop (frame number 34)
![Page 19: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/19.jpg)
Adaptive Motion Vector Refinement
![Page 20: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/20.jpg)
When the quantization step size difference is small, the distortion caused by the reuse of incoming motion vector is small.
Sum of differential reconstruction error (SDRE)
![Page 21: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/21.jpg)
![Page 22: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/22.jpg)
Fast Search Algorithm To reduce computational complexity by
minimizing the number of required checking points.
Horizontal and vertical search (HAVS) scheme.
Only when the computed SAD on the left side is larger than that of the starting point, the points on the right side are searched.
![Page 23: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/23.jpg)
5 checking points are required (best case)
![Page 24: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/24.jpg)
7 checking points are required (worst case)
![Page 25: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/25.jpg)
Simulation Results
![Page 26: Motion Vector Refinement for High-Performance Transcoding](https://reader035.vdocuments.us/reader035/viewer/2022062408/568135e4550346895d9d57f1/html5/thumbnails/26.jpg)
Conclusion Motion vector refinement (MVR) Forward dominant vector selection
composition method (FDVS) Adaptive motion vector refinement
scheme Fast-search algorithm