an efficient search strategy for block motion estimation using image features digital video...
TRANSCRIPT
![Page 1: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/1.jpg)
An Efficient Search Strategy for Block Motion Estimation Using
Image FeaturesDigital Video Processing 1 Term Project
Feng LiMichael Su
Xiaofeng Fan
![Page 2: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/2.jpg)
Fast Search in Block Motion Estimation
Block motion estimation using the full search is very computational demanding. 225 search points in a 15x15 search window with
displacement vectors from -7 to 7 in X, Y directions.
Fast search algorithms to reduce the amount of computations by limiting the number of locations to be searched.
Fast search algorithms can be trapped on the local minimum in the search process.
![Page 3: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/3.jpg)
Nonuni-modal error surface tested by a checking block
![Page 4: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/4.jpg)
MAD error surface for two different blocks
![Page 5: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/5.jpg)
Fast search improvement
Place the checking point as close as possible to the global minimum.
Multiple starting search points.Eliminate the unnecessary starting points
using image features. Points, Lines and Edges can be used as
the image features.
![Page 6: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/6.jpg)
Regular Starting point pattern: Starting points distribute evenly across the search window
![Page 7: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/7.jpg)
Image Features Edge-Assisted Search (EAS)
Edges are used as the image features.The number of search points are dynamic
on each block.Less search points are used for smooth
region.More search points are needed in blocks
containing many edges and motions.
![Page 8: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/8.jpg)
Image Features Edge-Assisted Search (EAS)
Image preprocessing Smoothing of the frame. Edge Detection using 3x3 Sobel gradient
convolution masks.
1 2 1 1 0 1
0 0 0 2 0 2
1 2 1 1 0 1x yg g
' '( , ) ( , )t t x t yS I i j g I i j g
![Page 9: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/9.jpg)
Adjustment of the Regular Starting Point Pattern
Convert into the binary image by threshold. Edge matching score (EMS) to eliminate the
unnecessary starting points.
1 ( ( , ))( , )
0t e
t
if S i j TB i j
otherwise
1 1 1 1
10 0 0 0
( , ) ( , ) ( , )N N N N
t ti j i j
EMS u v B i j B i u j v
min_ _ _k k in updated SPPG MAD MAD
![Page 10: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/10.jpg)
Flowchart of the EAS
![Page 11: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/11.jpg)
Example 1
![Page 12: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/12.jpg)
Image Block (15X15) and edge difference distribution
![Page 13: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/13.jpg)
Image Block (25X25) and edge difference distribution
![Page 14: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/14.jpg)
Block Intensity difference
![Page 15: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/15.jpg)
Test result 1: Displacement Vectors for Example 1
![Page 16: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/16.jpg)
Example 2
![Page 17: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/17.jpg)
Test result 2: Displacement Vectors for Example 2
![Page 18: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/18.jpg)
Performance Evaluation
0.00
5.00
10.00
15.00
20.00
25.00
30.00
35.00
40.00
45.00
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49
Full
3step
Diomand
EAS+3step
0.00
5.00
10.00
15.00
20.00
25.00
30.00
35.00
40.00
45.00
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55
EAS+3step
![Page 19: An Efficient Search Strategy for Block Motion Estimation Using Image Features Digital Video Processing 1 Term Project Feng Li Michael Su Xiaofeng Fan](https://reader035.vdocuments.us/reader035/viewer/2022062517/56649f135503460f94c26c22/html5/thumbnails/19.jpg)
Thank you
Questions?