enee408g: capstone design project: multimedia signal processing design project 2:
DESCRIPTION
ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2: Video Processing. Today’s Schedule. Introduction to Design Project 2 Check in Digital Camera and Pocket PC Check out PC camera and Pocket PC. Outline of Design Project 2. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/1.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 1
ENEE408G: Capstone Design Project:
Multimedia Signal Processing
Design Project 2:Video Processing
![Page 2: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/2.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 2
Today’s Schedule
Introduction to Design Project 2 Check in Digital Camera and Pocket PC Check out PC camera and Pocket PC
![Page 3: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/3.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 3
Outline of Design Project 2
Part I : Video Capturing by PC Camera Part II : Motion Estimation and
Compensation Part III: MPEG Video Part IV: Detect Scene Change in Video Part V: Mobile Computing and Pocket PC
Programming Bonus Part I : MPEG-7 Visual Descriptor Bonus Part II: Video Conference
![Page 4: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/4.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 4
Part I. Video Capturing by PC Camera
![Page 5: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/5.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 5
Pat II. Motion Estimation and Compensation
Inter-Frame Encoder
DCT QuantizationEntropyCoding
Inversequantization
+ DCT
FrameMemory
MotionCompensation
MotionEstimation
+
+
Reconstructed motioncompensated residualestimated
motionvectors
reconstructed motioncompensated
reference frame
MotionCompensated
residual
motioncompensatedmacroblocks
Originalmacroblocks
of pixels
EncodedInterframe_
![Page 6: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/6.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 6
ME: Exhaustive Block Matching
Reference Frame Current Frame
R R-1
R
N1
N 2
R-1
![Page 7: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/7.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 7
ME: Example
Reference Frame Current Frame
![Page 8: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/8.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 8
Exhaustive Block Matching (cont.1)
Demo: http://www.ece.umd.edu/class/enee408g/labs/
labV/Motion_Estimation_v3.exe http://www.ece.umd.edu/class/enee408g/labs/
labV/motion_estimation_3step.exe
![Page 9: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/9.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 9
Exhaustive Block Matching (cont.2)
0 2 4 6 8 10 12 14 160
2
4
6
8
10
12
14
16
18
Reference Frame Current Frame Motion Vectors
![Page 10: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/10.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 10
Motion Compensation
Estimated frame Residual
![Page 11: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/11.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 11
3-step approach
1
11
11
1
1 1
22
2
2 2 2
2
2
3
33
3
3
33
3
1
Search points in step 1
Search points in step 2
Search points in step 3
1
2
3
![Page 12: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/12.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 12
Part III.MPEG Video
MPEG-1 Video Use mpgwrite.m and mpgread.m. Tradeoff between bit rate and quality
![Page 13: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/13.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 13
Part IV. Detect Scene Change
Cut Scene Change Dissolve Scene Change Wipe Scene Change Multi-scene Change Design scene change detector
Hint: Use statistical characteristics for each frame
![Page 14: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/14.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 14
Part V. Pocket PC Programming
Apply what you learned from previous parts and design a simple application related to digital video processing by Microsoft eMbedded Tools for Pocket PC.
![Page 15: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/15.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 15
Bonus Part I. MPEG-7 Visual Descriptor
MPEG-7 Texture Descriptor http://nayana.ece.ucsb.edu/M7TextureDemo/Dem
o/client/M7TextureDemo.html
MPEG-7 Shape Descriptor http://
www.ee.surrey.ac.uk/Research/VSSP/imagedb/demo.html
![Page 16: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/16.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 16
MPEG-7 Texture Descriptor
![Page 17: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/17.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 17
MPEG-7 Shape Descriptor
![Page 18: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/18.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 18
Bonus Part II. Video Conference
Experience video conferencing using
Microsoft NetMeeting
Two scenarios:
video conferencing with different image modes
video conferencing with different available
bandwidths Do this part at home
![Page 19: ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2:](https://reader036.vdocuments.us/reader036/viewer/2022062408/5681449e550346895db15424/html5/thumbnails/19.jpg)
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 19
PC Camera / Digital Camera
Digital Camera and Pocket PC Check In PC Camera and Pocket PC Check Out