Download - Conceptual and Experimental Vision
![Page 1: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/1.jpg)
Conceptual and Experimental Vision
IntroductionR.Bajcsy, S.Sastry and A.Yang
Fall 2006
![Page 2: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/2.jpg)
Introduction and plan for the course
• We plan to follow the text :An Invitation to 3-D Vision by Yi Ma, Stefano Soatto,Jana Kosecka and S.S.Sastry.
• Plus some additional papers on real time, Active Vision.• Approximately every two weeks there will be a problem
set and programming homework assignment• There will no midterm and final, but projects instead.
Students are expected to participate in the class.
![Page 3: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/3.jpg)
The proposed Syllabus
• Week 1: Introduction• Week 2: Image formation : geometry, optics ,
Radiometry and error analysis • Week 3: Image primitives and correspondence• Week 4: Review of basic algebra and geometry• Week 5 :Epipolar geometry• Week 6: Camera calibration• Week 7: Structure from motion• Week 8: Optimization
![Page 4: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/4.jpg)
Syllabus cont.,
• Week 9: Real Time Vision• Week 10: Visual feedback• Week 11: Active Vision• Week 12: Introduction to GPCA: Iterative methods • Week 13: Introduction to GPCA:Algebraic Methods • Week 14: Estimation and Segmentation of Hybrid
Models, and Applications • Week 15:Projects
![Page 5: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/5.jpg)
Our expectation
• Through this course, students should acquire the ability to study computer vision through rigorous mathematical frameworks.
• By the end of the course, students should be familiar with the history of computer vision, the start-of-the-art performance of current vision systems, and important open problems in the literature.
• Experimentally, students should be able to setup a stereo camera system, evaluate its characteristics, calibrate it, and reconstruct motions of single and multiple objects.
![Page 6: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/6.jpg)
What is Vision?
• From the 3-D world to 2-D images: image formation (physics).
• Domain of artistic reproduction (synthesis): painting, graphics.
• From 2-D images to the 3-D world: image analysis and reconstruction (mathematical modeling, inference).
• Domain of vision: biological (eye and brain) computational
![Page 7: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/7.jpg)
Topics from a vision conf.: CVPR06
![Page 8: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/8.jpg)
CVPR 2006 cont.
![Page 9: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/9.jpg)
CVPR 2006 cont.
![Page 10: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/10.jpg)
CVPR 2006 cont.
![Page 11: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/11.jpg)
What we will cover
• Geometry• Stereo and 3D reconstruction• Matching and Registration• Segmentation• Real time considerations• Visual feedback and control• Error analysis of the sensor system
![Page 12: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/12.jpg)
What we will not cover
• Recognition• Learning• Tracking and video analysis• Low level analysis an graphics and Image Synthesis
![Page 13: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/13.jpg)
Our Brain
![Page 14: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/14.jpg)
Our eye vs. Camera
![Page 15: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/15.jpg)
Multiple views
![Page 16: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/16.jpg)
Camera’s multiple views
![Page 17: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/17.jpg)
Illusions
![Page 18: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/18.jpg)
Illusions for Prof. Ramachandran
• http://psy.ucsd.edu/chip/video/Mot_Capt_LQ.rm
![Page 19: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/19.jpg)
What painters knew
![Page 20: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/20.jpg)
Perspective Imaging and other monocular cues
![Page 21: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/21.jpg)
Image Analysis
![Page 22: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/22.jpg)
3-D Modeling and Rendering
![Page 23: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/23.jpg)
3-D Modeling and Rendering
![Page 24: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/24.jpg)
Image Mosaicing and panoramic views
![Page 25: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/25.jpg)
3-D reconstruction
![Page 26: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/26.jpg)
3-D data acquisition and reconstruction
![Page 27: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/27.jpg)
Geometry and Photometry
![Page 28: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/28.jpg)
Compare recovered shape and laser scanned object
![Page 29: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/29.jpg)
Data Acquisition and integration of Indian Baskets
![Page 30: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/30.jpg)
Real Time Virtual Object Insertion
![Page 31: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/31.jpg)
UAV at Berkeley
![Page 32: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/32.jpg)
Vision based driving
![Page 33: Conceptual and Experimental Vision](https://reader036.vdocuments.us/reader036/viewer/2022062520/56815e05550346895dcc4ffc/html5/thumbnails/33.jpg)
Tele-Immersive environment for Communication