Download - Senior Thesis Conference
![Page 1: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/1.jpg)
Senior Thesis ConferenceMarch 27, 2009
Mentors: Prof. Rama Chellappa Prof. Cha-Min Tang
Consultants: Aswin SankaranarayananPavan Turaga
Librarians:Bob KackleyDan Newsome
Discussants: Prof. David JacobsDr. Ashok VeeraraghavanProf. Larry DavisProf. Ankur SrivastavaMr. Bobby Bobo
Team Vision: Steve Caperna, Christopher Cheng, Junghee Cho, Victoria Fan, Avishkar Luthra, Brendan O’Leary, Jansen Sheng, Lee Stearns, Andrew Sun, Roni Tessler, Paul Wong, and Jimmy Yeh
![Page 2: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/2.jpg)
Research Question
How can technology address the needs of the visually impaired?
![Page 3: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/3.jpg)
![Page 4: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/4.jpg)
The White Cane Other Commercial Navigation Solutions
![Page 5: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/5.jpg)
Subjects
Subject Data
– Adaptive Technology Lab at the University of Maryland and the Columbia Lighthouse for the Blind in Riverdale, Maryland
– 24-61 years old– High level of interest in our project – Stressed the importance of having options to navigate more
independently – To be a helpful navigational aid it must be unobtrusive and highly
functional– Focus on Indoor Object Detection and Outdoor Navigation
![Page 6: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/6.jpg)
Object Identification and Location System
Computer Vision
Algorithm
Speech Output
Push-to-TalkVoice Input
Camera
Audio Feedback
ImageDatabase
User Interface
![Page 7: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/7.jpg)
Objects and Landmarks to Identify
![Page 8: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/8.jpg)
An Early Test of Our Vision Algorithm
![Page 9: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/9.jpg)
The SIFT Computer Vision Algorithm
CameraFeed SIFT BBF RANSAC 3D
TransformObject
Location
1 2 3 4 5 6
![Page 10: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/10.jpg)
The Discrete Speech Interface
![Page 11: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/11.jpg)
The Continuous Beacon Interface
![Page 12: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/12.jpg)
Sign Experiment Setup 3D Object Experiment Setup
![Page 13: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/13.jpg)
Locating a Restroom Sign
![Page 14: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/14.jpg)
Locating a Cane
![Page 15: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/15.jpg)
![Page 16: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/16.jpg)
Initial Results:
Discrete Mode:
Average Location Time: 16 sec
Continuous Mode:
Average Location Time: 12 sec
With Consistent Tracking: 5 sec
![Page 17: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/17.jpg)
Door Experiment
![Page 18: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/18.jpg)
CameraFeed SIFT BBF RANSAC 3D
TransformObject
Location
1 2 3 4 5 6
![Page 19: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/19.jpg)
Computer Vision
Algorithm
Speech Output
Push-to-TalkVoice Input
Camera
Audio Feedback
ImageDatabase
User Interface
System Diagram
![Page 20: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/20.jpg)
GPSAlgorithm
Computer Vision
Algorithm
GPS ReceiverInertial Navigation Unit
Speech Output
Push-to-TalkVoice Input
Camera
Audio Feedback
Graph
ImageDatabase
User Interface
System Diagram
![Page 21: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/21.jpg)
GPSAlgorithm
Computer Vision
Algorithm
GPS ReceiverInertial Navigation Unit
Speech Output
Push-to-TalkVoice Input
Camera
Audio Feedback
Graph
ImageDatabase
User Interface
Haptic Feedback
System Diagram
![Page 22: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/22.jpg)
Haptic Feedback Belt
![Page 23: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/23.jpg)
A Complete Navigation System for the Blind
GPSAlgorithm
Computer Vision
Algorithm
GPS ReceiverInertial Navigation Unit
Speech Output
Push-to-TalkVoice Input
Camera
Audio Feedback
Graph
ImageDatabase
User Interface
Haptic Feedback
System Diagram
![Page 24: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/24.jpg)
Objects and Landmarks to Identify
![Page 25: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/25.jpg)
![Page 26: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/26.jpg)
GPS Navigation
![Page 27: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/27.jpg)
SIFT Terminal Navigation
![Page 28: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/28.jpg)
Outdoor Testing
![Page 29: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/29.jpg)
Outdoor Testing
![Page 30: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/30.jpg)
A Complete Navigation System for the Blind
GPSAlgorithm
Computer Vision
Algorithm
GPS ReceiverInertial Navigation Unit
Speech Output
Push-to-TalkVoice Input
Camera
Audio Feedback
Graph
ImageDatabase
User Interface
Haptic Feedback
![Page 31: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/31.jpg)
A Demonstration of Our Object Detection Algorithm
![Page 32: Senior Thesis Conference](https://reader035.vdocuments.us/reader035/viewer/2022062305/56816371550346895dd44df2/html5/thumbnails/32.jpg)
A Demonstration of Our Speech Menu