presented by: doron brot, maimon vanunu, elia tzirulnick supervised by: johanan erez, ina krinsky,...
Post on 20-Dec-2015
216 views
TRANSCRIPT
![Page 1: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/1.jpg)
Presented by:
Doron Brot, Maimon Vanunu, Elia Tzirulnick
Supervised by:
Johanan Erez, Ina Krinsky, Dror Ouzana
Vision & Image Science Laboratory, Department of Electrical Engineering,Technion
![Page 2: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/2.jpg)
Steps to achieve the goal
Aims and motivation of the project
Algorithm for Traffics Signs Recognition
Results
Conclusions
![Page 3: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/3.jpg)
Control a self navigating vehicle according to traffic signs
![Page 4: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/4.jpg)
![Page 5: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/5.jpg)
• Build a controllable vehicle.
• Attach a wireless camera to the vehicle.
• Capture pictures from camera to computer.
• Analyze the visual data and translate it into controlling commands for the vehicle
![Page 6: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/6.jpg)
Build a controllable vehicle.
Mindstorms Robot Mindstorms Robot Invention System Invention System
![Page 7: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/7.jpg)
Build a controllable vehicle
![Page 8: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/8.jpg)
Build a controllable vehicle.
Communication to PC through Infra-red transmitter.
![Page 9: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/9.jpg)
Attach a wireless camera to the vehicle.
WAT-207CD CCD Color Camera
Wireless video transmitter
![Page 10: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/10.jpg)
Attach a wireless camera to the vehicle.
Wireless connection between camera and PC
![Page 11: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/11.jpg)
Capture pictures from camera to computer.
VideoOCX® software can handle all kinds of ‘Video for Windows’ ® compatible devices.
Flyvideo 98 video capture card
Microsoft Visual Basic 6.0
Phantom- a set of functions for the VB 6.0 that helps us control the LEGO™ vehicle.
![Page 12: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/12.jpg)
Analyze the visual data and translate it into controlling commands for the vehicle
Calculate the distance of the vehicle from traffic sign.
Capture one frame from the video camera.
Decide whether there is a traffic sign in the frame or not.
If there is, recognize the traffic sign.
NO
X
25 cm
GO RIGHT
If vehicle is close enough to the sign
send control command to RCX.
YES
![Page 13: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/13.jpg)
• How humans see colors.
• Conversion from RGB to HSV color space.
• Use Saturation in order to find colored areas in frame.
• Analyze the colored areas according to Hue.
• Recognize traffic sign.
• Sum colored pixels to calculate distance to the traffic sign.
• Send control command according to recognized sign.
![Page 14: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/14.jpg)
The human eye
![Page 15: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/15.jpg)
Visible Light
![Page 16: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/16.jpg)
The Retina
שני סוגי קולטנים:
(Rodsקנים )•
(Conesמדוכים )•
![Page 17: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/17.jpg)
הקולטנים ברשתית
-http://wwwמקור: cvrl.ucsd.edu/
![Page 18: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/18.jpg)
![Page 19: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/19.jpg)
Image representation in computer file – graylevel image.
![Page 20: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/20.jpg)
Image representation in computer file – color image.
![Page 21: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/21.jpg)
RGB values of traffic sign images
Not very helpful !
![Page 22: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/22.jpg)
Conversion from RGB to HSV color space.
The HSV color space )hue, saturation, value( is often used by people because it corresponds better to how people experience color than the RGB color space does.
![Page 23: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/23.jpg)
As hue varies, the corresponding colors vary from red, through yellow, green, cyan, blue, and magenta, back to red.
Understanding HSV color space
![Page 24: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/24.jpg)
As saturation varies, the corresponding colors )hues( vary from unsaturated )shades of gray( to fully saturated )no white component(.
Understanding HSV color space
![Page 25: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/25.jpg)
As value, or brightness, varies, the corresponding colors become increasingly brighter.
Understanding HSV color space
![Page 26: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/26.jpg)
Use Saturation in order to find colored areas in each frame.
![Page 27: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/27.jpg)
Analyze the colored areas according to Hue.
Recognize traffic sign. For example:
If the hue value of any pixel is between 200 and 250 that means that the color is red so we painted the pixel pure red.
![Page 28: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/28.jpg)
Sum colored pixels to calculate distance to the traffic sign.
Send control command according to recognized sign.
If number of colored pixels suits a known sign, in a sufficient distance
Example:
Blue – 434 pixels
Red – 591 pixels
![Page 29: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/29.jpg)
Graphical User Interface - GUI
![Page 30: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/30.jpg)
The navigating vehicle.
![Page 31: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/31.jpg)
• Successful recognition of traffic signs of different colors.
• White – gray background was helpful.
• For real traffic sign recognition more sophisticated algorithms have to be used )colored background, real-time processing etc(.
• The vehicle can only recognize the traffic signs we programmed it to )“Turn Right”, “No Parking” and “Stop”(.
![Page 32: Presented by: Doron Brot, Maimon Vanunu, Elia Tzirulnick Supervised by: Johanan Erez, Ina Krinsky, Dror Ouzana Vision & Image Science Laboratory, Department](https://reader035.vdocuments.us/reader035/viewer/2022062421/56649d445503460f94a20860/html5/thumbnails/32.jpg)
http://visl.technion.ac.il/projects/scitech02
We would like to thank our mentors: Johanan Erez, Ina Krinsky and Dror Ouzana.
Thanks to our counselors: Adva, Eran , May-Tal and koby.
Thanks to Ort Management.
We would also like to thank the Ollendorff Research Center for its support.