robotic guidance joe stawicki. project description teach a robot to guide a person to a predefined...
TRANSCRIPT
![Page 2: ROBOTIC GUIDANCE Joe Stawicki. PROJECT DESCRIPTION Teach a robot to guide a person to a predefined destination. The robot must use a cam and a vision](https://reader035.vdocuments.us/reader035/viewer/2022062308/56649d705503460f94a530bf/html5/thumbnails/2.jpg)
PROJECT DESCRIPTION
Teach a robot to guide a person to a predefined destination.
The robot must use a cam and a vision algorithm(s) as the main guidance.
Sensors such as bump, infra-red and ultra-sound could provide direction and safety for the robot.
The solution should be easily modified for alternative routes.
Check out Alexander Popov’s 2011 senior project for techniques about driving the robot.
![Page 3: ROBOTIC GUIDANCE Joe Stawicki. PROJECT DESCRIPTION Teach a robot to guide a person to a predefined destination. The robot must use a cam and a vision](https://reader035.vdocuments.us/reader035/viewer/2022062308/56649d705503460f94a530bf/html5/thumbnails/3.jpg)
MY SOLUTION
Turtlebot Kinect Sensor/Gyroscope ROS (Robot Operating System)
Moves the robot Gathers data
Kinect Sensor Gyroscope
Calculates the next position User Interface
SLAM (Simultaneous Localization and Mapping)
![Page 4: ROBOTIC GUIDANCE Joe Stawicki. PROJECT DESCRIPTION Teach a robot to guide a person to a predefined destination. The robot must use a cam and a vision](https://reader035.vdocuments.us/reader035/viewer/2022062308/56649d705503460f94a530bf/html5/thumbnails/4.jpg)
KINECT SENSOR
Variety of Sensors 3D depth sensors
Laser RGB camera Array of Microphones
![Page 5: ROBOTIC GUIDANCE Joe Stawicki. PROJECT DESCRIPTION Teach a robot to guide a person to a predefined destination. The robot must use a cam and a vision](https://reader035.vdocuments.us/reader035/viewer/2022062308/56649d705503460f94a530bf/html5/thumbnails/5.jpg)
SLAM
Simultaneous Localization and Mapping Build map of unknown
environment Uses Sensors
Keeps track of current location Based on what it sees/has seen
Navigate to a particular spot on the map
![Page 6: ROBOTIC GUIDANCE Joe Stawicki. PROJECT DESCRIPTION Teach a robot to guide a person to a predefined destination. The robot must use a cam and a vision](https://reader035.vdocuments.us/reader035/viewer/2022062308/56649d705503460f94a530bf/html5/thumbnails/6.jpg)
![Page 7: ROBOTIC GUIDANCE Joe Stawicki. PROJECT DESCRIPTION Teach a robot to guide a person to a predefined destination. The robot must use a cam and a vision](https://reader035.vdocuments.us/reader035/viewer/2022062308/56649d705503460f94a530bf/html5/thumbnails/7.jpg)
![Page 8: ROBOTIC GUIDANCE Joe Stawicki. PROJECT DESCRIPTION Teach a robot to guide a person to a predefined destination. The robot must use a cam and a vision](https://reader035.vdocuments.us/reader035/viewer/2022062308/56649d705503460f94a530bf/html5/thumbnails/8.jpg)
![Page 9: ROBOTIC GUIDANCE Joe Stawicki. PROJECT DESCRIPTION Teach a robot to guide a person to a predefined destination. The robot must use a cam and a vision](https://reader035.vdocuments.us/reader035/viewer/2022062308/56649d705503460f94a530bf/html5/thumbnails/9.jpg)
PROBLEMS
Network Issues (SNC Firewall)
Using ROS (Open Source) Weight Balance Issues
![Page 10: ROBOTIC GUIDANCE Joe Stawicki. PROJECT DESCRIPTION Teach a robot to guide a person to a predefined destination. The robot must use a cam and a vision](https://reader035.vdocuments.us/reader035/viewer/2022062308/56649d705503460f94a530bf/html5/thumbnails/10.jpg)
MORE WORK…
Calibration of the gyroscope
![Page 11: ROBOTIC GUIDANCE Joe Stawicki. PROJECT DESCRIPTION Teach a robot to guide a person to a predefined destination. The robot must use a cam and a vision](https://reader035.vdocuments.us/reader035/viewer/2022062308/56649d705503460f94a530bf/html5/thumbnails/11.jpg)
METHODOLOGY
Moving the Robot using Sasha’s project Assembling the Turtlebot ROS Installation ROS Tutorials Teleop/Navigation Adaptation to new environments Documentation
![Page 12: ROBOTIC GUIDANCE Joe Stawicki. PROJECT DESCRIPTION Teach a robot to guide a person to a predefined destination. The robot must use a cam and a vision](https://reader035.vdocuments.us/reader035/viewer/2022062308/56649d705503460f94a530bf/html5/thumbnails/12.jpg)
DEMO
![Page 13: ROBOTIC GUIDANCE Joe Stawicki. PROJECT DESCRIPTION Teach a robot to guide a person to a predefined destination. The robot must use a cam and a vision](https://reader035.vdocuments.us/reader035/viewer/2022062308/56649d705503460f94a530bf/html5/thumbnails/13.jpg)
RESOURCES
Sasha Popov Professors
Dr. Pankratz and Dr. McVey
Classmates ROS.org
Many tutorials/how-to’s/answers
Other online resources Trial and Error
![Page 14: ROBOTIC GUIDANCE Joe Stawicki. PROJECT DESCRIPTION Teach a robot to guide a person to a predefined destination. The robot must use a cam and a vision](https://reader035.vdocuments.us/reader035/viewer/2022062308/56649d705503460f94a530bf/html5/thumbnails/14.jpg)
KNOWLEDGE
Programming Languages (CS 322) Turtlebot software written in Python
Analysis of Algorithms (CS 321) Navigation
Operating Systems (CS 370) Linux and ROS
All Classes
![Page 15: ROBOTIC GUIDANCE Joe Stawicki. PROJECT DESCRIPTION Teach a robot to guide a person to a predefined destination. The robot must use a cam and a vision](https://reader035.vdocuments.us/reader035/viewer/2022062308/56649d705503460f94a530bf/html5/thumbnails/15.jpg)
EXTENSIONS
Voice Activation Other Turtlebot
Applications Object Avoidance Mobile Device Operation Turtlebot Arm
![Page 16: ROBOTIC GUIDANCE Joe Stawicki. PROJECT DESCRIPTION Teach a robot to guide a person to a predefined destination. The robot must use a cam and a vision](https://reader035.vdocuments.us/reader035/viewer/2022062308/56649d705503460f94a530bf/html5/thumbnails/16.jpg)
ADVICE FOR UPCOMING SENIORS
Start early Do little bits Weekly meetings are very helpful Document as you go When stuck, ask for help Enjoy it!!
![Page 17: ROBOTIC GUIDANCE Joe Stawicki. PROJECT DESCRIPTION Teach a robot to guide a person to a predefined destination. The robot must use a cam and a vision](https://reader035.vdocuments.us/reader035/viewer/2022062308/56649d705503460f94a530bf/html5/thumbnails/17.jpg)
QUESTIONS???