cs 378: autonomous intelligent roboticsjsinapov/teaching/cs378/slides/... · “a robust layered...
TRANSCRIPT
![Page 1: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/1.jpg)
CS 378: Autonomous Intelligent Robotics
Instructor: Jivko Sinapovhttp://www.cs.utexas.edu/~jsinapov/teaching/cs378/
![Page 2: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/2.jpg)
Announcements
FRI Summer Research Fellowships:
https://cns.utexas.edu/fri/beyond-the-freshman-lab/fellowships
Applications are due March 1st but apply now!
Funding is available for 4-5 students per FRI stream
![Page 3: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/3.jpg)
Semester Schedule
C++ and Robot Operating System (ROS)
Learning to use our robots
Computational Perception
Developmental Robotics
Human-Robot InteractionYou are here
Time
![Page 4: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/4.jpg)
Progression
2D simulation 3D simulation2D simulation Real World
![Page 5: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/5.jpg)
The Gazebo 3D simulator
• Install gazebo_ros package:sudo apt-get install ros-indigo-gazebo-ros
• Run the simulator:roslaunch gazebo_ros rubble_world.launch
• Guide for installing the gazebo simulator on Mac OS: http://gazebosim.org/tutorials?tut=install_from_source&cat=install
![Page 6: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/6.jpg)
Today
• Reading Discussion
• ROS Services II
• Homework 4
![Page 7: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/7.jpg)
“A robust layered control system...”
![Page 8: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/8.jpg)
“A robust layered control system...”
![Page 9: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/9.jpg)
“A robust layered control system...”
![Page 10: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/10.jpg)
“A robust layered control system...”
![Page 11: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/11.jpg)
“A robust layered control system...”
“I am interested in learning more about the sonar system that the robot implements in order to create a map of its surroundings. I am curious about some of the technicalities of this system, as well as how accurate it truly is in practice, especially in a room filled with constantly moving beings/objects. “
- Zara
![Page 12: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/12.jpg)
“A robust layered control system...”
“How will complex decisions based on input from various “layers” be made without some central [module] driving it all?”
- Saket
![Page 13: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/13.jpg)
“A robust layered control system...”
“They said their work was limited by the hardware to teach robots learning needing a "new sort of video camera and high-speed low-power processing box to run specially developed vision algorithms at 10 frames per second" to make progress". With hardware rapidly getting better, has this been made already and if so how far sway are they have they progressed?”
- Nathan
![Page 14: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/14.jpg)
“Intelligence without representation”
![Page 15: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/15.jpg)
“Intelligence without representation”
![Page 16: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/16.jpg)
“A robust layered control system...”
“Some questions I had were about the layering system. What would happen if say, there were contradictions in the desires with the same importance? How would the robot then respond to this situation?
- Justin
![Page 17: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/17.jpg)
“A robust layered control system...”
“Is it still believed that it is impossible to create a robot with human intelligence?
Just curious, what is the debate surrounding animal intelligence? How does it apply to Artificial Intelligence?
Is this approach still used in practice? How many layers have been achieved now?
-Amrutha
![Page 18: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/18.jpg)
![Page 19: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/19.jpg)
Readings for this week
D. McDermott (1981). "Artificial intelligence meets natural stupidity". Ch. 5 in Mind Design: Philosophy, Psychology, Artificial Intelligence, pp. 143-160, MIT Press.
Rich Sutton (2001). "Verification, The Key to AI".
Rich Sutton (2001). "Verification".
![Page 20: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/20.jpg)
ROS Services
![Page 21: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/21.jpg)
Messages vs. Services
![Page 22: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/22.jpg)
Messages vs. Services
![Page 23: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/23.jpg)
Messages vs. Services
Publisher
Subscriber
Client
Server
topi
c
requ
est
resp
onse
![Page 24: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/24.jpg)
Messages vs. Services
Publisher
Subscriber
Client
Server
topi
c
requ
est
resp
onse
t1
t2
t3
![Page 25: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/25.jpg)
Useful command line tools
rosservice list : list all available services
rosservice info <name> : print information about service to the console
rosservice call <name> <request> : call a service from the command line
![Page 26: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/26.jpg)
Calling a service from code
• Find out what the name of the service is
• Find out what the type of the srv is (i.e., what package it is declared in and the name of the .srv file
• Add the package where the srv is declared to your dependencies in package.xml and CMakeLists.txt
![Page 27: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/27.jpg)
Calling a service from code (con't)
• In your ROS node code, include the header file for the srv– e.g., if the srv is turtlesim/Spawn.srv then
“#include “turtlesim/Spawn.h”
• Create the client object as described in Tutorial #14: http://wiki.ros.org/ROS/Tutorials
![Page 28: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/28.jpg)
Homework 4: Multi-Agent System
![Page 29: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/29.jpg)
Reactive Paradigm Example
![Page 30: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/30.jpg)
Reactive Paradigm Example
![Page 31: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/31.jpg)
Reactive Paradigm Example
. . .
.
![Page 32: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/32.jpg)
Reactive Paradigm Example
![Page 33: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/33.jpg)
Reactive Paradigm Example
. . .
.
![Page 34: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/34.jpg)
![Page 35: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/35.jpg)
Homework 4: Prerequisites
• ROS tutorial on launch files (#8):http://wiki.ros.org/ROS/Tutorials/UsingRqtconsoleRoslaunch
• ROS tutorial on services (#14)
• Turtlesim video tutorial:http://wiki.ros.org/turtlesim/Tutorials#Video_Tutorials
![Page 36: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/36.jpg)
Homework 4: Part 1
• Create a new package called “cs378_<eid>_hw4”
• The package's dependencies should include the turtlesim package
![Page 37: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/37.jpg)
Homework 4: Part 1
• For part 1, the task is to write a ROS node which adds a new turtle to the simulator
• After adding the new turtle, it should follow turtle1
• Include a launch file called “hw4_part1.launch” which should launch the simulator, your node and the keyboard teleop node to control turtle1
![Page 38: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/38.jpg)
Homework 4: Part 2
![Page 39: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/39.jpg)
Homework 4: Part 2
• For Part 2, you should implement three different ROS nodes, with each corresponding to the “turtle”, the “shark”, and the “fish”.
• Behavior:– “fish” should move randomly with low velocity– “shark” should follow the turtle– “turtle” should avoid the shark but try to get to
the fish
![Page 40: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/40.jpg)
Homework 4: Part 2
• For Part 2, you should implement three different ROS nodes, with each corresponding to the “turtle”, the “shark”, and the “fish”.
• Behavior:– “fish” should move randomly with low velocity– “shark” should follow the turtle– “turtle” should avoid the shark but try to get to
the fish
![Page 41: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/41.jpg)
Homework 4: Part 2
• A single launch titled “hw4_part2.launch” should launch all 3 nodes along with the turtlesim simulator
• 2 of the 3 nodes, the “fish”, and the “shark” should make a client call to the simulator to add a turtle that will represent them
![Page 42: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/42.jpg)
Homework 4: Part 2
Due Friday March 4th
![Page 43: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/43.jpg)
![Page 44: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/... · “A robust layered control system...” “They said their work was limited by the hardware to teach](https://reader034.vdocuments.us/reader034/viewer/2022050415/5f8bde0e50aec767c12a966e/html5/thumbnails/44.jpg)
THE END