mit artificial intelligence laboratory — research directions the next generation of robots? rodney...
TRANSCRIPT
![Page 1: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/1.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
The Next Generation of Robots?Rodney Brooks
and
Una-May O’Reilly
![Page 2: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/2.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Our Objectives
• How can biology inform robotic competence?
• How can aspects of human development and social behavior inform robotic competence?
![Page 3: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/3.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Our Approach
• Exploit the advantages of the robot’s physical embodiment
• Integrate multiple sensory and motor systems to provide robust and stable behavioral constraints
• Capitalize on social cues from an instructor
• Build adaptive systems with a developmental progression to limit complexity
![Page 4: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/4.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Cog and Kismet
Our Humanoid Platforms
![Page 5: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/5.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Biological Inspiration for Cog
• Cog has simulated musculature in its arms
• Cog has an implementation of a human model of visual search and attention
• Cog employs context-based attention and internal situations influence action
• Cog uses a naïve model of physics to distinguish animate from inanimate
![Page 6: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/6.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Social Inspiration for Cog
• A theory of mind
• A theory of body
• Mimicry
![Page 7: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/7.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Neck pan
Neck tilt
Neck lean
Eye tilt
Left eye panRight eye pan
Camera with wide field of viewCamera with narrow field of viewAxis of rotation
Human <—> Robot
Microphones
Cameras
Speech synthesizer
Facial features
Gaze direction
Head orientation
![Page 8: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/8.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Levels of Control
robot respondsto human
human respondsto robot
Social Level
Primitives Level
Skills Level
Behavior Level
current goal
current primitive(s)coordination
between motormodalities
perceptualfeedback
![Page 9: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/9.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Kismet’s Competencies
• Direct Visual Attention
• Recognize Socially Communicated Reinforcement
• Communicate Internal State to Human
• Regulation of Social Interaction
![Page 10: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/10.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
No One in Charge
• 11 400-500 MHz PCs– QNX (vision)
– Linux (speech recognition)
– NT (speech synthesis & vocal affect recognition
NTspeech synthesisaffect recognition
LinuxSpeech
recognition
Face Control
EmotiveResponse
Percept& Motor
Drives & Behavior
L
Tracker
Attnsystem
Dist.to
target
Motionfilter
Eyefinder
Motorctrl
audiospeechcomms
Skinfilter
Colorfilter
QNX
CORBA
CORBA
CORBA
dual-portRAM
CamerasEye, neck, jaw motors
Ear, eyebrow, eyelid,lip motors
Microphone
Speakers
• 4 Motorola 68332 micro-controllers
• L, multi-threaded lisp
• higher-level perception, motivation, behavior, motor skill integration & face control
![Page 11: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/11.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Visual Attention
inh
ibit
res
et
Frame Grabber
Eye Motor Control
Top down,task-driveninfluences
w w w w
skin tone habituationmotioncolor
attention
![Page 12: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/12.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Visual Search
![Page 13: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/13.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Social Constraints
Comfortable interaction speed
Too fast – irritation
response
Too fast,Too close –
threat response
Comfortable interaction distance
Too close – withdrawal response
Too far – calling
behavior
Person draws closer
Person backs off
Beyond sensor range
![Page 14: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/14.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Cross Cultural Affect
Evidence for 4 contours inKismet-directed speech
time (ms)
pitc
h, f
(kH
z)o
approval
That’s a good bo-o-y! No no baby.
time (ms)pi
tch,
f (
kHz)
o
prohibition
Can youget it?
Can youget it?
time (ms)
pitc
h, f
(kH
z)o
attention
time (ms)
pitc
h, f
(kH
z)o
MMMM Oh, honey.
comfort
![Page 15: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/15.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Affect Recognizer
prohibition attention & approval
soothing & low-energy neutral
neutral
Soothing & Low-Intensity
neutralvs
Everything Else
Soothingvs
Low-Intensity Neutral
Approval & Attentionvs
Prohibitionvs
High Intensity Neutral
approvalvs
attention
soothing
prohibition
neutral
approval
attention
ener
gy v
aria
nce
pitch mean
![Page 16: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/16.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Naive Subjects
• 5 female subjects• 4 naive subjects• 1 caregiver
• Four contours and neutral speech
• praise, prohibition, attention, soothing
• Multiple languages• French, German, Indonesian,
English, Russian
• Driven by Human
![Page 17: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/17.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Facial Expressions
arousal
sleep
displeasure pleasureneutral
excitement
depression
stress
calm
afraidangry
frustrated
relaxed
content
elated
bored
sad
fatigued
happy
surprise
sleepy
![Page 18: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/18.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Facial Postures in Affect Space
Negativevalence
Open stance
surprise
unhappy
tired
anger
fearLow
arousal
Higharousal
Positivevalence
Closed stance
disgust
accepting
stern
content
![Page 19: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/19.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Face, Voice, Posture
![Page 20: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/20.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Turn-Taking / Proto-Dialog
•Naïve subjects•Told to “talk to the robot”•Engage in turn taking•No understanding (on either side) of content
![Page 21: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/21.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Implemented Model of Visual Search and Attention
Activation Map
Color w
Skin w
Motion w MotorSystem
Motivation System
Habituation w
![Page 22: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/22.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
![Page 23: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/23.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Hardware – Cog’s Arms
• 6 DOF in each arm
• Series elastic actuator
• Force control
• Spring law
Motor andGearbox
Encoder
Spring
Bearing
Actuatoroutput
xbkxxF )(
![Page 24: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/24.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Hardware – Cog’s Head
• 7 degrees of freedom
• Human speed and range of motion
![Page 25: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/25.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Visual and Inertial Sensors
Peripheral View
Foveal View
Peripheral View
Foveal View
3-axis inertial sensor
![Page 26: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/26.jpg)
MIT Artificial Intelligence Laboratory — Research Directions
Computational System
• Designed for real-time responses
• Network of 24 PC’s ranging from 200-800 MHz
• QNX real-time operating system
• Implementation shown today consists of – ~26 QNX processes
– ~75 QNX threads
![Page 27: MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks and Una-May O’Reilly](https://reader036.vdocuments.us/reader036/viewer/2022062315/56649f575503460f94c7c7e5/html5/thumbnails/27.jpg)
MIT Artificial Intelligence Laboratory — Research Directions