Behavior Based SystemsBehavior Based Systems

Key aspects of the behavior-based Key aspects of the behavior-based methodology:methodology: Situatedness:Situatedness:

The robot is an entity situated and surrounded by The robot is an entity situated and surrounded by the real world (or real virtual world); Brooks: the real world (or real virtual world); Brooks: "World is its best model""World is its best model"

Embodiment:Embodiment: A robot has a physical presence (a body with A robot has a physical presence (a body with

limitations, non-holonomic robot), or virtual limitations, non-holonomic robot), or virtual presence (a software body with limitations)presence (a software body with limitations)

Emergence:Emergence: Intelligence arises from the interactions of the Intelligence arises from the interactions of the

robotic agent with its environment. It is not the robotic agent with its environment. It is not the property of either the agent or the environment property of either the agent or the environment in isolation but is rather a result of the interplay in isolation but is rather a result of the interplay between thembetween them

Issues in Behavior-based ParadigmIssues in Behavior-based Paradigm

Grounding in realityGrounding in reality Symbol grounding problem; Brooks: "The Symbol grounding problem; Brooks: "The

world is its own best model" Problem of world is its own best model" Problem of using simulatorsusing simulators

Ecological dynamicsEcological dynamics An agent is immersed in a highly dynamic An agent is immersed in a highly dynamic

environment Evolutionary processes shape environment Evolutionary processes shape agents to fit their ecological nicheagents to fit their ecological niche

ScalabilityScalability

DefinitionsDefinitions An individual behavior:An individual behavior:

A stimulus-response pair for a given A stimulus-response pair for a given environmental setting that is modulated by environmental setting that is modulated by attention and determined by intentionattention and determined by intention

Attention:Attention: prioritizes tasks and focuses sensory prioritizes tasks and focuses sensory

resources and is determined by the current resources and is determined by the current environmental contextenvironmental context

Intention:Intention: Determines what set of behaviors should Determines what set of behaviors should

be active based on the robotic agent's be active based on the robotic agent's internal goals and objectivesinternal goals and objectives

Definitions (cont.)Definitions (cont.)

Emergent behavior:Emergent behavior: The global observed behavior; a The global observed behavior; a

consequence of the interaction of the consequence of the interaction of the active individual behaviorsactive individual behaviors

Reflexive behavior (purely reactive behavior)Reflexive behavior (purely reactive behavior) Behavior that is generated by hardwired Behavior that is generated by hardwired

reactive behaviors with tight sensor-reactive behaviors with tight sensor-effector coupling.effector coupling.

Animal BehaviorAnimal Behavior IdeasIdeas

Animal behavior defines intelligence (or Animal behavior defines intelligence (or stupidity)stupidity)

Proof that intelligent behavior is possibleProof that intelligent behavior is possible Can provide models that can be used to create Can provide models that can be used to create

intelligent machinesintelligent machines Biological studies are not necessary viewed as Biological studies are not necessary viewed as

constraining for robots;constraining for robots; ProblemsProblems

Biological hardware is differentBiological hardware is different Our knowledge of the functioning of the Our knowledge of the functioning of the

biological hardware isbiological hardware is often inadequateoften inadequate

Animal behavior StudiesAnimal behavior Studies

NeuroscienceNeuroscience The study of the nervous system's anatomy, The study of the nervous system's anatomy,

physiology, biochemistry, and molecular biologyphysiology, biochemistry, and molecular biology PsychologyPsychology

The study of mind and behaviorThe study of mind and behavior EthologyEthology

The study of animal behavior in natural conditionsThe study of animal behavior in natural conditions

Evidence from NeuroscienceEvidence from Neuroscience

Many specialized small systems in animal Many specialized small systems in animal kingdom have been analyzed:kingdom have been analyzed: bat sonarbat sonar wiping reflex in frogswiping reflex in frogs cockroach locomotioncockroach locomotion

Evidence exists that vector calculation is used in Evidence exists that vector calculation is used in some areas in the brainsome areas in the brain

Evidence exists that the "planning" in the central Evidence exists that the "planning" in the central nervous system translate into establishing nervous system translate into establishing equilibrium points that implicitly specify the equilibrium points that implicitly specify the desired motiondesired motion

Force fields in frog spinal cordForce fields in frog spinal cord

Some neuroscience theoriesSome neuroscience theories

Schema theorySchema theory Philosophical model; Immanuel KantPhilosophical model; Immanuel Kant Neurological schema theory (C.1910)Neurological schema theory (C.1910) A schema is the basic unit of behavior from which A schema is the basic unit of behavior from which

complex actions can be constructed.complex actions can be constructed. Neural networks theoryNeural networks theory

Basic model (1943) (McCulloch&Pitts)Basic model (1943) (McCulloch&Pitts) Perceptron (1959) (Minsky&Papert)Perceptron (1959) (Minsky&Papert) Backpropagation (1985) (Rummelhart, Hinton & Backpropagation (1985) (Rummelhart, Hinton &

WilliamsWilliams

PsychologyPsychology

Robotics is currently using ideas and theories of Robotics is currently using ideas and theories of human psychology that researchers in psychology human psychology that researchers in psychology no longer accept as valid.no longer accept as valid.

i.e.recycling of old ideas of psychology in the i.e.recycling of old ideas of psychology in the field of robotics;field of robotics;

controversial ideas and theorems can be used in controversial ideas and theorems can be used in roboticsrobotics

Some paradigms in psychologySome paradigms in psychology

Behaviorism, (1910)Behaviorism, (1910) Main idea: Everything is "Stimulus and Response"Main idea: Everything is "Stimulus and Response" B.F.SkinnerB.F.Skinner

Gestalt psychology, (1947)Gestalt psychology, (1947) Main idea: “Pure behaviorism is limited; there exists Main idea: “Pure behaviorism is limited; there exists

levels of organization above the sensation“levels of organization above the sensation“ Ecological psychology, (1979)Ecological psychology, (1979)

Main idea: "Things are perceived in terms of the Main idea: "Things are perceived in terms of the opportunities they afford." Concept of affordances. opportunities they afford." Concept of affordances.

The observer and the environment complement each The observer and the environment complement each other.other.

Some paradigms in psychologySome paradigms in psychology

Cognitive psychology, (1975)Cognitive psychology, (1975) Cognition: the activity of knowing: the acquisition, Cognition: the activity of knowing: the acquisition,

organization, and use of knowledge;organization, and use of knowledge; Main idea:Main idea:

““classical behaviorism explains only animal behaviorclassical behaviorism explains only animal behavior A series of subsystems processes the environmental A series of subsystems processes the environmental

information:information: stimulus attention perception thought processes ⇒ ⇒ ⇒stimulus attention perception thought processes ⇒ ⇒ ⇒

decision response⇒ ⇒ decision response⇒ ⇒

EthologyEthology

Animal behavior can be categorized into three Animal behavior can be categorized into three major classes:major classes: ReflexesReflexes

rapid, automatic, involuntary responses to a stimulirapid, automatic, involuntary responses to a stimuli TaxesTaxes

behavioral responses that orient the animal toward (positive behavioral responses that orient the animal toward (positive tropism) or away (negative tropism) from a stimulus, tropism) or away (negative tropism) from a stimulus, examples:examples:

chemotaxis (positive/negative tropism towards a certain chemotaxis (positive/negative tropism towards a certain chemical),chemical),

phototaxis (positive/negative tropism towards light)phototaxis (positive/negative tropism towards light) Fixed-action patternsFixed-action patterns

Time-extended response patterns triggered by a stimulus Time-extended response patterns triggered by a stimulus but persisting for longer than the stimulus itselfbut persisting for longer than the stimulus itself

Ecological nicheEcological niche

The status of an animal in its community, in The status of an animal in its community, in terms of its relations to food and enemies, is terms of its relations to food and enemies, is generally called its nichegenerally called its niche

Evolution has molded animals to fit their niche.Evolution has molded animals to fit their niche. To be self sufficient, an agent must exhibit To be self sufficient, an agent must exhibit

behavioral stability and market viability.behavioral stability and market viability. Behavioral stability implies that the agent does not Behavioral stability implies that the agent does not

succumb to irrecoverable debt of any vital resourcesuccumb to irrecoverable debt of any vital resource Market viability amounts to pleasing the robot's Market viability amounts to pleasing the robot's

employeremployer

Ecological niche of robotsEcological niche of robots

If the roboticist intends to build a system that is If the roboticist intends to build a system that is autonomous and can successfully compete with autonomous and can successfully compete with other environmental inhabitants, that system must other environmental inhabitants, that system must find a stable niche or it (as an application) will be find a stable niche or it (as an application) will be unsuccessful.unsuccessful.

For robots to be commonplace, they must find the For robots to be commonplace, they must find the ecological niches that allow them to survive ecological niches that allow them to survive and/or dominate their competitors, whether they and/or dominate their competitors, whether they be mechanical or biological.be mechanical or biological.