Operant Operant ConditioningConditioning

I. The BasicsI. The Basics

Discovered by Edward Thorndike and made Discovered by Edward Thorndike and made popular by B.F. Skinnerpopular by B.F. Skinner

If a response is followed by a reward, that If a response is followed by a reward, that response is more likely to be used again in the response is more likely to be used again in the future.future. Rewards are used to increase the use of behaviorsRewards are used to increase the use of behaviors Punishments are used to decrease the use of Punishments are used to decrease the use of

behaviorsbehaviors The individual must The individual must operateoperate on the environment to on the environment to

get the reward or avoid the punishmentget the reward or avoid the punishment

II. B.F. SkinnerII. B.F. Skinner

Skinner BoxSkinner Box A small cage A small cage

containing a lever that containing a lever that can be pushed by a can be pushed by a rat or a disk that can rat or a disk that can be pecked by a be pecked by a pigeon. (most of pigeon. (most of Skinner’s research Skinner’s research involved rats & involved rats & pigeons)pigeons)

II. Skinner Cont.II. Skinner Cont.

Skinner BoxSkinner Box The box can be programmed in a variety of waysThe box can be programmed in a variety of ways Examples:Examples:

Pressing the lever or pecking the disk results in food Pressing the lever or pecking the disk results in food = the animal learns to make the response= the animal learns to make the response

A light may signal when pressing or pecking will result A light may signal when pressing or pecking will result in the delivery of food = the animal can be trained in the delivery of food = the animal can be trained when to press or peck.when to press or peck.

There may be a grid on the floor through which the There may be a grid on the floor through which the animal can be shocked = the animal can be trained to animal can be shocked = the animal can be trained to press a lever to turn off a painful shock.press a lever to turn off a painful shock.

The case of the pigeon The case of the pigeon & the guided missile& the guided missile

Role in Human BehaviorRole in Human Behavior

III. Skinners view of III. Skinners view of societysociety

B.F. Skinner saw the world as one big Skinner box and B.F. Skinner saw the world as one big Skinner box and the Skinner box as a model of society.the Skinner box as a model of society.

Skinner wrote a novel outlining how rewards and Skinner wrote a novel outlining how rewards and punishments could be used to create a utopian society.punishments could be used to create a utopian society.

Experimental communities were created based on his Experimental communities were created based on his ideasideas

One of these still exists. An upbeat attitude is instilled One of these still exists. An upbeat attitude is instilled in children by only rewarding positive statements like “I in children by only rewarding positive statements like “I like it” and “I’m happy.” Negative statements are like it” and “I’m happy.” Negative statements are ignored.ignored. Behavioral engineeringBehavioral engineering

IV. Token EconomiesIV. Token Economies

Psychologists use operant conditioning to Psychologists use operant conditioning to teach hospitalized psychiatric patients to teach hospitalized psychiatric patients to use more normal behaviors. Specifically, use more normal behaviors. Specifically, whenever the patients behave in normal whenever the patients behave in normal ways they are given tokens which they ways they are given tokens which they can later exchange for rewards such as can later exchange for rewards such as additional television time, better living additional television time, better living accommodations, or hospital passes. accommodations, or hospital passes. This is known as a “token economy.”This is known as a “token economy.”

V. Reinforcement and V. Reinforcement and PunishmentPunishment

Reinforcement: what is given to an individual Reinforcement: what is given to an individual after a response to increase the likelihood the after a response to increase the likelihood the response will be used again.response will be used again.

Two types:Two types:1.1. Positive Reinforcement: increases the likelihood Positive Reinforcement: increases the likelihood

that a response will be used again. (Praise)that a response will be used again. (Praise)2.2. Negative Reinforcement: something which when Negative Reinforcement: something which when

it is terminated it is terminated increasesincreases the likelihood that a the likelihood that a response will be used again. (mother stops response will be used again. (mother stops nagging once a child complies, will increase nagging once a child complies, will increase compliance to avoid nagging)compliance to avoid nagging)

V. Reinforcement and V. Reinforcement and Punishment Cont.Punishment Cont.

Punishment: Something that reduces the use Punishment: Something that reduces the use of a behavior. (speeding ticket may prevent of a behavior. (speeding ticket may prevent that person from speeding in the future)that person from speeding in the future) Punishment behaviors are not unlearned or Punishment behaviors are not unlearned or

forgotten. Rather, they are suppressed. When the forgotten. Rather, they are suppressed. When the possibility of punishment is withdrawn, the behavior possibility of punishment is withdrawn, the behavior likely will return.likely will return.

It is better to reinforce desired behaviors than to It is better to reinforce desired behaviors than to punish undesirable behaviorspunish undesirable behaviors

Operant Operant Conditioning Conditioning DemonstrationDemonstration

VI. Avoidance VI. Avoidance ConditioningConditioning

Punishment can be used to increase Punishment can be used to increase behaviorsbehaviors

This is achieved when behaviors enable This is achieved when behaviors enable an individual to avoid punishmentan individual to avoid punishment

Skinner box/electric shockSkinner box/electric shock Avoidance Conditioning is why students Avoidance Conditioning is why students

study.study. They study to avoid getting a bad gradeThey study to avoid getting a bad grade

VII. ShapingVII. Shaping

Successive ApproximationsSuccessive Approximations