BullyBully

Learning and Learning and MemoryMemory

Classical ConditioningClassical Conditioning

Ivan PavlovIvan Pavlov RussiaRussia What is learning?What is learning? Classical Conditioning:Classical Conditioning: A A

learning process in which learning process in which associations are made associations are made between a natural stimulus between a natural stimulus and a neutral stimulus.and a neutral stimulus.

Pavlov’s doggy . . . Again . . .Pavlov’s doggy . . . Again . . .

Classical ConditioningClassical Conditioning

Pavlov began his Pavlov began his experiments by ringing a experiments by ringing a tuning fork and then tuning fork and then immediately placing some immediately placing some meat powder on the dogs meat powder on the dogs tongue. He chose the tuning tongue. He chose the tuning fork because it was a fork because it was a neutral neutral stimulusstimulus..

Neutral Stimulus:Neutral Stimulus: A stimulus A stimulus that does not initially elicit that does not initially elicit any part of the unconditioned any part of the unconditioned response.response.

Classical ConditioningClassical Conditioning Well, after a few times the dog Well, after a few times the dog

begins to salivate by merely begins to salivate by merely hearing the sound, even if there hearing the sound, even if there was no food within it’s sight.was no food within it’s sight.

Pavlov demonstrated that a Pavlov demonstrated that a neutral stimulus (here, the tuning neutral stimulus (here, the tuning fork) can cause a formerly fork) can cause a formerly unrelated response.unrelated response.

This occurs if it is presented This occurs if it is presented regularly just before the stimulus regularly just before the stimulus (here, the food) that normally (here, the food) that normally brings about a response (here, brings about a response (here, salivation.) salivation.)

Classical ConditioningClassical Conditioning According to Pavlov, every human or According to Pavlov, every human or

animal has a set of animal has a set of unconditionalunconditional or or involuntary responses.involuntary responses.

Such responses include blushing, Such responses include blushing, shivering, being startled, and salivating.shivering, being startled, and salivating.

In this experiment, food was the In this experiment, food was the unconditional stimulusunconditional stimulus..

Unconditional Stimulus (UCS):Unconditional Stimulus (UCS): An An event that elicits a certain predictable event that elicits a certain predictable response typically without previous response typically without previous training.training.

Classical ConditioningClassical Conditioning A few other important things:A few other important things: Unconditioned Response (UCR): An Unconditioned Response (UCR): An

organism’s automatic (or neutral) organism’s automatic (or neutral) reaction to a stimulus. (Example = reaction to a stimulus. (Example = salivation).salivation).

Under normal conditions, the sound of a Under normal conditions, the sound of a tuning fork would not cause salivation. tuning fork would not cause salivation. The dog had to be taught, or conditioned The dog had to be taught, or conditioned to associate this sound with food.to associate this sound with food.

An ordinarily neutral event that, after An ordinarily neutral event that, after training, leads to a response such as training, leads to a response such as salivation is termed a salivation is termed a conditioned conditioned stimulusstimulus..

Classical ConditioningClassical Conditioning Conditioned Stimulus (CS):Conditioned Stimulus (CS): A once- A once-

neutral event that elicits a given neutral event that elicits a given response after a period of training in response after a period of training in which it has been paired with an which it has been paired with an unconditioned stimulus.unconditioned stimulus.

The salivation that is caused by the The salivation that is caused by the tuning fork is called a tuning fork is called a conditioned conditioned responseresponse..

Conditioned Response (CR):Conditioned Response (CR): The The learned reaction to a conditioned learned reaction to a conditioned stimulus.stimulus.

Classical ConditioningClassical Conditioning

Generalization and Generalization and DiscriminationDiscrimination

In the same set of experiments, Pavlov In the same set of experiments, Pavlov also studied the process of also studied the process of generalization and discriminationgeneralization and discrimination..

Generalization:Generalization: Responding similarly to Responding similarly to a range of similar stimuli.a range of similar stimuli.

Example:Example: When Pavlov attempted to When Pavlov attempted to train the dog to salivate at the sight of a train the dog to salivate at the sight of a circle…it worked after multiple trials!circle…it worked after multiple trials!

The dog had generalized it’s response The dog had generalized it’s response to include a similar stimulus.to include a similar stimulus.

Generalization and Generalization and DiscriminationDiscrimination

Pavlov was later able to do the Pavlov was later able to do the opposite, teaching the dog to respond opposite, teaching the dog to respond only to the circle by always pairing only to the circle by always pairing meat powder with the circle but never meat powder with the circle but never pairing it with a different object like an pairing it with a different object like an oval.oval.

In doing this, he taught his dog In doing this, he taught his dog discrimination.discrimination.

Discrimination:Discrimination: The ability to respond The ability to respond differently to similar but distinct differently to similar but distinct stimuli.stimuli.

Extinction and Spontaneous Extinction and Spontaneous RecoveryRecovery

A classically conditioned A classically conditioned response, like any other response, like any other behavior, is subject to change.behavior, is subject to change.

Pavlov discovered that if he Pavlov discovered that if he stopped presenting food after stopped presenting food after the sound of the tuning fork, the sound of the tuning fork, the sound gradually lost its the sound gradually lost its effect on the dog.effect on the dog.

After he repeatedly struck the After he repeatedly struck the tuning fork without giving food, tuning fork without giving food, the dog no longer associated the dog no longer associated the sound with the arrival of the sound with the arrival of food – the sound of the tuning food – the sound of the tuning fork no longer caused the fork no longer caused the salivation response.salivation response.

HahahahaHahahaha

Extinction and Spontaneous Extinction and Spontaneous RecoveryRecovery

Pavlov called this Pavlov called this effect extinctioneffect extinction!! Extinction:Extinction: The gradual disappearance of a The gradual disappearance of a

conditioned response when the conditioned conditioned response when the conditioned stimulus is repeatedly presented without stimulus is repeatedly presented without the unconditioned stimulus.the unconditioned stimulus.

Yet, even though the conditioned response Yet, even though the conditioned response has been extinguished, it does not mean has been extinguished, it does not mean that the CR has been completely unlearned.that the CR has been completely unlearned.

Whaaaaaaa?Whaaaaaaa? Spontaneous Recovery!Spontaneous Recovery! Yup, you eventually see the object again Yup, you eventually see the object again

and get a response…Ask me if confused, I’ll and get a response…Ask me if confused, I’ll explain!explain!

Operant ConditioningOperant Conditioning Ok, so, suppose you have a dinosaur! Yes Ok, so, suppose you have a dinosaur! Yes

a dinosaur!a dinosaur! Your dinosaur is wandering around the Your dinosaur is wandering around the

neighborhood, sniffing trees, checking neighborhood, sniffing trees, checking garbage cans, and looking for a squirrel garbage cans, and looking for a squirrel to chase.to chase.

A kind neighbor sees the dinosaur and A kind neighbor sees the dinosaur and tosses a bone out of the kitchen door to it.tosses a bone out of the kitchen door to it.

The next day the dinosaur is likely to stop The next day the dinosaur is likely to stop at the same door on it’s rounds. Once at the same door on it’s rounds. Once again your neighbor produces another again your neighbor produces another bone, so the dinosaur becomes a regular bone, so the dinosaur becomes a regular visitor!visitor!

Why?Why?

Operant ConditioningOperant Conditioning Well I’ll tell ya why! Hold your Well I’ll tell ya why! Hold your

horses!horses! Well, ummm, see, there’s this, well, Well, ummm, see, there’s this, well,

ummm, thing called, like, ummm, thing called, like, operant operant conditioningconditioning..

Operant Conditioning:Operant Conditioning: Learning in Learning in which a certain action is reinforced which a certain action is reinforced or punished, resulting in or punished, resulting in corresponding increases and corresponding increases and decreases in occurrence.decreases in occurrence.

Operant = operates due to a Operant = operates due to a change yo.change yo.

ReinforcementReinforcement Reinforcement:Reinforcement: Stimulus or event Stimulus or event

follows a response and increases the follows a response and increases the likelihood that the response will be likelihood that the response will be repeated.repeated.

Examples of reinforcers:Examples of reinforcers: Social ApprovalSocial Approval MoneyMoney Extra privilagesExtra privilages Giving a dog a treat when it shakes your Giving a dog a treat when it shakes your

hand.hand.

Primary and Secondary Primary and Secondary Reinforcer’sReinforcer’s

Primary Reinforcer:Primary Reinforcer: Stimulus that is Stimulus that is naturally rewarding, naturally rewarding, such as food or such as food or water.water.

Secondary Secondary Reinforcer:Reinforcer: Stimulus Stimulus such as money that such as money that becomes rewarding becomes rewarding through its link with through its link with a primary reinforcer.a primary reinforcer.

Schedules of Schedules of ReinforcementReinforcement

Fixed-Ratio Schedule:Fixed-Ratio Schedule: A pattern of reinforcement in A pattern of reinforcement in which a specific number of correct responses is which a specific number of correct responses is required before reinforcement can be obtained.required before reinforcement can be obtained.

Variable-Ratio Schedule:Variable-Ratio Schedule: A pattern of reinforcement A pattern of reinforcement in which an unpredictable number of responses are in which an unpredictable number of responses are required before reinforcement can be obtained.required before reinforcement can be obtained.

Fixed-Interval Schedule:Fixed-Interval Schedule: A pattern of reinforcement A pattern of reinforcement in which a specific amount of time must elapse in which a specific amount of time must elapse before a response will elicit reinforcement.before a response will elicit reinforcement.

Variable-Interval Schedule:Variable-Interval Schedule: A pattern of A pattern of reinforcement in which changing amounts of time reinforcement in which changing amounts of time must elapse before a response will obtain must elapse before a response will obtain reinforcement.reinforcement.

Shaping and ChainingShaping and Chaining What is Shaping?What is Shaping? Shaping: Shaping: A technique in which the A technique in which the

desired behavior is “molded” by desired behavior is “molded” by first rewarding any act similar to first rewarding any act similar to that behavior and then requiring that behavior and then requiring ever-closer approximations to the ever-closer approximations to the desired behavior before giving the desired behavior before giving the reward.reward.

In other words, positive In other words, positive reinforcement is used to “sculpt” reinforcement is used to “sculpt” new responses out of the old, new responses out of the old, possibly negative, ones.possibly negative, ones.

Is anyone confused? Is anyone confused?

Shaping and ChainingShaping and Chaining

Response Chain: Response Chain: Learned Reactions Learned Reactions that follow one that follow one another in sequence, another in sequence, each reaction each reaction producing the signal producing the signal for the next.for the next. Examples:Examples:

Swimming, Swimming, Basketball, Lacrosse, Basketball, Lacrosse, Baseball, Hockey, Baseball, Hockey, Football, etc.Football, etc.

One Example of a Response One Example of a Response ChainChain

One More Example of a One More Example of a Response Chain!Response Chain!

Aversive ControlAversive Control

Aversive Control:Aversive Control: Process of Process of Influencing Influencing behavior by means behavior by means of some form of of some form of “unpleasant” “unpleasant” stimuli!stimuli!

Ouch! Ouch! Ouch! Ouch! Ouch!Ouch!

Funny Fishies!

Negative ReinforcementNegative Reinforcement In the concept of negative In the concept of negative

reinforcement, a painful or reinforcement, a painful or unpleasant stimulus is removed. unpleasant stimulus is removed. The removal of unpleasant The removal of unpleasant consequences increases the consequences increases the frequency of a behavior. frequency of a behavior.

Negative Reinforcement:Negative Reinforcement: Increasing Increasing the strength of a given response by the strength of a given response by removing or preventing a painful removing or preventing a painful stimulus when the response occurs.stimulus when the response occurs.

Cognitive LearningCognitive Learning Cognitive Learning focuses on how Cognitive Learning focuses on how

information is obtained, processed, and information is obtained, processed, and organized.organized. Such learning is concerned Such learning is concerned with the mental process involved in with the mental process involved in learning.learning. Latent Learning and Learned Latent Learning and Learned Helplessness are examples of cognitive Helplessness are examples of cognitive learning.learning.

Cognitive Learning:Cognitive Learning: Form of altering Form of altering behavior that involves mental processes behavior that involves mental processes and may result from observation or and may result from observation or imitation.imitation.

Cognitive LearningCognitive Learning Examples:Examples: 1. 1. Latent Learning.Latent Learning. Latent learning is not Latent learning is not

demonstrated by an immediately observable demonstrated by an immediately observable change in behavior at the time of the change in behavior at the time of the learning.learning. Although the learning typically Although the learning typically occurs in the absence of a reinforcer, it may occurs in the absence of a reinforcer, it may not be demonstrated until the reinforcer not be demonstrated until the reinforcer appears.appears.

Example:Example: Have you ever had to locate a building or a Have you ever had to locate a building or a street in a section of Durham that you are unfamiliar street in a section of Durham that you are unfamiliar with?with? You may have been through that section of town You may have been through that section of town before and remember details such as an unusual sign before and remember details such as an unusual sign or building.or building. Remembering these details may have Remembering these details may have helped you find the building or street you were looking helped you find the building or street you were looking for.for. In other words, you learned some details you were In other words, you learned some details you were not intending to.not intending to.

Cognitive LearningCognitive Learning Examples:Examples: 2. 2. Learned Helplessness.Learned Helplessness. Learned Learned

helplessness is a condition in which helplessness is a condition in which repeated attempts to control a situation repeated attempts to control a situation fail, resulting in the belief that the fail, resulting in the belief that the situation is uncontrollable.situation is uncontrollable. Example:Example: You do poorly on a math test the You do poorly on a math test the

first time you try and decide it was because first time you try and decide it was because you had not studied enough.you had not studied enough. The next test, The next test, you do poorly again and decide it was you do poorly again and decide it was because you did not feel well.because you did not feel well. On the third On the third test, you once again score poorly…You give test, you once again score poorly…You give up and decide that you “are just dumb,” up and decide that you “are just dumb,” giving up on math.giving up on math.

Modeling and Behavior Modeling and Behavior ModificationModification

Modeling!Modeling! Wait….No…The other kind of Wait….No…The other kind of

modeling!modeling! Modeling:Modeling: Learning by imitating Learning by imitating

others; copying behavior!others; copying behavior! This is how the majority of This is how the majority of

people learn how to act in new people learn how to act in new situations (sports, concerts, etc.)situations (sports, concerts, etc.)

Modeling and Behavior Modeling and Behavior ModificationModification

The term “behavior modification” often The term “behavior modification” often appears in magazine articles describing appears in magazine articles describing research on changing people’s behavior research on changing people’s behavior through drugs, “mind control,” or even through drugs, “mind control,” or even brain surgery.brain surgery.

In fact, it is none of these things.In fact, it is none of these things. Behavior Modification:Behavior Modification: Refers to the Refers to the

systematic application of learning systematic application of learning principles to change people’s actions and principles to change people’s actions and feelings.feelings. Example: Example: Giving your little brother a quarter Giving your little brother a quarter

to go away!to go away!

Social LearningSocial Learning

Social learning: Social learning: Learning through Learning through viewing other people and the way viewing other people and the way that they behave in society.that they behave in society.

Example:Example: Britney Spears has 3-4 kids Britney Spears has 3-4 kids by different guys. Little girls who by different guys. Little girls who buy her records and love her start buy her records and love her start having babies and the pre-teen having babies and the pre-teen pregnancy rate rises.pregnancy rate rises.