Dr. B.F. Skinner and Operant Conditioning
Summary
TLDRThe script discusses B.F. Skinner's experiments with pigeons to study behavior modification through reinforcement schedules. By controlling the pigeons' environment and rewarding specific behaviors like pecking a disc, Skinner demonstrated how behavior can be shaped. He applied these findings to human behavior, like gambling, showing how variable ratio schedules drive addictive behaviors. The script challenges the concept of free will, suggesting that actions are driven by external causes rather than internal volition.
Takeaways
- đŠ Pigeons can be trained to distinguish between two words and respond appropriately, indicating that their behavior can be shaped by controlling their environment.
- đŹ B.F. Skinner's research involved isolating specific behaviors in pigeons, such as pecking a colored disc, and studying how these behaviors could be altered through reinforcement schedules.
- đœïž The pigeons were kept hungry to ensure that food could be used as an effective automatic reward, demonstrating the power of positive reinforcement.
- đ The frequency of the reward, or reinforcement schedule, was a key variable in studying pigeon behavior, with different schedules having distinct effects on behavior.
- đ° The variable ratio schedule of reinforcement, effective in both pigeons and rats, is central to gambling devices and can lead to addictive behaviors, suggesting parallels between animal and human behaviors.
- đ€ The concept of free will is challenged by the understanding that behaviors are shaped by external factors and reinforcement schedules, rather than internal volition.
- đ§ Skinner's work suggests that behaviors are the result of environmental control and learning, not autonomous decision-making, which has implications for how we view human actions.
- đ The study of pigeon behavior provides insights into human behavior, particularly in areas like gambling, where the schedules of reinforcement are similar.
- đŻ Understanding the causes of behavior allows us to move away from attributing actions to an internal act of will, as suggested by historical figures like Jonathan Edwards.
- đ The scientific study of behavior aims to uncover the causes of actions, which can help us understand and potentially predict or change behaviors more effectively.
Q & A
How do pigeons learn to distinguish between two words?
-Pigeons learn to distinguish between two words by being taught and rewarded with food for the correct behavior. They respond differently to each sign, and their behavior is shaped by controlling their environment.
What was the first task in the study of pigeon behavior?
-The first task was to isolate an individual piece of behavior and see how it could be changed. This was done by keeping pigeons hungry and using food as an automatic reward.
How was the pigeon's behavior measured in the experiment?
-The pigeon's behavior, specifically pecking a colored disc, was measured on a graph. This allowed researchers to study how often the reward (food) was offered and its effect on the pigeon's behavior.
What is a schedule of reinforcement in the context of the pigeon experiment?
-A schedule of reinforcement refers to the timing and frequency of rewards given to a pigeon for performing a specific behavior, such as pecking a disc. It can be scheduled to occur every time, every few times, or at variable intervals.
How does the variable ratio schedule affect pigeon behavior?
-The variable ratio schedule is very effective with pigeons and can lead to a pathological gambling-like behavior. It is at the heart of all gambling devices and has the same effect on humans, making them continue the behavior due to the uncertainty of the reward.
What is the connection between pigeon behavior and human gambling?
-The connection lies in the schedule of reinforcement. Both pigeons and humans can exhibit compulsive behaviors due to the variable ratio schedule, which is a common feature in gambling systems.
How does understanding pigeon behavior help interpret human behavior?
-Understanding pigeon behavior helps interpret human behavior by showing that the reinforcement schedule, not internal feelings or excitement, drives the behavior. This insight can be applied to human behaviors, such as gambling.
What does the script suggest about the concept of free will?
-The script suggests that free will is a fiction. By discovering the causes of behavior, the need for an internal act of will is diminished, and eventually, it may be attributed to nothing.
Who is Jonathan Edwards, and what is his view on free will mentioned in the script?
-Jonathan Edwards was an American Divine of the 18th century. He believed in free will because we know about our behavior but not about its causes. The script argues that once the causes of behavior are discovered, the concept of free will becomes less necessary.
How does the script describe the process of learning in pigeons?
-The script describes the learning process in pigeons as a response to environmental control and rewards. The pigeons are not acting independently; their behavior is shaped by the reinforcement schedules and the rewards they receive.
What role does the environment play in shaping pigeon behavior according to the script?
-The environment plays a crucial role in shaping pigeon behavior by controlling the availability of food as a reward. The pigeons' behavior is learned and modified based on the conditions and schedules set within their environment.
Outlines
đŠ Conditioning Pigeons and the Illusion of Free Will
The script discusses the behaviorist approach to studying animal behavior, using pigeons as an example. Pigeons were trained to distinguish between two words and respond accordingly, with food as a reward. This conditioning was achieved by controlling the pigeons' environment and manipulating their hunger levels. The concept of 'schedules of reinforcement' is introduced, which refers to the timing and frequency of rewards. The script explains how different reinforcement schedules can influence behavior, drawing parallels between pigeons and humans, particularly in the context of gambling. The idea of free will is challenged, suggesting that behaviors are shaped by external factors rather than internal volition. The historical perspective of Jonathan Edwards is mentioned, who argued that the belief in free will stems from a lack of understanding of the causes of behavior.
Mindmap
Keywords
đĄPigeons
đĄConditioning
đĄReinforcement
đĄSchedules of Reinforcement
đĄVariable Ratio Schedule
đĄGambling
đĄFree Will
đĄBehaviorism
đĄSkinner Box
đĄPathological Gambler
đĄExternal Reasons
Highlights
Pigeons can be taught to distinguish between two words and behave accordingly through rewards.
Behavior is shaped by controlling the environment, not by independent actions.
Skinner's method involved isolating a specific behavior to study its change.
Pigeons were kept hungry to use food as an automatic reward.
Pigeons were studied in a uniform box to measure pecking behavior.
Pecking a colored disc was learned as a behavior to produce a reward.
Schedules of reinforcement are key to understanding behavior patterns.
Reinforcement can be scheduled to occur at variable intervals.
Variable ratio schedules are effective in both pigeons and gambling devices.
Pigeons can exhibit pathological gambling behavior similar to humans.
Changing the reinforcement schedule can alter pigeon behavior.
The study of pigeon behavior helps interpret human gambling behavior.
Gambling is driven by the schedule of reinforcement, not by punishment or excitement.
All gambling systems incorporate variable ratios, influencing behavior.
Understanding the causes of behavior can diminish the concept of free will.
External reasons, not internal states, initiate behavior.
The science of behavior aims to discover causes, reducing the need for an internal act of will.
Free will may be a fiction as behavior can be explained by external causes.
Transcripts
can pigeons read this one gives every
indication because he's been taught to
distinguish between two words and to
behave
appropriately he's learned his different
response to each sign by being rewarded
with food
so the bird isn't acting independently
Its Behavior is shaped by controlling
its
environment the first task was to
isolate an individual piece of behavior
and see how that could be changed
Skinner did this by keeping individual
pigeons at about 3/4 of their normal
weight so that the birds were always
hungry and food could be used as an
automatic
reward the pigeon was studded in a
uniform B box one it quickly grew used
to one piece of behavior pecking a
colored disc was measured on a
graph the pigeon learned that pecking
the disc produced a reward then the
behavior of pecking could be studied in
relation to how often that reward was
offered or in Skinner terms what was the
schedule of reinforcement main thing is
what what we call schedules of
reinforcement reinforcement is what the
Layman calls reward and you can schedule
it so that a reward occurs every now and
then when a pigeon does something we
usually use a response with a pigeon
pecking a little disc a little spot on
the wall and you can reinforce with food
but you don't reinforce every time
you're every perhaps every tenth time or
perhaps only once every minute or
something like that there are very large
number of of schedules and they have
their special effects and there is a
good example of how you can move from
the the uh the pigeon to the human case
because one of the one of the schedules
which is very effective with with rats
or pigeons is what we call a variable
ratio schedule and that is at the heart
of all gambling devices and has the same
effect a pigeon can become a
pathological Gambler just as a person
can now the fact that we found that out
with pigeons and could prove it by
removing and changing the schedule makes
it easy for it to interpret the case
with the human the human subject we we
don't say that the human subject gambles
to punish himself as freudians might say
or gambl because he feels excited when
he does so nothing nothing of the sort
people gamble because of the schedule of
the reinforcement that follows and this
is true of all gambling system they all
have varable ratios built into them so
what we've learned from the pigeon it
made it possible to interpret this vast
field very
effectively when does that leave free
will because we all think we have a
choice whether to do things or not to do
things yes well you see we it leaves it
in the position of of a fiction we we
have assume somehow or other that these
internal States feelings and so on have
initiated something they have started
something they have created we we we we
have done something in in a voluntary
way we have willed to act if you now
look at the actual history we find that
there are external reasons why this has
happened in other words by discovering
the causes of behavior we we can dispose
of the imagined internal cause we
dispose of Free Will as a an American
Divine of the 18th century Jonathan
Edwards did he said we believe in free
will because we know about our Behavior
but not about its causes and of course
it's a s it's the the object of a
science of behavior to discover causes
and once you have found those causes
there is less you need to attribute to
an internal Act of Will and eventually I
think you need to attribute nothing to
it
Voir Plus de Vidéos Connexes
Online All the Time? Researchers Predicted It | Retro Report on PBS
21 Days to change YOUR LIFE | Challenge - Dopamine Detox BOOK SUMMARY In Hindi
Jordan Peterson - The Key to Healthy Relationships
How to Train a Brain: Crash Course Psychology #11
You have no free will at all | Stanford professor Robert Sapolsky
5
5.0 / 5 (0 votes)