MEN ACT UPON THE WORLD, AND CHANGE IT, AND ARE CHANGED IN TURN BY THE CONSEQUENCES OF THEIR ACTION. B. F. Skinner, Verbal Behavior, 1957, p. 1

1
MEN ACT UPON THE WORLD, AND CHANGE IT, AND ARE
CHANGED IN TURN BY THE CONSEQUENCES OF THEIR
ACTION.B. F. Skinner, Verbal Behavior, 1957,
p. 1
2
Operant Conditioning
3
Operant Conditioning
4
(No Transcript)
5
Operant Conditioning
6
Operant Conditioning
7
(No Transcript)
8
Three-term Contingency

• SD
• SR
• Ro

• SD discriminative stimulus
• Ro operant class
• SR reinforcer

F force m mass dv/dt acceleration
Newtons Second Law of Motion
9
Operant Conditioning
10
PATTERNS OF BEHAVIOR

• The outstanding characteristic of operant
  behavior is that it can be differentiated in form
  and in temporal patterning by consequent events.
• Morse, 1966

11
PATTERNS OF BEHAVIOR

• Behavior is very, very complex---but
• Behavior is not chaotic or without causes.
• This means there can be a science of behavior.
• There are orderly patterns to behavior.
• These patterns are induced, in part, by
  contingencies.

12
CUMULATIVE STUDY TIME FOR TEST
W
T
Th
F
S
Su
M
T
Operant Conditioning
13
Operant Conditioning
14
Fixed-Interval (FI)1-min.
15
(No Transcript)
16
Operant Conditioning
17
Operant Conditioning
18
Operant Conditioning
19
Operant Conditioning
20
Operant Conditioning
21
Operant Conditioning
22
O-rules, functional relations B f (r)
r feedback
B output
E-rules, feedback functions r g (B)
Figure 1. The behavior-environment feedback
system
Operant Conditioning
23
Feedback Functions Fixed or Random Ratio ( FR n
or RR n) r mB r reinforcer rate, B
response rate, m reinforcers, response
1/n Variable or Random Interval ( VI t or RI
t) r B a (1-a) exp (-cB) / (tB a (1-a)
exp (-cB) 1) Baum, 1992
Operant Conditioning
24
Operant Conditioning
25
Ratio-Like Feedback Functions
26
OTHER POSSIBILITIES
27
Operant Conditioning
28
Operant Conditioning