Shaping

1
Shaping

• Chapter 8

2
Simple Reinforcement
Before Andrew has no gum
Behavior Initial Andrew moves his lips
After Andrew receives gum
3
Differential Reinforcement
Reinforcement
Behavior Intermed Andrew makes croaking sound
After Andrew receives gum
Before Andrew has no gum
Behavior Intermed Andrew moves his lips
After Andrew receives no gum
Extinction
4
Differential Reinforcement
Reinforcement
Behavior Terminal Andrew says gum
After Andrew receives gum
Before Andrew has no gum
Behavior Intermed Andrew makes croaking sound
After Andrew receives no gum
Extinction
5
Process of Shaping

• Used when the response is not currently in the
  repertoire
• Is used as an intervention
• We dont shape people, we shape responses

6
Operant Level

• The frequency of responding before reinforcement

7
Terminal Behavior

• Behavior not in the repertoire or not occurring
  at the desired rate
• This is the goal of the intervention

8
Shaping Behaviors

• Initial behaviors
• Intermediate behaviors

9
Initial behavior

• Behavior that resembles the terminal behavior
  along some meaningful dimension and occurs with
  at least a minimal frequency

10
Intermediate behaviors

• Behavior that more closely approximates the
  terminal behavior

11
The procedure of shaping with reinforcement

• The differential reinforcement of only that
  behavior that more and more closely resembles the
  terminal behavior

12
Shaping with Reinforcement
Reinforcement
Behavior Initial Andrew moves lips Intermed
Andrew makes croaking sound Terminal Says words
clearly
After Andrew receives gum
Before Andrew has no gum
Behavior Initial NA Intermed Moves lips
only Terminal Says words unclearly
After Andrew receives no gum
Extinction
13
Differential Reinforcement vs. Shaping
Differential Reinforcement Shaping
of response classes One A series
Successive Approximations to the terminal behavior No Yes
Some terminal behavior at the start Yes No
14
Differential Reinforcement vs. Shaping fill in
the table
Shaping Differential Reinforcement
of response classes
Successive Approximations to the terminal behavior
Some terminal behavior at the start
15
Shaping with punishment

• The differential punishment of all behavior
  except that which more and more closely resembles
  the terminal behavior

16
Variable-outcome shaping

• Shaping that involves an increase in the
  magnitude of a reinforcer or a decrease in the
  magnitude of an aversive outcome as performance
  more and more closely resembles the terminal
  behavior

17
Variable Outcome Shaping
Quicker Reinforcement
Behavior Initial forceful Intermed very
forceful Terminal superforceful
After Initital Rattle in 10-sec Intermediate
Rattle in 6s Terminal Rattle in 4s
Before Rod has no rattle in his hand
Behavior Initial weak force Intermed
forceful Terminal very forceful
After Initial no rattle Intermed Rattle in
10s Terminal Rattle in 6 sec
Slower Reinforcement
18
Fixed outcome shaping

• Shaping that involves the delivery of a fixed
  magnitude of a reinforcer, when performance meets
  the changing criterion,
• or the delivery of a fixed magnitude of an
  aversive outcome, when performance fails to meet
  the changing criterion.

19
Fixed Outcome vs. Variable Outcome Shaping
Fixed Outcome Variable Outcome
of outcome sizes One Many
Regression to earlier levels No reinforcers Weaker reinforcers
Usual Source of Shaping Behavior Modifier (planned) Nature (unplanned)
20
Operant Classes
Differential Reinforcement
21
Shaping

• Creates new behavior (creates classes)
• adds responses to an individuals repertoire
• Differential reinforcement of successive
  approximations

22
Shaping

• Artificial (i.e., deliberate)

23
Deliberate Shaping

• Select a final target behavior
• Measure current distribution (baseline)
• Differentially reinforce an approx.
• Diff. reinf. new approx.
• Place previous approx. on EXT
• Continue until target behavior occurs

24
Eckerman et al. (1980)

• Interested in developing principles of shaping
• Two questions
• Step Size?
• How fast (i.e., step rate)?

25
Eckerman et al. (1980)
26
(No Transcript)
27
(No Transcript)
28
Induction (Response Generalization)
Functional Operant Class
29
(No Transcript)
30
Small Steps
31
Small Steps
32
Small Steps
33
Small Steps
34
Small Steps
35
Small Steps
36
Small Steps
37
Large Steps
38
Large Steps
39
Large Steps
40
Large Steps
41
Eckerman et al. (1980)Independent Variables

• Step Size Change in distance each step
• Step Rate How long at each step

42
Eckerman et al. (1980)Dependent Variable

• Accuracy
• Percentage of pecks at target locations

43
Eckerman et al. (1980)Results

• Accuracy was unaffected by step size or step rate
  
• Just as accurate with large steps and a criterion
  that changes rapidly
• Under these conditions, relatively large steps
  and relatively rapid change are best

44
Small Steps
45
Small Steps
46
Small Steps
47
Small Steps
48
Small Steps
49
Small Steps
50
v
v
Small Steps
51
Small Steps
52
Large Steps
53
Large Steps
54
Large Steps
55
Large Steps
56
Large Steps
57
Large Steps
58
Large Steps
59
Eckerman et al. (1980)Results

• Accuracy was unaffected by step size or step rate
  
• Just as accurate with large steps and a criterion
  that changes rapidly
• Under these conditions, relatively large steps
  and relatively rapid change are best