ABA Fundamentals

Effects of different accessibility of reinforcement schedules on choice in humans.

Stockhorst (1994) · Journal of the experimental analysis of behavior 1994
★ The Verdict

Cut the wait, boost acceptance—people take leaner payoffs when the first reward arrives faster.

✓ Read this if BCBAs who write thinning or token plans for older learners
✗ Skip if Clinicians serving early learners who work on basic mand training

01Research in Context

01

What this study did

The researchers asked college students to pick between two schedules of reward. One schedule paid more often but made the student wait longer before each payoff. The other paid less often but let the student start sooner.

The team changed how long the wait was for the lean schedule. They wanted to see if shorter waits made people accept the leaner payoff. The whole test took place in a quiet lab room with points exchanged for money.

02

What they found

When the lean schedule made people wait a long time, most students rejected it. When the researchers cut that wait, the same students switched and accepted the leaner payoff.

The switch happened in an orderly way. Each small cut in wait time pushed more students toward the lean schedule. This pattern matches the delay-reduction hypothesis.

03

How this fits with other research

Landry et al. (1989) ran a near-copy of this choice task with pigeons. Both studies show the same rule: shorter waits boost acceptance of leaner reward. The 1989 paper adds that the rule holds even when total food rate stays the same.

Renda et al. (2018) flipped the idea around. Instead of cutting waits, they exposed rats to long waits first. After this delay training, the rats picked larger-later rewards more often. Together, the two papers show that both shortening waits and practicing long waits can shift choice.

Vos et al. (2013) looked at what happens when payoff is delayed but the delay is not shown. Response rates crashed. Stockhorst (1994) kept delays visible, so acceptance rose. The pair warns us: signal any delay you must use.

04

Why it matters

You can make lean schedules more acceptable by trimming the wait time that comes before the first payoff. In practice, deliver the first praise or token right after the target response, even if later payoffs stay sparse. If you must impose a delay, give a clear signal—like a timer or a countdown—so the learner can see the wait shrink.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Start your next reinforcement thinning session by delivering the first token immediately, then stretch the later ones.

02At a glance

Intervention
not applicable
Design
randomized controlled trial
Sample size
48
Population
neurotypical
Finding
positive

03Original abstract

Based on the delay-reduction hypothesis, a less profitable schedule should be rejected if its duration exceeds the mean delay to reinforcement. It should be accepted if its duration is shorter than the mean delay. This was tested for humans, using a successive-choice schedule. The accessibility of the less profitable (variable-interval 18 s) schedule was varied by changing the duration (in terms of a fixed interval) of the waiting-time component preceding its presentation. Forty-eight students were randomly assigned to three groups. In Phase 1, the duration of the less profitable schedule equaled the mean delay to reinforcement in all groups. In Phase 2, waiting time preceding the less profitable schedule was reduced in Group 1 and increased in Group 2. Thus, the schedule was correlated either with a relative delay increase (Group 1) or a delay reduction (Group 2). In Group 3, conditions remained unchanged. As predicted, acceptance of the less profitable schedule decreased in Group 1 and increased in Group 2. The increased acceptance in Group 2 was accompanied by a decreased acceptance of the more profitable (variable-interval 3 s) schedule, resembling a pattern of negative contrast. Response rates were higher under the component preceding (a) the more profitable schedule in Group 1 and (b) the less profitable schedule in Group 2. Implications for the modification of human choice behavior are discussed.

Journal of the experimental analysis of behavior, 1994 · doi:10.1901/jeab.1994.62-269