ABA Fundamentals

Effects on preference of reinforcement delay, number of reinforcers, and terminal-link duration.

Poniewaz (1984) · Journal of the experimental analysis of behavior 1984
★ The Verdict

Quick task exit can override both delay and payoff size when learners pick between options.

✓ Read this if BCBAs who use token boards, chained schedules, or delayed reinforcement in clinics or classrooms.
✗ Skip if Practitioners who work only with immediate reinforcement and single-response programs.

01Research in Context

01

What this study did

Pigeons pecked two keys in a two-part choice game. First, each peck on a key started a brief "link" that always ended the same way.

Then the bird entered a "terminal" phase where it earned food after a set delay. The team varied three things: how long the wait was, how many food pellets came at the end, and how long the terminal phase stayed on.

02

What they found

Longer waits usually hurt a key’s popularity. But when the wait came with extra pellets, birds often stayed loyal to that side.

If the terminal phase ended quickly, birds picked it even when the wait was long and the payoff small. Quick escape trumped both delay and amount.

03

How this fits with other research

Lloyd (2002) seems to clash: keeping a fixed 10-second gap between delays still killed preference as absolute delays grew. The difference is procedure. Schmitt (1984) paired longer waits with more food; Lloyd (2002) held food amount flat. Extra pellets, not just the gap, kept birds choosing.

Gowen et al. (2013) extend the story into one session. They showed choice can flip from "impulsive" to "self-control" as delays rise within the same hour. Schmitt (1984) showed the static snapshot; Emma et al. showed the movie.

Rider (1983) used rats and mixed delays instead of concurrent chains. Both papers agree: sprinkle in enough short delays and subjects forgive the long ones. Species and setup differ, but the tolerance pattern holds.

04

Why it matters

When you set up token boards, response chains, or delayed praise, remember three levers: wait time, payoff size, and how fast the student can exit the activity. If the task is tough, shorten the terminal requirement first; that alone can save the program. Then add extra reinforcers if you must stretch the wait.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Let the student finish the hard task a few seconds early before you hand over the big reinforcer.

02At a glance

Intervention
not applicable
Design
single case other
Population
not specified
Finding
not reported

03Original abstract

Three experiments used concurrent-chains procedures to examine the effects of reinforcement delay, number of reinforcers, and terminal-link duration on preference. In Condition 30 of Experiment 1, food was delivered after 30 seconds in each 150-second terminal link, with four additional food deliveries occurring at 30-second intervals in one of the links. In Condition 5, food was delivered after 5 seconds in each 25-second terminal link, and the four additional reinforcers were delivered at 5-second intervals. Preferences for the multiple-food chain were greater in Condition 30. In Experiment 2, the terminal link(s) providing only one reinforcer terminated immediately after delivery of the reinforcer. Preferences for the multiple-food chain were smaller than in Experiment 1. In Condition 5 of Experiment 3, food was delivered after 5, 75, 100, 125, and 150 seconds in one 150-second link and after 5 seconds in the other. Condition 50 differed only in that the first (or only) reinforcer in each link was delivered after 50 seconds instead of after 5 seconds. Preferences for the multiple-food chain were greater in Condition 50. Results of Experiments 1 and 2 do not correspond to results obtained by Moore (1979).

Journal of the experimental analysis of behavior, 1984 · doi:10.1901/jeab.1984.42-255