Effects on preference of reinforcement delay, number of reinforcers, and terminal-link duration.
Quick task exit can override both delay and payoff size when learners pick between options.
01Research in Context
What this study did
Pigeons pecked two keys in a two-part choice game. First, each peck on a key started a brief "link" that always ended the same way.
Then the bird entered a "terminal" phase where it earned food after a set delay. The team varied three things: how long the wait was, how many food pellets came at the end, and how long the terminal phase stayed on.
What they found
Longer waits usually hurt a key’s popularity. But when the wait came with extra pellets, birds often stayed loyal to that side.
If the terminal phase ended quickly, birds picked it even when the wait was long and the payoff small. Quick escape trumped both delay and amount.
How this fits with other research
Lloyd (2002) seems to clash: keeping a fixed 10-second gap between delays still killed preference as absolute delays grew. The difference is procedure. Schmitt (1984) paired longer waits with more food; Lloyd (2002) held food amount flat. Extra pellets, not just the gap, kept birds choosing.
Gowen et al. (2013) extend the story into one session. They showed choice can flip from "impulsive" to "self-control" as delays rise within the same hour. Schmitt (1984) showed the static snapshot; Emma et al. showed the movie.
Rider (1983) used rats and mixed delays instead of concurrent chains. Both papers agree: sprinkle in enough short delays and subjects forgive the long ones. Species and setup differ, but the tolerance pattern holds.
Why it matters
When you set up token boards, response chains, or delayed praise, remember three levers: wait time, payoff size, and how fast the student can exit the activity. If the task is tough, shorten the terminal requirement first; that alone can save the program. Then add extra reinforcers if you must stretch the wait.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Let the student finish the hard task a few seconds early before you hand over the big reinforcer.
02At a glance
03Original abstract
Three experiments used concurrent-chains procedures to examine the effects of reinforcement delay, number of reinforcers, and terminal-link duration on preference. In Condition 30 of Experiment 1, food was delivered after 30 seconds in each 150-second terminal link, with four additional food deliveries occurring at 30-second intervals in one of the links. In Condition 5, food was delivered after 5 seconds in each 25-second terminal link, and the four additional reinforcers were delivered at 5-second intervals. Preferences for the multiple-food chain were greater in Condition 30. In Experiment 2, the terminal link(s) providing only one reinforcer terminated immediately after delivery of the reinforcer. Preferences for the multiple-food chain were smaller than in Experiment 1. In Condition 5 of Experiment 3, food was delivered after 5, 75, 100, 125, and 150 seconds in one 150-second link and after 5 seconds in the other. Condition 50 differed only in that the first (or only) reinforcer in each link was delivered after 50 seconds instead of after 5 seconds. Preferences for the multiple-food chain were greater in Condition 50. Results of Experiments 1 and 2 do not correspond to results obtained by Moore (1979).
Journal of the experimental analysis of behavior, 1984 · doi:10.1901/jeab.1984.42-255