ABA Fundamentals

Probability and delay in commitment.

Rachlin et al. (1987) · Journal of the experimental analysis of behavior 1987
★ The Verdict

People and pigeons lock in early when a big reward feels unlikely, treating low probability just like extra wait time.

✓ Read this if BCBAs teaching delay tolerance or gambling-risk reduction to neurotypical teens or adults.
✗ Skip if Clinicians working only with fixed-ratio food reinforcers and no choice component.

01Research in Context

01

What this study did

The team asked people and pigeons to pick between two reward paths. One path gave a small reward right away. The other path gave a bigger reward later, but only if a first-stage gamble paid off.

The gamble chance changed across trials: 90 %, 50 %, or 10 %. Subjects could lock in their choice early or wait to decide until the gamble result came out.

02

What they found

Both humans and pigeons acted the same way. When the first-stage gamble was very likely (90 %), they waited to commit. When the gamble was unlikely (10 %), they committed early, before they knew the result.

In short, low probability made both species "jump the gun" and grab the big reward path sooner.

03

How this fits with other research

Lancioni et al. (2011) later showed a similar pattern in rats and pigeons. They stretched the time between trials and saw the same drop in risky choices, backing up the 1987 link between probability and delay.

Tracey et al. (1974) had already shown that pigeons follow a "momentary maximizing" rule—pick the option that pays off most right now. Meyer et al. (1987) add the twist that low chance of payoff is treated like extra delay, so birds jump early to escape the wait.

Funderburk et al. (1983) found that signal length can flip preference for signaled versus unsignaled food. Together these studies show timing cues, probability, and commitment rules all push the same choice lever.

04

Why it matters

If you want a client to wait for a bigger reinforcer, check the odds they see. When the chance of payoff looks low, they may "commit early" to a smaller, sure thing. You can raise the perceived probability by adding clearer signals, shortening wait times, or showing repeated small wins. Try giving a 10 % shot at a large prize only after the client has seen a few easy wins first. This keeps the "gamble" from feeling like endless delay.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Before a tough task, show the client two quick, easy wins to raise perceived odds, then offer the high-payoff choice.

02At a glance

Intervention
not applicable
Design
single case other
Population
neurotypical
Finding
not reported

03Original abstract

In the first stage of a two-stage choice, human subjects chose between probabilistic access to a second choice (between a small high-probability reward and a large low-probability reward) and commitment to the large low-probability reward. When confronted with the second-stage choice, subjects strongly preferred the small high-probability reward. When the first-stage probability (of access to the second stage) was high, subjects strongly preferred the path leading to the choice in the second stage. But when the first-stage probability was low, subjects committed themselves to the large low-probability reward. These results parallel those obtained by Rachlin and Green (1972) with pigeons and constitute some evidence that probabilities may be interpreted as delays.

Journal of the experimental analysis of behavior, 1987 · doi:10.1901/jeab.1987.48-347