Suboptimal choice in a percentage-reinforcement procedure: effects of signal condition and terminal-link length.
A bright cue that shouts "long wait coming" can make clients abandon the better deal.
01Research in Context
What this study did
Cohen et al. (1990) worked with pigeons in a two-key chamber.
Each key led to a different terminal link. One key gave food every time. The other gave food only half the time.
The team added a twist. Sometimes a light came on and told the bird a long wait was coming. They varied how long the wait was and whether the signal appeared.
What they found
Most birds picked the sure-thing key when waits were short or silent.
When the wait was long and the light signaled it, preference flipped. Many birds now chose the risky side even though it paid less.
The signal turned a good deal into a bad one.
How this fits with other research
Nevin et al. (2016) later saw the same signal power in children. Lean signaled DRA cut problem behavior and also cut relapse. Both studies show a signal can override normal payoff rules.
Barrett et al. (1987) found that unsignaled delays hurt responding. L et al. added a signal and got the opposite: the signal made the delay costlier, so birds walked away. The two papers bracket how timing and information interact.
Malone (1975) showed pigeons like stimuli that tell them what is coming. L et al. show that if the news is "long wait," the birds stop liking it. Preference for information flips when the information is bad.
Why it matters
Your client may "choose" a lean schedule if the rich one comes with clear but aversive signals. Think of a token board that always announces a 5-minute wait before the big reinforcer. The learner might leave or act out even though the payoff is better. Try fading the signal, shortening the delay, or adding signals to both schedules so no side feels worse.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Remove or soften the warning stimulus that marks a long delay before reinforcement.
02At a glance
03Original abstract
Pigeons' choice between reliable (100%) and unreliable (50%) reinforcement was studied using a concurrent-chains procedure. Initial links were fixed-ratio 1 schedules, and terminal links were equal fixed-time schedules. The duration of the terminal links was varied across conditions. The terminal link on the reliable side always ended in food; the terminal link on the unreliable side ended with food 50% of the time and otherwise with blackout. Different stimuli present during the 50% terminal links signaled food or blackout outcomes under signaled conditions but were uncorrelated with outcomes under unsignaled conditions. In signaled conditions, most pigeons displayed a nearly exclusive preference for the 100% alternative when terminal links were short (5 or 10 s), but with terminal links of 30 s or longer, preference for the 100% alternative was sharply reduced (often to below .5). In unsignaled conditions, most pigeons showed extreme preference for the 100% alternative with either short (5 s) or longer (30 s) terminal links. Thus, pigeons' choice between reliable and unreliable reinforcement is influenced by both the signal conditions on the unreliable alternative and the duration of the terminal-link delay. With a long delay and signaled outcomes, many pigeons display a suboptimal tendency to choose the unreliable side.
Journal of the experimental analysis of behavior, 1990 · doi:10.1901/jeab.1990.53-219