When good news leads to bad choices
Celebration cues tied to small-quick payoffs trap learners in sub-optimal choices.
01Research in Context
What this study did
McDevitt and team looked at 40 years of pigeon experiments.
They asked: what happens when a light or sound tells the bird food is coming?
All studies used two keys. One key gave a small snack right away.
The other key gave a bigger snack later, but only after a long wait.
A signal appeared when the bird picked the small-immediate key.
The review counted how often the signal made pigeons choose the worse deal.
What they found
The signal almost always pushed pigeons toward the small-quick reward.
Birds lost up to half the food they could have earned.
The brighter or louder the signal, the stronger the bad choice.
Even smart pigeons with lots of training still fell for the trap.
How this fits with other research
Ward-Horner et al. (2017) saw the opposite: some pigeons pick the big-late pile when they have to work harder for it.
The two papers seem to clash, but the difference is what the bird sees.
McDevitt’s birds got a flashy cue right after the bad choice; Ward-Horner’s birds only saw the work ahead.
Signals that celebrate the wrong choice act like mini-slot machines.
Shahan et al. (2021) add a clinical angle: when you suddenly cut good reinforcement, problem behavior roars back.
Both lines show that how we signal reinforcement matters as much as the amount.
Why it matters
If you give praise or tokens right after a quick-but-shallow response, you may lock that response in.
Pause before you pair excitement with easy answers.
Instead, save the big praise for the bigger payoff.
Try fading the cue volume or delay it a few seconds.
Small changes in what the client hears or sees can steer them toward better long-term gains.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Delay your praise by 3s when the client picks the harder task to build patience.
02At a glance
03Original abstract
Pigeons and other animals sometimes deviate from optimal choice behavior when given informative signals for delayed outcomes. For example, when pigeons are given a choice between an alternative that always leads to food after a delay and an alternative that leads to food only half of the time after a delay, preference changes dramatically depending on whether the stimuli during the delays are correlated with (signal) the outcomes or not. With signaled outcomes, pigeons show a much greater preference for the suboptimal alternative than with unsignaled outcomes. Key variables and research findings related to this phenomenon are reviewed, including the effects of durations of the choice and delay periods, probability of reinforcement, and gaps in the signal. We interpret the available evidence as reflecting a preference induced by signals for good news in a context of uncertainty. Other explanations are briefly summarized and compared.
Journal of the Experimental Analysis of Behavior, 2016 · doi:10.1002/jeab.192