Responding during reinforcement delay in a self-control paradigm.
Letting learners change their mind during the wait reveals true self-control better than a locked-in choice.
01Research in Context
What this study did
Researchers let pigeons pick between two keys. One key gave a small food pellet right away. The other key gave a bigger pellet after a long wait.
During the long wait the birds could keep pecking. The keys stayed active, so the birds could change their mind at any time.
The team watched how often birds switched back to the small-now key. They also counted extra pecks on the empty key.
What they found
Some birds waited and took the big late reward. Other birds pecked the small-now key during the wait and ended up with the smaller snack.
The birds that looked most self-controlled also pecked the empty key a lot. This extra pecking showed they were tempted to switch.
Letting birds change their choice made their true self-control level visible. Earlier studies that locked in the choice may have overestimated how patient the birds were.
How this fits with other research
Cullinan et al. (2001) later used the same setup with kids who have ADHD. They added delay-fading and kept reinforcer size high. All three students learned to wait up to 24 hours. The bird data hinted that kids might also peek or ask to switch during the wait.
Alsop et al. (1995) ran a similar choice game with typical preschoolers and adults. They showed that liking the food matters. When kids really loved the small treat, they picked it more often. The pigeon study adds that letting them change the choice during the wait reveals even more.
Hansen et al. (1989) found that young children do not notice delay changes. Only older kids did. Together these papers tell us to teach waiting only after kids can feel the passage of time, and to expect more switching behavior in younger clients.
Why it matters
When you run self-control programs, build in a brief window where the client can still switch. Watch for extra requests, fidgeting, or eye gaze toward the immediate reward. These micro-switches show the real strength of the delay tolerance. Use that data to decide when to lengthen the delay or add coping skills.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →During your next delay task, keep the small-now option visible and record any attempts to switch.
02At a glance
03Original abstract
Eight pigeons chose between a small, immediate reinforcer and a large, increasingly delayed reinforcer. Responding during the large-reinforcer delays was examined. During large-reinforcer delays, pecks on one key produced the small, immediate reinforcer; pecks on the other key had no effect. Thus, a pigeon could reverse its initial choice of the large, delayed reinforcer, or it could maintain its original choice. Pigeons that made a relatively high number of initial large-reinforcer choices tended to maintain these choices, and those pigeons that actually received a relatively high number of large reinforcers, tended to respond more frequently on the ineffective key during the delay periods. The findings suggest that some previous studies of self-control training in pigeons may have resulted in increased self-control partially due to a lack of opportunity for the pigeons to change their choices.
Journal of the experimental analysis of behavior, 1984 · doi:10.1901/jeab.1984.41-267