Average uncertainty as a determinant of observing behavior.
A 40% chance of reinforcement keeps attention high; 0% or 100% kills it.
01Research in Context
What this study did
Pigeons could peck a key to see a colored light for 20 seconds. The light told them if food was coming or not. The chance of food varied from 0% to 100% across conditions. Researchers counted how often the birds pecked to look at the light.
What they found
Pecks peaked when food came about 40% of the time. Birds hardly pecked when food was certain (0% or 100%). The graph made an upside-down U. Uncertainty itself kept the birds watching.
How this fits with other research
Jenkins et al. (1973) ran the same task first. They showed the food-cue light was a reinforcer on its own. Thomson (1974) adds the curve: attention is strongest in the middle, not at the ends.
Jason et al. (1985) moved the test to adult humans. People only watched bad-news cues when those cues helped them work faster. The two studies agree: stimuli linked to better outcomes hold attention; pure uncertainty does not.
Allan et al. (1994) later let pigeons choose between 50% and 100% payoff keys. With short delays, birds picked the risky key. Their data line up with the 1974 peak: moderate uncertainty can beat certainty when the signal has conditioned value.
Why it matters
Keep your reinforcement schedule slightly unpredictable. A 40% chance keeps eyes on you and your cues. Too much certainty or too little payoff drops attention. Try mixing in random easy trials between hard ones to hold client focus without frustration.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Program 4 unknown trials after every 6 known trials to keep the learner looking at your SD.
02At a glance
03Original abstract
After discrimination training on a multiple variable-interval extinction schedule of food reinforcement, pigeons were placed on the uncued or mixed version of the same schedule and allowed to make an optional "observing response" that converted the uncued schedule to the corresponding cued schedule by providing a 20-sec exposure to the appropriate discriminative stimulus. The schedule consisted of one hundred 40-sec components, and the probability that any one of them would be a variable-interval component was systematically varied between 0.00 and 1.00. The results showed that the amount of observing behavior was an inverted "U" function of the probability of the variable-interval component. Few observing responses occurred at probabilities of 0.00 or 1.00, and maximum responding occurred at a value less than 0.50.
Journal of the experimental analysis of behavior, 1974 · doi:10.1901/jeab.1974.22-401