Delay reduction and optimal foraging: variable-ratio search in a foraging analogue.
Delay-reduction theory beats simple rate-maximization when work is required for payoff.
01Research in Context
What this study did
Researchers let pigeons peck keys in a foraging game.
Birds could stay in one patch or fly to another.
Each patch gave food on a variable-ratio schedule.
The team pitted two theories against each other.
Delay-reduction said birds pick the patch that cuts wait time.
Rate-maximization said birds pick the patch that gives most food per minute.
The schedules were set so the theories made opposite forecasts.
What they found
In all eleven tests the birds chose the smaller, sooner reinforcer.
The result lined up with delay-reduction, not with rate-maximization.
Even when the richer patch asked for more pecks, they still took the faster payoff.
How this fits with other research
Calamari et al. (1987) saw the same pattern with fixed-ratio and progressive-ratio schedules.
They also found that birds care more about delays across trials than about overall rate.
Ghaziuddin et al. (1996) later used a similar foraging set-up and saw birds undermatch the best rate.
That study added empty patches, yet choice still tracked wait time first.
Together the papers show that effort plus delay, not just food per minute, steers choice.
Why it matters
Your clients, like pigeons, often pick the response that ends the wait fastest.
When you design reinforcement schedules, weigh both delay and effort, not just payoff size.
If you want a learner to stick with a tougher task, shrink the delay first; the rate can follow.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Put the easier, faster reinforcer first in a chain, then stretch ratio only after the learner stays.
02At a glance
03Original abstract
The present study investigated conditions under which the conditioned reinforcement principles of delay-reduction theory and views based on simple maximization of reinforcement rate make ordinally opposing predictions with respect to foraging-related choice behavior. The use of variable-ratio schedules in the choice phase also represents an extension of delay-reduction theory to schedules that may better mimic the effort involved in searching. Pigeons responded on modified concurrent-chains schedules in which equal variable-ratio schedules led to unequal variable-interval outcomes and unequal reinforcer amounts. All 4 subjects completed a minimum of two replications of conditions for which the predictions of delay-reduction theory and a simple rate-maximizing theory were opposed. Results were consistent with delay reduction's ordinal predictions in 11 of 11 replications of the divergent predictions favoring the smaller, more immediate alternative. The predictions of rate maximization were upheld only when they were consistent with those of delay reduction. Results are discussed in terms of conditioned reinforcement, sensitivity to reductions in delay to food, and possible rules of thumb that may be useful in characterizing foraging.
Journal of the experimental analysis of behavior, 1994 · doi:10.1901/jeab.1994.61-465