The maximization of overall reinforcement rate on concurrent chains.
Animals drift toward richer concurrent chains but stop short of the rate-maximizing split, so clinicians must supplement schedules with added cues or shaping.
01Research in Context
What this study did
Houston et al. (1987) built a math model of concurrent-chain schedules. They asked: do animals pick the chain that gives the most total reward per minute?
The model kept reinforcement rate constant but let reward size vary across chains. It predicted general trends, not exact choice splits.
What they found
When one chain delivered bigger pay-offs, animals moved toward it, but not as far as the rate-maximizing formula said they should.
The paper labels this a systematic deviation: choice follows the direction of maximization yet undershoots the precise optimal split.
How this fits with other research
Fovel et al. (1989) later showed mice doing almost perfect maximizing on VR-VI chains when reward duration, not size, was varied. The two studies sit side-by-side: size differences create deviation; duration differences do not.
Hinson (1988) added another wrinkle. He varied both rate and duration at once and saw animals slide toward indifference as overall rate rose. That empirical result sharpens the 1987 model by showing rate changes can wash out sensitivity to other dimensions.
Yuwiler et al. (1992) looked like a direct contradiction: pigeons on a VI analogue matched rather than maximized even when maximization should win. The clash fades once you note the species and the task structure differ; the core message stays—simple rate math cannot stand alone.
Why it matters
If you run concurrent schedules in practice, remember that bigger reinforcers pull behavior only part-way toward the mathematical best. You will need extra prompts or time to reach optimal allocation. Also, watch for duration or rate shifts elsewhere in the setting—they can override the size effect and push clients toward indifference.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →When you size up reinforcers across two options, expect clients to favor the larger one but plan extra trials or prompts to reach the optimal allocation.
02At a glance
03Original abstract
We model behavioral allocation on concurrent chains in which the initial links are independent variable-interval schedules. We also quantify the relationship between behavior during the initial links and the probability of entering a terminal link. The behavior that maximizes overall reinforcement rate is then considered and compared with published experimental data. Although all the trends in the data are predicted by rate maximization, there are considerable deviations from the predictions of rate maximization when reward magnitudes are unequal. We argue from our results that optimal allocation on concurrent chains, and prey choice as used in the theory of optimal diets, are distinct concepts. We show that the maximization of overall rate can lead to apparent violations of stochastic transitivity.
Journal of the experimental analysis of behavior, 1987 · doi:10.1901/jeab.1987.48-133