Choice: Some quantitative relations.
Taking the square root of reinforcement rates sharpens delay-reduction predictions in chained choice procedures.
01Research in Context
What this study did
E and colleagues ran pigeons in a two-key chamber. The birds first pecked on either key to enter a terminal link.
Only one terminal link ended in grain. The team varied how soon that grain arrived. They recorded which key the bird picked.
What they found
A plain delay-reduction equation missed some choices. Taking the square root of each reinforcement rate made the numbers line up better.
The tweak let one formula predict most of the birds' picks across many delay values.
How this fits with other research
Quilitch et al. (1973) had already squared delay values to fit simple concurrent schedules. Sarber et al. (1983) did the opposite—square-rooting rates—because their procedure added the extra 'chain' step. The two changes look opposite but serve different set-ups.
Jensen et al. (1973) squeezed 94% of variance out of pigeon data with a terminal-link model. The 1983 square-root move is a second, simpler way to reach similar accuracy under the same chained layout.
Later work kept borrowing the idea. Green et al. (1987) used delay-reduction to explain why birds avoid unreliable pay-offs. Hinson (1988) swapped the square root for a hyperbolic decay curve. Each paper tweaks the math, but all stay inside the delay-reduction family started here.
Why it matters
If you write token boards, chained schedules, or differential reinforcement plans, remember that raw rate alone can mislead. A quick square-root adjustment gives a closer guess of which side a client will choose. Try computing √rate for each branch the next time you set up a choice program, then watch if the prediction matches live data. The small math step costs nothing and can save you from accidental extinction of the 'losing' option.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Before your next chained DRA session, calculate √rate for each branch and place the richer option where you want more responses.
02At a glance
03Original abstract
Six pigeons responded in fifty-six conditions on a concurrent-chains procedure. Conditions included several with equal initial links and unequal terminal links, several with unequal initial links and equal terminal links, and several with both unequal initial and terminal links. Although the delay-reduction hypothesis accounted well for choice when the initial links were equal (mean deviation of .04), it fit the data poorly when the initial links were unequal (mean deviation of .18). A modification of the delay-reduction hypothesis, replacing the rates of reinforcement with the square roots of these rates, fit the data better than either the unmodified delay-reduction equation or Killeen's (1982) model. The modified delay-reduction equation was also consistent with data from prior studies using concurrent chains. The absolute rates of responding in each terminal link were well described by the same hyperbola (Herrnstein, 1970) that describes response rates on simple interval schedules.
Journal of the experimental analysis of behavior, 1983 · doi:10.1901/jeab.1983.40-1