Interresponse-time sensitivity during discrete-trial and free-operant concurrent variable-interval schedules.
Choice follows the time since the last response plus the last side picked—just two numbers predict what happens next.
01Research in Context
What this study did
Bell (1999) watched pigeons choose between two keys. Each key paid grain on its own variable-interval clock.
The birds worked in two set-ups: short discrete trials and long free-operant sessions. The author timed how long each bird waited between pecks.
What they found
The birds’ time since the last peck predicted where they pecked next. Only two pieces of data were needed: the pause just ended and the last side picked.
This simple two-part rule explained choice as well as older, more complex equations.
How this fits with other research
Yuwiler et al. (1992) said pigeons “match” reinforcement rates rather than “maximize” payoff. Bell (1999) agrees matching happens, but shows it is driven by the single pause before each peck.
Nevin (1969) first showed that after a reinforcer pigeons are less likely to switch keys. Bell (1999) adds that the length of the pause since the last peck sets up the next choice.
Katz et al. (2003) later changed the pay rates every few minutes and still saw matching. Their fast shifts fit the same pause-based rule Bell (1999) proposed.
Why it matters
If two timing variables guide choice in birds, your learners may also decide by “how long since I last did it” and “which option I just used.” Try watching the pause before a response; it may tell you which item, task, or place the client will pick next. Build teaching loops that reset that pause to keep the desired response active.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Time the pause before each response during a two-option preference assessment; offer the next trial when the pause favors the target item.
02At a glance
03Original abstract
Two experiments investigated the sensitivity of pigeons' choice to elapsed time since the last response (i.e., to inter-response time [IRT]) during concurrent variable-interval variable-interval schedules. Experiment 1 used a two-key discrete-trial procedure with variable intertrial intervals. Experiment 2 employed a three-key free-operant procedure. In both experiments choice was found to be a function of the active-schedule IRT, defined as the time since the most recent response. Monte Carlo simulations show how this finding permits the joining of several seemingly incompatible data sets held to both support and contradict a kind of choice strategy, termed momentary maximizing, which attempts to maximize momentary reinforcement probabilities. The studies suggest that only two variables are needed to describe the static molecular structure of concurrent variable-interval choice: active-schedule IRTs and "response states" consisting of the last one or two schedule choices.
Journal of the experimental analysis of behavior, 1999 · doi:10.1901/jeab.1999.72-317