Some factors controlling preference between fixed-ratio and variable-ratio schedules of reinforcement.
Learners often pick unpredictable reinforcement even when it pays less, so design VR systems that feel fun, not just efficient.
01Research in Context
What this study did
Researchers let pigeons pick between two keys. One key gave food after a fixed number of pecks. The other gave food after a variable number of pecks.
A third key let the bird switch between the two schedules. The team changed how many pecks the switch key needed and how long the delay was.
What they found
The birds almost always chose the variable-ratio side, even when it paid less. The easier and faster the switch, the stronger the preference.
The pigeons were not trying to get the most food per minute. They simply liked the unpredictable schedule.
How this fits with other research
Sturmey et al. (1996) extends this result. They showed the smallest ratio in the VR string, not the average, drives the choice. Keep the lowest component at 1 and preference stays high.
Choi et al. (2012) moves the idea to token economies. Pigeons still picked the variable option when tokens were involved, but the preference vanished without the token stimuli.
Fine et al. (2005) looks like a contradiction at first. They found only weak preference for variable intervals. The difference is schedule type: VR versus VI. Variability in ratio feels different from variability in wait time.
Why it matters
Your client may choose a VR token board even if a fixed-ratio board pays faster. Build in easy switch backs and keep the smallest VR component low to maintain engagement. Watch for cases where variability itself, not payoff, keeps the child on task.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Try a VR 3-7 token board next to the usual FR 5 board and let the client choose.
02At a glance
03Original abstract
A multiple schedule of food reinforcement for key-pecking was arranged which consisted of nine fixed-ratios, each of which operated in the presence of a different stimulus. Pigeons could complete a given fixed-ratio within the multiple schedule or, by pecking a second key, could switch from the fixed-ratio schedule to a variable-ratio schedule consisting of the same nine ratios. Stable switching behavior was established which did not maximize simple probability or rate of reinforcement. Instead, the subjects showed a stable preference for the variable-ratio schedule of food reinforcement. Increasing the number of responses required to switch, and removing the occasions on which reinforcement was delivered after a single response in the variable schedule, decreased the number of switches to the variable schedule. Periods of delay interposed between a completed switch and the availability of reinforcement after one response in the variable schedule also decreased switching to the variable schedule, particularly at long delay intervals.
Journal of the experimental analysis of behavior, 1968 · doi:10.1901/jeab.1968.11-689