Risky choice in pigeons: preference for amount variability using a token-reinforcement system.
Visible tokens can make learners gamble for variable amounts even when the safe choice pays the same.
01Research in Context
What this study did
Choi et al. (2012) let pigeons pick between two token piles. One pile always held the same number of tokens. The other pile varied: sometimes more, sometimes fewer.
The birds could trade tokens for food right away. The team then removed the tokens and ran the same choice again to see if the birds still liked the risky option.
What they found
With tokens in view, every pigeon chose the variable pile almost every time. They liked the gamble even when the average payoff was the same.
When the tokens disappeared, the preference vanished. Without the visible tokens, the birds picked the steady option. The tokens themselves, not just the food, controlled risk taking.
How this fits with other research
Davison et al. (1995) saw the opposite pattern in starlings. Those birds avoided variable food amounts when the average stayed equal. The clash is simple: starlings vs. pigeons, not a flaw in either study.
Doughty et al. (2010) showed pigeons and humans both like variable delays when tokens trade in right away. The new paper keeps the same quick-exchange setup but swaps delay for amount, proving the token effect works across both features.
Mueller et al. (2000) pushed the idea further in rats. They showed hungry rats lean toward variable pellets while well-fed rats play it safe. Together, these studies say: species, energy budget, and token visibility all shape risky choice.
Why it matters
If you run a token board or point system, remember the tokens are not neutral counters. Their mere sight can make kids chase the "maybe bigger" pile even when a sure, smaller pile is smarter. Watch for this when you offer variable bonuses or lottery-style rewards. If you want steady performance, deliver tokens without fanfare or skip variable amounts altogether.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Check if your token board shows upcoming amounts; if it does, keep the number of tokens the same each time unless you want to see risky choice.
02At a glance
03Original abstract
Pigeons were given repeated choices between variable and fixed numbers of token reinforcers (stimulus lamps arrayed above the response keys), with each earned token exchangeable for food. The number of tokens provided by the fixed-amount option remained constant within blocks of sessions, but varied parametrically across phases, assuming values of 2, 4, 6, or 8 tokens per choice. The number of tokens provided by the variable-amount option varied between 0 and 12 tokens per choice, arranged according to an exponential or rectangular distribution. In general, the pigeons strongly preferred the variable option when the fixed option provided equal or greater numbers of tokens than the variable amount. Preference for the variable amount decreased only when the alternatives provided widely disparate amounts favoring the fixed amount. When tokens were removed from the experimental context, preference for the variable option was reduced or eliminated, suggesting that the token presentation played a key role in maintaining risk-prone choice patterns. Choice latencies varied inversely with preferences, suggesting that local analyses may provide useful ancillary measures of reinforcer value. Overall, the results indicate that systematic risk sensitivity can be attained with respect to reinforcer amount, and that tokens may be critical in the development of such preferences.
Journal of the experimental analysis of behavior, 2012 · doi:10.1901/jeab.2012.98-139