Reinforcement uncertainty enhances preference for choice in humans
People only fight for choice when the payoff is a coin-flip; sure things remove the urge to choose.
01Research in Context
What this study did
Rost (2018) asked college students to pick between two computer keys. One key always gave a point. The other key gave a point only half the time.
Students could choose which key to press, or the computer picked for them. The test happened in short sessions across several days.
What they found
When points were unsure, students wanted to choose the key themselves. When points were guaranteed, they stopped caring about choice.
Certain rewards erased the need to control the pick.
How this fits with other research
Hanratty et al. (2021) extend this idea. They first let students taste varied prizes, then let them choose. After tasting variety, students still wanted choice even when rewards were sure.
May (2019) moves the lab result into a classroom. Students picked their own reading tasks. Choice helped only when the teacher also gave quick praise for on-task behavior. Without praise, choice did nothing.
Deshais et al. (2019) shows even first-graders vote for the reward system they like. Kids still want a say, even when the prize odds are fixed.
Together, these papers show uncertainty sparks choice, but other cues—like past variety or teacher attention—can keep that spark alive when odds turn certain.
Why it matters
In your session, build a little mystery. Put a highly preferred item in a closed bag and let the learner pick when to open it. Once the item is 100% known, switch to learner-selected activities to keep motivation high.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Hide a favorite edible in a mystery box and let the client choose when to open it—then track how many tasks they complete before asking for the reveal.
02At a glance
03Original abstract
Under concurrent-chains schedules of reinforcement, participants often prefer situations that allow selection among alternatives (free choice) to situations that do not (forced choice). The present experiment examined the effects of reinforcement probability on choice preferences. Preferences for free versus forced choice were measured under a condition in which participants' choices were always reinforced (reinforcement probability of 1.0) and a condition in which outcomes were uncertain (reinforcement probability of 0.5). Forty-four college students participated and preferences were examined under a concurrent-chains schedule of reinforcement. Participants preferred free choice under uncertain reinforcement, but a bias toward free choice was not observed when reinforcement was certain. These results align with previous findings of preference for free choice under conditions of uncertainty, but suggest that preference may be dependent upon probabilistic reinforcement contingencies in the terminal links of the concurrent-chains arrangement. Thus, reinforcement probability is an important variable to consider when conducting similar studies on the value of choice.
Journal of the Experimental Analysis of Behavior, 2018 · doi:10.1002/jeab.449