Comparison of the predictive validity and consistency among preference assessment procedures: a review of the literature.
Use paired-stimulus or MSW preference tests for the most reliable reinforcer picks; pictures work only if you add a quick sample.
01Research in Context
What this study did
Kang et al. (2013) read 14 studies that compared different ways to find reinforcers. They looked only at people with developmental delays. They asked which methods give the same top items over time and which items really work as reinforcers.
The team coded how each study ran the test, how many items it used, and how well it predicted later reinforcer strength.
What they found
Single-stimulus and paired-stimulus tests usually picked the same high-preference items. Free-operat tests often picked different favorites. When studies ran a quick reinforcer check, items from MSW or paired formats worked best.
Longer sessions and pictures instead of real items lowered the match between the test and later reinforcer strength.
How this fits with other research
Kodak et al. (2009) found the same split: MSW and free-operat lists did not line up for half their kids. Soyeon’s review pools that data and shows the mismatch is common.
Conine et al. (2019) showed kids now pick leisure items more than older papers reported. Soyeon’s review did not include this shift, so you may want to test both edibles and leisure today.
Villafaña et al. (2023) tested picture cards for food-avoiding kids and got clean matches to real edible tests. Soyeon warned pictures can lower validity, but the new study shows that adding a quick taste sample fixes the problem.
Why it matters
Pick one format and stick with it. Use paired-stimulus or MSW for the most reliable reinforcer picks. If you must use pictures, give a brief taste or touch sample right after the choice. Re-test every few weeks and always run a short reinforcer probe before starting teaching programs.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Run a 5-item paired-stimulus test, then do a 2-minute reinforcer check to confirm the top item increases responding.
02At a glance
03Original abstract
We reviewed 14 experimental studies comparing different preference assessments for individuals with developmental disabilities that were published in peer-reviewed journals between 1985 and 2012. Studies were summarized based on the following six variables: (a) the number of participants, (b) the type of disability, (c) the number and type of stimuli, (d) the average duration of administration, (e) compared procedures, and (f) results. Studies were also classified in terms of the predictive validity and consistency of the preference assessment results. The results suggest the preference assessment procedures that may produce more accurate predictions for the reinforcing effects of identified stimuli and consistent preference results. The findings are discussed in relation to the previous literature. Evidence based modifications of the most efficient preference assessment are also discussed.
Research in developmental disabilities, 2013 · doi:10.1016/j.ridd.2012.12.021