Assessment & Research

Comparison of the predictive validity and consistency among preference assessment procedures: a review of the literature.

Kang et al. (2013) · Research in developmental disabilities 2013
★ The Verdict

Use paired-stimulus or MSW preference tests for the most reliable reinforcer picks; pictures work only if you add a quick sample.

✓ Read this if BCBAs writing skill-acquisition plans for clients with developmental disabilities.
✗ Skip if Clinicians already using daily reinforcer probes with edible items.

01Research in Context

01

What this study did

Kang et al. (2013) read 14 studies that compared different ways to find reinforcers. They looked only at people with developmental delays. They asked which methods give the same top items over time and which items really work as reinforcers.

The team coded how each study ran the test, how many items it used, and how well it predicted later reinforcer strength.

02

What they found

Single-stimulus and paired-stimulus tests usually picked the same high-preference items. Free-operat tests often picked different favorites. When studies ran a quick reinforcer check, items from MSW or paired formats worked best.

Longer sessions and pictures instead of real items lowered the match between the test and later reinforcer strength.

03

How this fits with other research

Kodak et al. (2009) found the same split: MSW and free-operat lists did not line up for half their kids. Soyeon’s review pools that data and shows the mismatch is common.

Conine et al. (2019) showed kids now pick leisure items more than older papers reported. Soyeon’s review did not include this shift, so you may want to test both edibles and leisure today.

Villafaña et al. (2023) tested picture cards for food-avoiding kids and got clean matches to real edible tests. Soyeon warned pictures can lower validity, but the new study shows that adding a quick taste sample fixes the problem.

04

Why it matters

Pick one format and stick with it. Use paired-stimulus or MSW for the most reliable reinforcer picks. If you must use pictures, give a brief taste or touch sample right after the choice. Re-test every few weeks and always run a short reinforcer probe before starting teaching programs.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Run a 5-item paired-stimulus test, then do a 2-minute reinforcer check to confirm the top item increases responding.

02At a glance

Intervention
not applicable
Design
systematic review
Population
developmental delay
Finding
not reported

03Original abstract

We reviewed 14 experimental studies comparing different preference assessments for individuals with developmental disabilities that were published in peer-reviewed journals between 1985 and 2012. Studies were summarized based on the following six variables: (a) the number of participants, (b) the type of disability, (c) the number and type of stimuli, (d) the average duration of administration, (e) compared procedures, and (f) results. Studies were also classified in terms of the predictive validity and consistency of the preference assessment results. The results suggest the preference assessment procedures that may produce more accurate predictions for the reinforcing effects of identified stimuli and consistent preference results. The findings are discussed in relation to the previous literature. Evidence based modifications of the most efficient preference assessment are also discussed.

Research in developmental disabilities, 2013 · doi:10.1016/j.ridd.2012.12.021