Evaluating convergent validity between RAISD and MSWO rankings across informants
Don’t trust RAISD interviews alone—run an MSWO to confirm what the learner actually prefers.
01Research in Context
What this study did
Jeglum et al. (2023) asked a simple question. Do RAISD interview rankings match MSWO choice rankings when different people answer?
They compared the two tools across informants. No new treatment was given. The goal was to see if the lists agreed.
What they found
The rankings rarely matched. RAISD and MSWO showed poor convergent validity. In plain words, the interview did not predict what was actually chosen.
How this fits with other research
Seo et al. (2016) found good agreement for the Supports Intensity Scale across informants. Their positive result seems opposite, but they studied support needs, not favorite items.
Balboni et al. (2013) also saw strong match between self-report and caregiver QOL ratings. Again, the topic differed; quality of life is easier to estimate than toy preference.
MacLean et al. (2011) and Green et al. (2020) both used CFA to show poor fit of standard IQ models. Like Jeglum, they warn that assumed structures can fail when tools are used with new groups.
Why it matters
Before you build a reinforcement array, do a quick MSWO even if the RAISD is already done. One short choice session can catch false top items and save weeks of weak reinforcement.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Pick one client, run a five-item MSWO, and compare the order to the last RAISD list.
02At a glance
03Original abstract
AbstractThe Reinforcer Assessment for Individuals with Severe Disabilities (RAISD) and multiple‐stimulus without replacement preference assessment (MSWO) are evidence‐based tools used to determine preferences indirectly through interview and observation of choice making, respectively. Often, the RAISD is used to inform the stimulus array of the MSWO. However, reports frequently vary between informants. This can lead to discrepant identification of putative reinforcers and therefore has the potential for weaker or ineffective reinforcement‐based treatments. The purpose of this study was to compare RAISD and MSWO outcomes across informants (adolescent, caregiver, and teacher) and evaluate the convergent validity between the two measures. The results indicated that across participants, RAISD and MSWO results rarely produced convergent validity. Implications for practitioners and researchers are discussed.
Behavioral Interventions, 2023 · doi:10.1002/bin.1964