Evaluating Measurement Invariance Over Time for a Personal Opportunities Scale for People With IDD: Implications for Policy and Practice.
Your favorite IDD outcome scale can quietly drift—test for measurement invariance before you trust year-to-year score changes.
01Research in Context
What this study did
Dababnah et al. (2025) checked if the Personal Opportunities Scale gives the same scores for adults with IDD at two time points. They used data from the adults who answered the same 24-item survey one year apart. The team ran a measurement-invariance test to see if the scale drifted over time.
What they found
The scale held partial invariance. Factor loadings stayed steady, but three item intercepts shifted. That means a raw score of 20 at Time-1 is not the same as 20 at Time-2. Longitudinal comparisons need statistical correction or you risk seeing fake change.
How this fits with other research
Kildahl et al. (2025) found a similar story with the Aberrant Behavior Checklist. Four of five subscales stayed invariant, but the hyperactivity/non-compliance subscale drifted. Both papers warn that even trusted scales can slip over time in ID samples.
Horovitz et al. (2011) tracked psychiatric symptoms for one year in adults with severe ID. They saw stable scores except on the PDD/Autism subscale. Their finding lines up with Sarah et al.: most items hold, but a few move, so check each subscale before you claim change.
Embregts (2000) showed the Child Behavior Checklist has poor reliability (κ = 0.27–0.52) for youth with mild ID. Sarah et al. extend that worry into adulthood and add a fix: run invariance tests instead of just reliability checks.
Why it matters
If you use the Personal Opportunities Scale for goal setting or funding reports, rerun the invariance model yearly. When intercepts shift, convert raw scores to latent means before you tell families or payers that progress rose or fell. One extra analysis saves you from mislabeling real growth as none, or none as growth.
Get CEUs on This Topic — Free
The ABA Clubhouse has 60+ on-demand CEUs including ethics, supervision, and clinical topics like this one. Plus a new live CEU every Wednesday.
Export last year’s and this year’s raw scale scores, then ask your data team for a free Mplus script to check intercept differences before writing the progress summary.
02At a glance
03Original abstract
Personal opportunities refer to chances for people with intellectual and developmental disabilities (IDD) to take self-directed action based on their interests, strengths, and preferences. This study tested for measurement invariance across five years of cross-sectional data, including data collected during the COVID-19 pandemic, to determine whether the scale performed consistently over time. Analysis revealed significant differences in both the National Core Indicators In-Person Survey (NCI-IPS) outcomes and in the Personal Opportunities scale. Measurement invariance testing indicated partial threshold and loading invariance, but not intercept invariance, suggesting that the ways in which participants perceived or responded to scale items changed over time. We recommend that researchers utilizing scaled measures with longitudinal outcomes employ statistical checks, including measurement invariance, to ensure the scale performs consistently over time.
Intellectual and developmental disabilities, 2025 · doi:10.1352/1934-9556-63.4.315