Assessment & Research

Evaluating Measurement Invariance Over Time for a Personal Opportunities Scale for People With IDD: Implications for Policy and Practice.

Lineberry et al. (2025) · Intellectual and developmental disabilities 2025
★ The Verdict

Your favorite IDD outcome scale can quietly drift—test for measurement invariance before you trust year-to-year score changes.

✓ Read this if BCBAs who track adult IDD outcomes across annual plan renewals.
✗ Skip if Clinicians who only do single-time screenings.

01Research in Context

01

What this study did

Dababnah et al. (2025) checked if the Personal Opportunities Scale gives the same scores for adults with IDD at two time points. They used data from the adults who answered the same 24-item survey one year apart. The team ran a measurement-invariance test to see if the scale drifted over time.

02

What they found

The scale held partial invariance. Factor loadings stayed steady, but three item intercepts shifted. That means a raw score of 20 at Time-1 is not the same as 20 at Time-2. Longitudinal comparisons need statistical correction or you risk seeing fake change.

03

How this fits with other research

Kildahl et al. (2025) found a similar story with the Aberrant Behavior Checklist. Four of five subscales stayed invariant, but the hyperactivity/non-compliance subscale drifted. Both papers warn that even trusted scales can slip over time in ID samples.

Horovitz et al. (2011) tracked psychiatric symptoms for one year in adults with severe ID. They saw stable scores except on the PDD/Autism subscale. Their finding lines up with Sarah et al.: most items hold, but a few move, so check each subscale before you claim change.

Embregts (2000) showed the Child Behavior Checklist has poor reliability (κ = 0.27–0.52) for youth with mild ID. Sarah et al. extend that worry into adulthood and add a fix: run invariance tests instead of just reliability checks.

04

Why it matters

If you use the Personal Opportunities Scale for goal setting or funding reports, rerun the invariance model yearly. When intercepts shift, convert raw scores to latent means before you tell families or payers that progress rose or fell. One extra analysis saves you from mislabeling real growth as none, or none as growth.

FREE CEUs

Get CEUs on This Topic — Free

The ABA Clubhouse has 60+ on-demand CEUs including ethics, supervision, and clinical topics like this one. Plus a new live CEU every Wednesday.

60+ on-demand CEUs (ethics, supervision, general)
New live CEU every Wednesday
Community of 500+ BCBAs
100% free to join
Join The ABA Clubhouse — Free →
→ Action — try this Monday

Export last year’s and this year’s raw scale scores, then ask your data team for a free Mplus script to check intercept differences before writing the progress summary.

02At a glance

Intervention
not applicable
Design
other
Population
intellectual disability, developmental delay
Finding
inconclusive

03Original abstract

Personal opportunities refer to chances for people with intellectual and developmental disabilities (IDD) to take self-directed action based on their interests, strengths, and preferences. This study tested for measurement invariance across five years of cross-sectional data, including data collected during the COVID-19 pandemic, to determine whether the scale performed consistently over time. Analysis revealed significant differences in both the National Core Indicators In-Person Survey (NCI-IPS) outcomes and in the Personal Opportunities scale. Measurement invariance testing indicated partial threshold and loading invariance, but not intercept invariance, suggesting that the ways in which participants perceived or responded to scale items changed over time. We recommend that researchers utilizing scaled measures with longitudinal outcomes employ statistical checks, including measurement invariance, to ensure the scale performs consistently over time.

Intellectual and developmental disabilities, 2025 · doi:10.1352/1934-9556-63.4.315