Assessment & Research

Vineland-3 Measurement Non-Invariance in Children With and Without Intellectual and Developmental Disabilities.

McClain et al. (2023) · American journal on intellectual and developmental disabilities 2023
★ The Verdict

Vineland-3 raw scores may shift meaning across IDD and non-IDD groups—verify metric invariance or switch to person-ability values.

✓ Read this if BCBAs who track adaptive behavior change in mixed-ID classrooms or clinical trials.
✗ Skip if Practitioners using only teacher ratings or single-ID caseloads.

01Research in Context

01

What this study did

McClain et al. (2023) asked a simple question. Do Vineland-3 scores mean the same thing for kids with IDD and kids without IDD?

They ran a measurement-invariance test on the Comprehensive Interview Form. The sample mixed youth with intellectual disability, developmental delay, and neurotypical peers.

02

What they found

The test showed configural invariance. In plain words, the same questions load on the same domains for both groups.

But metric invariance looked shaky. A one-point score jump may not reflect the same skill gain in each group. Direct score comparisons are risky.

03

How this fits with other research

Thurm et al. (2020) already warned that adaptive scales often miss real change. Their review sets the stage for the new warning.

Halladay (2025) flips the mood. The 2025 review still backs Vineland-3 for ID trials, urging person-ability scores to dodge floor effects.

The two papers seem to clash. One says "watch out, scores may drift," the other says "use it, just score it smarter." The gap is method, not message. Brunson flags a psychometric trap; Alycia offers a scoring workaround.

Nordstrand et al. (2015) adds comfort. Their Bayley-III low-verbal study found no item bias in toddlers. Younger kids with delay kept pace, showing invariance can hold when the tool is built for low language.

04

Why it matters

Before you compare baseline and exit Vineland-3 scores across kids with and without IDD, check the metric. If the scale units stretch differently, a five-point gain may look big for one child and small for another. Run a quick invariance check in your stats package, or use person-ability values instead of raw scores. Either step keeps your progress graphs honest and your treatment decisions solid.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Export your Vineland-3 file into Winsteps or R, run a metric-invariance test, and plot person-ability scores if p<.05.

02At a glance

Intervention
not applicable
Design
other
Sample size
1192
Population
intellectual disability, developmental delay, neurotypical
Finding
inconclusive

03Original abstract

Measurement of adaptive skills is important in the diagnosis, intervention planning, and progress monitoring of children with intellectual and developmental disabilities (IDD). Thus, ensuring accurate measurement, including measurement invariance, across children with and without IDD is critical. In this study, we evaluate the measurement invariance using multigroup confirmatory factor analysis (MG-CFA) of the Vineland-3 Comprehensive Interview (CIF) across children ages 6-21 years with and without IDD (N = 1,192) using archival data. Results showed that the Vineland-3 CIF exhibits configural invariance but may show some metric non-invariance in children with and without IDD. Suggestions for using the Vineland-3 CIF in this population are provided and future research and measure development needs are discussed.

American journal on intellectual and developmental disabilities, 2023 · doi:10.1352/1944-7558-128.4.334