Assessment & Research

Examining the Role of Race, Ethnicity, and Gender on Social and Behavioral Ratings Within the Autism Diagnostic Observation Schedule.

Harrison et al. (2017) · Journal of autism and developmental disorders 2017
★ The Verdict

ADOS carries a small racial/ethnic item bias—eyeball scores from minority kids closely and collect extra data near the cutoff.

✓ Read this if BCBAs giving ADOS to ethnically diverse children or making eligibility decisions from borderline scores.
✗ Skip if Clinicians who only test monolingual, non-minority adults with clear pass/fail results.

01Research in Context

01

What this study did

Taylor et al. (2017) looked for hidden bias inside ADOS scores. They checked if race, ethnicity, or gender changes how items rate social and behavior skills.

They ran a statistical scan of ADOS records. The goal was to spot items that score kids differently even when skill levels are the same.

02

What they found

Three ADOS items showed small but real racial/ethnic bias. Gender items came out clean.

In plain words, the test gives minority children slightly lower scores on a few social points, even when their true skills match peers.

03

How this fits with other research

Magaña et al. (2013) saw a similar story with the ADI-R. Social and communication scores held steady across Latino and white adolescents, but restrictive behavior scores ran lower for Latino youth.

Tafolla et al. (2025) pushed further and found ADOS-2 severity scores stayed the same whether the test was given in English or Spanish to 94 bilingual clients. This seems to clash with J et al.'s bias finding, yet the two studies looked at different questions: language form versus racial/ethnic item wording.

Hedley et al. (2010) and Lugo-Marín et al. (2019) add more Spanish-language validations. Their positive results for the ADEC-SP and AQ-Short show tools can work well once translated and re-normed, backing the idea that cultural tweaks, not wholesale replacement, fix the bias.

04

Why it matters

You already use the ADOS to help decide eligibility. This paper tells you to pause if a child is from a racial or ethnic minority group. A small score dip on a few items might reflect test bias, not less skill. When the total score is close to the cutoff, gather extra parent input, school records, or a second observation before you rule in or out. The same three items may also shift slightly if you test in Spanish, yet Tafolla et al. (2025) show the overall severity score holds across languages, so keep using your bilingual protocol with confidence.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Pull your last three borderline cases; if any involve minority children, add parent interview or classroom clip before you finalize results.

02At a glance

Intervention
not applicable
Design
other
Sample size
2458
Population
autism spectrum disorder
Finding
mixed
Magnitude
small

03Original abstract

The Autism Diagnostic Observation Schedule (ADOS) is widely used to assess symptoms of autism spectrum disorder (ASD). Given well-documented differences in social behaviors across cultures, this study examined whether item-level biases exist in ADOS scores across sociodemographic groups (race, ethnicity, and gender). We examined a subset of ten ADOS items among participants (N = 2458). Holding level of overall ADOS behavioral symptoms constant, we found significant item level bias (measurement noninvariance) for race and ethnicity on three ADOS items. Item-level bias was not apparent across gender. Although the magnitude of bias was small, our findings highlight the need to reevaluate norms and operational definitions used in assessments to increase ASD diagnostic accuracy among culturally-diverse groups.

Journal of autism and developmental disorders, 2017 · doi:10.1007/s10803-017-3176-3