Assessment & Research

An international review of autism knowledge assessment measures.

Harrison et al. (2017) · Autism : the international journal of research and practice 2017
★ The Verdict

Most autism knowledge tests are junk—use only scales with published reliability and validity.

✓ Read this if BCBAs who train staff, parents, or students and need a proven knowledge quiz.
✗ Skip if Clinicians who only screen or diagnose and never teach about autism.

01Research in Context

01

What this study did

Taylor et al. (2017) hunted for every autism knowledge test used around the world. They found 67 studies that used 44 different scales. They asked one question: do these scales actually measure what they claim to measure?

The team looked for psychometric evidence—numbers that show a test is reliable and valid. Only seven percent of the studies used tools with strong evidence. Almost half used tests with no evidence at all.

02

What they found

Most autism knowledge tests are “home-made.” Researchers create new questions, give them once, and never check if scores are stable or meaningful. Practitioners then adopt these untested tools for training and research.

The review warns that bad scales can hide real knowledge gaps or create fake ones. Either way, programs built on shaky numbers waste time and money.

03

How this fits with other research

McClain et al. (2019) give hope. Their new 31-item ASKSG passed reliability and validity checks in a large sample. It is one of the rare tools that meets the standards Taylor et al. (2017) say are missing.

Tde Wit et al. (2024) show the same pattern for symptom scales. Their Autism Symptom Dimensions Questionnaire has solid psychometrics, proving good tools can be built when researchers do the math.

Stevanovic et al. (2021) sound a cross-cultural alarm. They found the Childhood Autism Rating Scale does not work the same way in six countries. This is exactly the kind of evidence Taylor et al. (2017) say is missing for knowledge tests.

04

Why it matters

Before you run staff training or parent classes, check the evidence behind your knowledge quiz. If the scale lacks reliability or validity data, swap it for one like the ASKSG that has numbers you can trust. Good data drive good decisions.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Download the free ASKSG manual and replace any home-made quiz you hand out in training.

02At a glance

Intervention
not applicable
Design
systematic review
Finding
not reported

03Original abstract

Autism spectrum disorder-specific knowledge deficits contribute to current disparities in the timing and quality of autism spectrum disorder services throughout the United States and globally. This study conducted a systematic review of Western and International literature to examine measures used to assess autism spectrum disorder knowledge. This review identified 44 unique autism spectrum disorder knowledge measures across 67 studies conducted in 21 countries. Measures used in each study were evaluated in terms of psychometric strength. Of the 67 studies reviewed, only 7% were rated as using a measure with strong psychometric support compared to 45% that were rated as using a measure with no reported psychometric support. Additionally, we examined content overlap and subdomains of autism spectrum disorder knowledge assessed (e.g. etiology, symptoms) and cross-cultural adaptation procedures utilized in the field. Based on these findings, the need for a cross-culturally valid and psychometrically sound measure of autism spectrum disorder knowledge is discussed and recommendations for improving current assessment methods are presented, including suggestions for measure subdomains.

Autism : the international journal of research and practice, 2017 · doi:10.1177/1362361316638786