An international review of autism knowledge assessment measures.
Most autism knowledge tests are junk—use only scales with published reliability and validity.
01Research in Context
What this study did
Taylor et al. (2017) hunted for every autism knowledge test used around the world. They found 67 studies that used 44 different scales. They asked one question: do these scales actually measure what they claim to measure?
The team looked for psychometric evidence—numbers that show a test is reliable and valid. Only seven percent of the studies used tools with strong evidence. Almost half used tests with no evidence at all.
What they found
Most autism knowledge tests are “home-made.” Researchers create new questions, give them once, and never check if scores are stable or meaningful. Practitioners then adopt these untested tools for training and research.
The review warns that bad scales can hide real knowledge gaps or create fake ones. Either way, programs built on shaky numbers waste time and money.
How this fits with other research
McClain et al. (2019) give hope. Their new 31-item ASKSG passed reliability and validity checks in a large sample. It is one of the rare tools that meets the standards Taylor et al. (2017) say are missing.
Tde Wit et al. (2024) show the same pattern for symptom scales. Their Autism Symptom Dimensions Questionnaire has solid psychometrics, proving good tools can be built when researchers do the math.
Stevanovic et al. (2021) sound a cross-cultural alarm. They found the Childhood Autism Rating Scale does not work the same way in six countries. This is exactly the kind of evidence Taylor et al. (2017) say is missing for knowledge tests.
Why it matters
Before you run staff training or parent classes, check the evidence behind your knowledge quiz. If the scale lacks reliability or validity data, swap it for one like the ASKSG that has numbers you can trust. Good data drive good decisions.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Download the free ASKSG manual and replace any home-made quiz you hand out in training.
02At a glance
03Original abstract
Autism spectrum disorder-specific knowledge deficits contribute to current disparities in the timing and quality of autism spectrum disorder services throughout the United States and globally. This study conducted a systematic review of Western and International literature to examine measures used to assess autism spectrum disorder knowledge. This review identified 44 unique autism spectrum disorder knowledge measures across 67 studies conducted in 21 countries. Measures used in each study were evaluated in terms of psychometric strength. Of the 67 studies reviewed, only 7% were rated as using a measure with strong psychometric support compared to 45% that were rated as using a measure with no reported psychometric support. Additionally, we examined content overlap and subdomains of autism spectrum disorder knowledge assessed (e.g. etiology, symptoms) and cross-cultural adaptation procedures utilized in the field. Based on these findings, the need for a cross-culturally valid and psychometrically sound measure of autism spectrum disorder knowledge is discussed and recommendations for improving current assessment methods are presented, including suggestions for measure subdomains.
Autism : the international journal of research and practice, 2017 · doi:10.1177/1362361316638786