Determining treatment outcome in early intervention programs for autism spectrum disorders: a critical analysis of measurement issues in learning based interventions.
Your ruler decides the story—use measures that matter in the kid’s real day, not just the clinic room.
01Research in Context
What this study did
Matson (2007) read dozens of early ABA papers for kids with autism.
The author asked one question: do the tests in these studies really show life change, or just lab tricks?
No new kids were tested; it is a narrative review, like a long book report.
What they found
Many papers call a program a "success" because scores on a clinic test went up.
Those same tests often ignore real-world skills like talking to friends or brushing teeth.
The review warns that shiny graphs can hide weak, useless, or fake gains.
How this fits with other research
Bolte et al. (2013) counted 289 different tools used only once across autism trials. This number proves the warning in Matson (2007) was spot-on: no common ruler means everyone makes their own.
Gitimoghaddam et al. (2022) looked at 770 ABA studies and still found almost zero quality-of-life data. The field has grown, but the blind spot Matson (2007) flagged is still there.
Eckes et al. (2023) pooled 11 strong trials and found medium IQ gains, yet no language benefit. The null language result fits Matson (2007): if you pick narrow IQ tests you may miss wider language needs.
Why it matters
Before you say a child "made progress," list the exact skill, where it will be used, and who cares. Pick one social-valid measure and one real-setting probe. Share both with parents every month so the story is about life, not just clinic charts.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Add one parent-chosen daily-life goal (like 'orders lunch') and track it at home for two weeks alongside your clinic program.
02At a glance
03Original abstract
One of the areas receiving the greatest attention from researchers studying autism spectrum disorders in recent years involves psychologically based early intervention programs. Various claims of cure, marked improvement in social and communication skills, and improved I.Q. are among the conclusions that have been drawn by various researchers. However, little has been done to analyze the dependent variables used in these studies and their impact on the conclusions reached regarding treatment effectiveness. Obviously, this set of measures is crucial since these methods define which behaviors "improved" and to what extent. The present review analyzes the current status, strengths, and weaknesses of these measurements.
Research in developmental disabilities, 2007 · doi:10.1016/j.ridd.2005.07.006