Assessment & Research

The importance of characterizing intervention for individuals with autism.

Stahmer et al. (2016) · Autism : the international journal of research and practice 2016
★ The Verdict

We cannot fix or choose autism interventions until we write down exactly what we do and how well we do it.

✓ Read this if BCBAs who write or supervise comprehensive ABA programs
✗ Skip if RBTs looking for ready-made lesson plans

01Research in Context

01

What this study did

Bouck et al. (2016) wrote a position paper. They asked teams to measure every part of an autism intervention.

The authors want a simple tool that lists what is done, how long, and how well.

They say science and families cannot pick the best program until we can count and compare parts.

02

What they found

The paper does not give new data. It gives a warning.

Without clear records, we cannot know why one child progresses and another does not.

03

How this fits with other research

Kim et al. (2024) took the same idea and used it on problem behavior. They show how to log A-B-C data so you can see the true function before treatment.

Lombardo (2021) extends the call by giving a ready-made way to define subgroups. Statistically-derived prototypes let you label clients as "high-language" or "low-flexibility" before you pick parts to teach.

O’Neill et al. (2025) looked at dozens of parent-training studies. They found most reports skip details like how many minutes parents practiced or what prompts were used. The gap proves the 2016 warning is still real.

04

Why it matters

Next time you run a program, list every step on one sheet. Note dose, materials, and fidelity score. Share the sheet with parents and funders. These notes turn your case into data the field can trust and your next team can copy.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Open a shared Google Sheet and log each procedure, minute, and fidelity check for one client this week.

02At a glance

Intervention
not applicable
Design
theoretical
Population
autism spectrum disorder
Finding
not reported

03Original abstract

research-article2016 AUT0010.1177/1362361316637503AutismEditorial Editorial The importance of characterizing intervention for individuals with autism The estimated annual cost of caring for individuals with autism is US$268 billion (Leigh and Du, 2015). What is this buying? Beyond a general knowledge of setting and type of service provided (e.g. educational, mental health, speech therapy, and occupational therapy), we know very little about the type and quality of interventions being delivered. For several reasons, it is imperative that we be able to accurately and efficiently characterize the treatment that children with autism receive in their communities. One reason for this urgency links treatment to our basic understanding of mechanism and subtype in autism. Most efforts to identify different kinds of autism, using either behavioral or biological measures, have been frustratingly disappointing. Yet there is still growing consensus that autism really comprises a set of phenotypically linked dis- orders, and that if we could distinguish among them, we could improve our understanding of their basic biology, leading to more targeted treatments and supports. An important unexplored strategy for subtyping autism may be to examine response to treatment. Thus far, we have examined predictors of treatment success; however, these have primarily been relatively gross measures of intelli- gence and language use (e.g. Ben-Itzchak and Zachor, 2011). A few studies have examined specific behaviors relating to response to specific, well-characterized treat- ments (e.g. Schreibman et al., 2009; Sherer and Schreibman, 2005; Yoder and Stone, 2006). However, these studies have not led to phenotypic descriptions that provide a better understanding of either the biology that may subtype the disorder or methods to prescribe treat- ment a priori (Stahmer et al., 2010; Vivanti et al., 2014). If we wish to examine this question, we will either have to standardize treatment for a very large and heterogeneous sample of individuals with autism—a very costly endeavor—or we will have to be able to measure the active ingredients of treatment in the schools and clinics in which treatment is delivered. The second reason for characterizing intervention is the need to identify active mechanisms, with the goal of refin- ing treatments (e.g. Kasari and Lawton, 2010; Schreibman et al., 2015). Due to the complexity of treatment of autism, many evidence-based interventions are packages com- posed of several components. Each of these components has a cost associated with implementing it, including the time it takes to train providers to accurately use each Autism 2016, Vol. 20(4) 386­–387 © The Author(s) 2016 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav DOI: 10.1177/1362361316637503 aut.sagepub.com component. Evidence-based interventions with varying brand names may utilize similar components even when differing in overall theoretical orientation (Schreibman et al., 2015) and may lead to similar outcomes when imple- mented with high fidelity (Boyd et al., 2014). However, these interventions may also differ in important ways. Therefore, it is important to examine the relative contribu- tion, mechanism of action, and necessity of each compo- nent of an intervention package to achieve optimal child outcomes (Lerner et al., 2012; Sanetti et al., 2009; Schulte et al., 2009). We know that community providers often pick and choose specific components of an intervention to fit their clients and setting rather than use the package as a whole (Stahmer et al., 2005). Examining the impact of individual components of an intervention will help deter- mine whether their methods of modifying and combining treatments are likely to be both effective and efficient. If we could measure the delivery of each component accu- rately, we could dismantle components that are mostly associated with positive outcome. The third reason to characterize interventions is that we can measure the quality of care individuals with autism receive. The service delivery infrastructure for individuals with autism has not kept pace with the dra- matically increasing number of children diagnosed. Service providers rush to hang out shingles saying that they treat autism, but there are few licensure and creden- tialing practices in place. Although this has increased access to care, there continues to be extreme variability in service intensity and quality. Even if we measure the number of service hours, and perhaps the “type” of ser- vice, which may often include educational services, speech and language therapy, occupational therapy, par- ent-implemented intervention, and social skills groups, there is a huge range in the quality of intervention within these services. Families and payers have few ways of assessing the quality of the care individuals with autism receive. Similar to quality assurance and improvement procedures that have been put in place to assess the care provided for other health conditions, we need accurate measures that can be implemented with relatively little time burden to assess quality of care. The measures currently available are narrow in scope, either focused on a specific intervention or a specific service setting. Typically, intervention developers will create a Downloaded from aut.sagepub.com at UNIV CALIFORNIA DAVIS on April 25, 2016

Autism : the international journal of research and practice, 2016 · doi:10.1177/1362361316637503