Tactics to Evaluate the Evidence Base of a Nonbehavioral Intervention in an Expanded Consumer Area
Run a four-question scan before you okay any non-ABA product.
01Research in Context
What this study did
Walmsley et al. (2019) wrote a how-to paper for BCBAs who face new, non-ABA products. They list four quick checks: run a literature search, spot fad language, rate evidence quality, and ask 'what behavioral mechanism could make this work?'
The authors built the list so practitioners can screen anything from sensory swings to spelling apps before signing off in expanded areas like gerontology or brain-training camps.
What they found
The paper itself is conceptual, so there are no participant data. Instead it gives a four-question checklist you can finish in under 30 minutes.
Using the steps in order lets you rule out weak interventions early and keeps you from accidentally endorsing a flashy but empty package.
How this fits with other research
Gilroy et al. (2022) tested the 'rate evidence' step in real life. Their survey showed caregivers will swap high-evidence ABA for low-evidence fads unless you stress the science strength first. The survey results turn Walmsley's advice into a concrete talking point: lead with evidence quality.
Cowan et al. (2023) built a ready-made decision sheet for prompting choices. It is an example of the checklist idea working inside ABA: students picked better prompts with minimal supervision. Their tool shows you can move from Walmsley's abstract criteria to a one-page form.
Bottini et al. (2019) found most providers ignore research when they intersperse tasks. This gap is exactly what Walmsley's tactic wants to close: replace 'it feels right' with a quick literature check before you start.
Why it matters
Next time a family asks about a new non-ABA gadget, run the four-tactic scan before you answer. It keeps your ethical obligation, saves billable hours wasted on dead-end tools, and shows payors you use science, not marketing. Post the checklist on your clinic door so staff remember: search, spot, rate, mechanism — then decide.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Pick one non-ABA tool you were asked about last week and walk it through the four-tactic checklist with your team.
02At a glance
03Original abstract
The purpose of this article is to provide tactics for the behavior analyst to effectively evaluate the evidence base for an unfamiliar nonbehavioral intervention when expanding services. Just as behavior analysts must be aware of fad treatments in autism likely to be encountered, so, too, should practitioners become familiar with potential fad treatments in any expanded area of practice. The present article extends previous work by considering challenges surrounding contact with nonbehavioral literature in the context of an expanded consumer base. The article also considers ethical interactions with nonbehavioral professionals following appraisal of the intervention, and how adopting the strategies listed here can aid in establishing oneself as a resource. Associated barriers and solutions are presented around four tactics: (a) searching the literature, (b) recognizing and evaluating the common properties of fad treatments, (c) distinguishing quality of evidence, and (d) ascertaining behavioral mechanisms of action. Examples from gerontology will be provided to illustrate the use of the proposed tactics.
Behavior Analysis in Practice, 2019 · doi:10.1007/s40617-018-00308-3