Assessment & Research

The Evolution of Behavior Analysis: Toward a Replication Crisis?

Locey (2020) · Perspectives on Behavior Science 2020
★ The Verdict

Keep running direct replications or behavior analysis will slide into the same replication crisis that psychology faces.

✓ Read this if BCBAs who write, review, or fund research.
✗ Skip if RBTs looking for quick classroom tricks.

01Research in Context

01

What this study did

Locey (2020) wrote a think-piece, not an experiment. He asked one question: could behavior analysis fall into the same replication trap that hit psychology?

He looked at trends in our journals. More papers now use big between-group designs instead of small single-case replications.

02

What they found

The field’s old habit of repeating single-subject studies acts like a shield. It catches errors early.

That shield is cracking. Low-power group studies and the pressure for positive results invite false positives.

03

How this fits with other research

Elcoro et al. (2023) pick up where Locey stops. They give ready-made tools—citation maps and co-authorship scores—to spot silos and fix them.

Hobson (1987) and Saunders et al. (2005) cheer the move toward bigger social problems. Locey warns the same move can trade away our replication culture. The goals clash, but the fix is the same: keep running direct replications even in large-scale work.

Bowe et al. (1983) formed small clubs to protect behavioral language from mentalism. Locey wants the same club model to protect methodological purity from statistical drift.

04

Why it matters

You do not need to dump group designs, but you should anchor them with single-case replications. Build replication into grant timelines and student theses. Ask journals to welcome direct replications as much as novel findings. A five-subject replication today can save a million-dollar failure tomorrow.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Add a direct-replication condition to your next study or grant before you collect a single participant.

02At a glance

Intervention
not applicable
Design
theoretical
Finding
not reported

03Original abstract

The Open Science Collaboration (Science, 349(6251), 1–8, 2015) produced a massive failure to replicate previous research in psychology—what has been called a “replication crisis in psychology.” An important question for behavior scientists is: To what extent is behavior science vulnerable to this type of massive replication failure? That question is addressed by considering the features of a traditional approach to behavior science. Behavior science in its infancy was a natural science, inductive, within-subject approach that encouraged both direct and systematic replication. Each of these features of behavior science increased its resistance to three factors identified as responsible for the alleged replication crisis: (1) failures to replicate procedures, (2) low-power designs, and (3) publication bias toward positive results. As behavior science has evolved, the features of the traditional approach have become less ubiquitous. And if the science continues to evolve as it has, it will likely become more vulnerable to a massive replication failure like that reported by the Open Science Collaboration (Science, 349(6251), 1–8, 2015).

Perspectives on Behavior Science, 2020 · doi:10.1007/s40614-020-00264-w