Assessment & Research

Forcing square pegs into round holes: some comments on "an analysis-of-variance model for the intrasubject replication design".

Hartmann (1974) · Journal of applied behavior analysis 1974
★ The Verdict

Ditch one-way ANOVA for single-subject data—watch each client’s own graph and replicate the change.

✓ Read this if BCBAs who analyze single-case data in clinics or schools.
✗ Skip if Researchers only running large group trials.

01Research in Context

01

What this study did

Shimp (1974) wrote a short attack paper.

It said stop cramming single-subject learning curves into one-way ANOVA.

The author claimed ANOVA hides each learner’s unique path.

02

What they found

The paper found no new data.

Instead it showed that fixed-effect ANOVA treats each child like a clone.

It urged analysts to plot each subject’s own line and look for repeats across phases.

03

How this fits with other research

Bell (1999) picked up the torch. It told BCBAs to skip all p-values and trust visual analysis plus steady replication.

Falligant et al. (2022) gave you modern tools—conservative dual-criteria and fail-safe k—to make that visual check sharper without stats.

Cashon et al. (2013) seems to disagree. They added hierarchical linear modeling to single-case data and said it can strengthen, not replace, visual reads. The clash is only surface: Shimp (1974) hated old-school ANOVA, not careful modern modeling that still honors each subject’s curve.

04

Why it matters

Next time you open Excel after a reversal or multiple-baseline plot, do not click “ANOVA.”

Split the graph by participant, draw phase lines, and look for the same jump twice.

If you need extra eyes, Falligant’s aids are free online. Your decision stays visual, your kid stays unique, and your evidence stays clean.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Print your last ABAB graph, cover the names, and verify the effect repeats for each learner before you write the report.

02At a glance

Intervention
not applicable
Design
theoretical
Finding
not reported

03Original abstract

This paper critically examines the application of fixed-effect one-way analysis-of-variance procedures to learning data from a single subject. Procedures more appropriate for data obtained from intrasubject replication designs are briefly described.

Journal of applied behavior analysis, 1974 · doi:10.1901/jaba.1974.7-635