Assessment & Research

A further consideration in the application of an analysis-of-variance model for the intrasubject replication design.

Kratochwill et al. (1974) · Journal of applied behavior analysis 1974
★ The Verdict

ANOVA is the wrong tool for single-case graphs because the data points are chained together; look at the chart or use newer mixed models.

✓ Read this if BCBAs who analyze reversal or multiple-baseline data and want defensible stats.
✗ Skip if Practitioners who only do preference assessments or discrete-trial summaries.

01Research in Context

01

What this study did

Lydersen et al. (1974) wrote a theory paper. They checked if ANOVA fits single-subject reversal designs. They showed the math breaks the independence rule. Data points in one phase depend on the point before them.

They said: use your eyes, not F-tests. Graphs and phase lines give the answer.

02

What they found

The authors found a clear flaw. ANOVA needs each score to be independent. In A-B-A designs, scores next to each other rise and fall together. That linkage spoils the test.

They urged behavior analysts to stay with visual checks and simple phase mean shifts.

03

How this fits with other research

Christophersen et al. (1972) had pushed the opposite view: ANOVA can work on reversal data. Lydersen et al. (1974) and Mulvaney et al. (1974) shot that idea down in the same journal issue. Both pairs of critics agreed: serial correlation kills the test.

DeHart et al. (2019) later offered a fix. Mixed-effects models handle the correlation and still give p-values. Their method keeps each subject’s raw data, so it respects single-case logic while adding stats.

Reid et al. (1999) and Nasr et al. (2000) widened the fight. They asked if any number-crunching summary of single cases is fair. The field still splits: some teams defend meta-analysis, others stay visual-only like T et al.

04

Why it matters

If you run reversal or multiple-baseline graphs, skip ANOVA. The rows of dots are linked like a chain; the test assumes they are not. Plot the data, draw phase lines, and look for level or trend changes. If you need a statistic for a grant or journal, try mixed-effects or randomization tests instead. Your graphs stay clean and your stats stay honest.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Open your last reversal graph and remove any ANOVA table—replace it with phase mean lines and a note on visual level change.

02At a glance

Intervention
not applicable
Design
theoretical
Finding
not reported

03Original abstract

It is argued that the analysis-of-variance model is inappropriate for assessing treatment effects in single-subject designs. In particular, such designs are demonstrated to violate the crucial assumption concerning the statistical independence of observations. Alternative methods of data analysis are suggested.

Journal of applied behavior analysis, 1974 · doi:10.1901/jaba.1974.7-629