Assessment & Research

Consistent Visual Analysis of Multielement Data: A Preliminary Evaluation.

Gifford et al. (2024) · Behavior modification 2024
★ The Verdict

Expert BCBAs agree strongly on whether multielement graphs show an effect, so clear visual separation is enough evidence to proceed.

✓ Read this if BCBAs who run multielement designs in clinic or school settings.
✗ Skip if Practitioners who rely only on statistical software for decision-making.

01Research in Context

01

What this study did

van der Miesen et al. (2024) asked seasoned behavior analysts to look at a stack of multielement graphs. Each graph showed two or more conditions side-by-side. The experts simply answered: “Do you see experimental control?”

The team then counted how often the judges agreed. High agreement would mean your eyes, my eyes, and every other BCBA’s eyes reach the same verdict when paths clearly split.

02

What they found

Agreement was high. When the lines in different phases moved apart, experts usually said “effect.” When the lines stayed messy, they said “no effect.” The survey supports the idea that visual analysis of multielement graphs is reliable.

03

How this fits with other research

The finding backs up Wolfe et al. (2019). That paper gave step-by-step rules for A-B-A-B and multiple-baseline graphs. Both studies say: follow a clear path and visual calls line up.

O’Grady et al. (2021) and Blair et al. (2019) show that short computer or equivalence lessons teach students to read basic AB graphs. R et al. shift the lens from trainees to veterans, showing the pros already agree once the graph type is multielement.

Kril et al. (2022) offered a decision algorithm to help novices. R et al. show experts don’t need the extra tool for multielement data; they reach the same answer without it.

04

Why it matters

You can feel safe trusting your visual check when multielement paths diverge. No extra software or formula is needed if the change is obvious. Use the moment you spot clean separation as green light to keep, modify, or fade the intervention. When paths overlap, pause and collect more data instead of second-guessing your eyes.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Show your next multielement graph to a colleague; if you both see clear separation, move ahead with the intervention.

02At a glance

Intervention
not applicable
Design
survey
Finding
positive

03Original abstract

Experimenters provided 33 graphical displays of hypothetical data depicted in a multielement experimental design to editorial board members of prominent, applied, behavior-analytic journals via an online survey. For each display, participants indicated (a) the presence or absence of experimental control and (b) the degree of experimental control (rated on a 1-100 scale). Each depiction varied systematically in (a) the number of data paths, (b) the number of data paths elevated above the control, (c) the mean difference between affected data paths and control conditions, and (d) the degree of variability within conditions. Correspondence among experts' ratings of experimental control was high across all presented graphical displays, supporting the reliability of visual analysis as an evaluative tool for these designs.

Behavior modification, 2024 · doi:10.1177/01454455231212263