Consistent Visual Analysis of Multielement Data: A Preliminary Evaluation.
Expert BCBAs agree strongly on whether multielement graphs show an effect, so clear visual separation is enough evidence to proceed.
01Research in Context
What this study did
van der Miesen et al. (2024) asked seasoned behavior analysts to look at a stack of multielement graphs. Each graph showed two or more conditions side-by-side. The experts simply answered: “Do you see experimental control?”
The team then counted how often the judges agreed. High agreement would mean your eyes, my eyes, and every other BCBA’s eyes reach the same verdict when paths clearly split.
What they found
Agreement was high. When the lines in different phases moved apart, experts usually said “effect.” When the lines stayed messy, they said “no effect.” The survey supports the idea that visual analysis of multielement graphs is reliable.
How this fits with other research
The finding backs up Wolfe et al. (2019). That paper gave step-by-step rules for A-B-A-B and multiple-baseline graphs. Both studies say: follow a clear path and visual calls line up.
O’Grady et al. (2021) and Blair et al. (2019) show that short computer or equivalence lessons teach students to read basic AB graphs. R et al. shift the lens from trainees to veterans, showing the pros already agree once the graph type is multielement.
Kril et al. (2022) offered a decision algorithm to help novices. R et al. show experts don’t need the extra tool for multielement data; they reach the same answer without it.
Why it matters
You can feel safe trusting your visual check when multielement paths diverge. No extra software or formula is needed if the change is obvious. Use the moment you spot clean separation as green light to keep, modify, or fade the intervention. When paths overlap, pause and collect more data instead of second-guessing your eyes.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Show your next multielement graph to a colleague; if you both see clear separation, move ahead with the intervention.
02At a glance
03Original abstract
Experimenters provided 33 graphical displays of hypothetical data depicted in a multielement experimental design to editorial board members of prominent, applied, behavior-analytic journals via an online survey. For each display, participants indicated (a) the presence or absence of experimental control and (b) the degree of experimental control (rated on a 1-100 scale). Each depiction varied systematically in (a) the number of data paths, (b) the number of data paths elevated above the control, (c) the mean difference between affected data paths and control conditions, and (d) the degree of variability within conditions. Correspondence among experts' ratings of experimental control was high across all presented graphical displays, supporting the reliability of visual analysis as an evaluative tool for these designs.
Behavior modification, 2024 · doi:10.1177/01454455231212263