Assessment & Research

Comparison of visual analysis, non-overlap methods, and effect sizes in the evaluation of parent implemented functional assessment based interventions.

Barton et al. (2019) · Research in developmental disabilities 2019
★ The Verdict

Visual-analysis words are all over the map and rarely match NAP or Tau-U—lock your labels and add numbers before you share the graph.

✓ Read this if BCBAs who write or review single-case graphs for parent-implemented FAs.
✗ Skip if Clinicians who only run standardized norm-referenced tests.

01Research in Context

01

What this study did

Barton et al. (2019) looked at 40 parent-run functional assessment studies. They checked how often authors used the same visual-analysis words. They also compared expert graph reading to two number scores: NAP and Tau-U.

02

What they found

The same graph features were called by many different names. Experts and the NAP/Tau-U numbers often disagreed on whether a change was big. The newer BC-SMD score still needs more proof.

03

How this fits with other research

Manolov et al. (2014) already told us to add trend lines and split-middle numbers to graphs. E et al. show that, even with those tips, labels stay messy and numbers still clash with eyeball tests.

Azim et al. (2025) move past single-diagnosis FA. They group kids by shared traits like poor sleep or talk delays. Their wider lens may shrink the label chaos that E et al. found.

Matson et al. (2011) found most FA work uses tiny samples of boys with ID/ASD. E et al. kept seeing the same small, narrow groups, so the disagreement problem hits the same kids again and again.

04

Why it matters

Before you send a graph to a parent, school, or journal, pick one label set and stick to it. Add a trend line and write the NAP or Tau-U under the graph. Tell the reader which word means “big change” and which means “small.” This small step can cut reviewer fights and helps parents trust the data.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Pick one glossary of visual terms, paste it in your report template, and add a NAP value under each graph before you email it.

02At a glance

Intervention
not applicable
Design
systematic review
Finding
not reported

03Original abstract

We used an existing body of research (i.e., parent implemented functional-assessment based interventions) to examine visual analysis features and processes and evaluate the reliability of two frequently used non-overlap indices (NAP & Tau-U) and a novel effect size index-the between-case standardized mean difference (BC-SMD). Results indicated that visual analysis terms and procedures were inconsistently used across studies. Further, there was limited agreement between the non-overlap indices and independent visual analysis. Results regarding the BC-SMD were inconclusive given only 5 of the 15 studies were eligible for analyses for different dependent variables. Our results suggest that visual analysis standards are needed by which single case researchers analyze and report their results. Further, additional research is needed refining SCR effect sizes, which can be used to describe the magnitude of change within and across SCR studies with functional relations.

Research in developmental disabilities, 2019 · doi:10.1016/j.ridd.2018.11.001