Assessment & Research

Intercoder Reliability and Validity of WebPlotDigitizer in Extracting Graphed Data.

Drevon et al. (2017) · Behavior modification 2017
★ The Verdict

WebPlotDigitizer is reliable enough for everyday extraction of single-case graphs.

✓ Read this if BCBAs who pull data from published figures for meta-analysis, grant prep, or clinical files.
✗ Skip if Practitioners who only read already-tabulated data tables.

01Research in Context

01

What this study did

Drevon et al. (2017) asked a simple question. Can a free web tool pull numbers from published graphs as well as two humans can?

They took 36 single-case graphs and had coders click every point with WebPlotDigitizer. Then they checked how closely different people agreed and how accurate the clicks were.

02

What they found

Agreement was high. Coders matched on almost every point they pulled.

The tool also hit the true values. The tiny errors that did occur were too small to change a study’s conclusion.

03

How this fits with other research

Manolov (2026) extends this work. Their 2026 tutorial now lists WebPlotDigitizer as the first no-install step in any SCED workflow.

Howard et al. (2019) and Tyrer et al. (2006) look like contradictions at first. They warn that visual analysis and statistics can disagree. The key difference is timing. Daniel et al. test data extraction, not the later step of deciding what the data mean. Once the points are pulled, you still need the rules those papers provide.

Lanovaz et al. (2017) hands you one such rule: keep at least three points in A and five in B before you trust dual-criteria lines drawn on the graph you just digitized.

04

Why it matters

If you meta-analyze single-case data or check a graph in a grant proposal, you no longer need to eyeball the figure. Open WebPlotDigitizer, trace the line, and paste the numbers into Excel. The study shows the risk of coder error is now lower than the risk of skipping the tool.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Try tracing one old graph from your files; export the values and compare with your last hand entry.

02At a glance

Intervention
not applicable
Design
methodology paper
Finding
strongly positive

03Original abstract

Quantitative synthesis of data from single-case designs (SCDs) is becoming increasingly common in psychology and education journals. Because researchers do not ordinarily report numerical data in addition to graphical displays, reliance on plot digitizing tools is often a necessary component of this research. Intercoder reliability of data extraction is a commonly overlooked, but potentially important, step of this process. The purpose of this study was to examine the intercoder reliability and validity of WebPlotDigitizer (Rohatgi, 2015), a web-based plot digitizing tool for extracting data from a variety of plots, including XY coordinates of interrupted time-series data. Two coders extracted 3,596 data points from 168 data series in 36 graphs across 18 studies. Results indicated high levels of intercoder reliability and validity. Implications of and recommendations based on these results are discussed in relation to researchers involved in quantitative synthesis of data from SCDs.

Behavior modification, 2017 · doi:10.1177/0145445516673998