Intercoder Reliability and Validity of WebPlotDigitizer in Extracting Graphed Data.
WebPlotDigitizer is reliable enough for everyday extraction of single-case graphs.
01Research in Context
What this study did
Drevon et al. (2017) asked a simple question. Can a free web tool pull numbers from published graphs as well as two humans can?
They took 36 single-case graphs and had coders click every point with WebPlotDigitizer. Then they checked how closely different people agreed and how accurate the clicks were.
What they found
Agreement was high. Coders matched on almost every point they pulled.
The tool also hit the true values. The tiny errors that did occur were too small to change a study’s conclusion.
How this fits with other research
Manolov (2026) extends this work. Their 2026 tutorial now lists WebPlotDigitizer as the first no-install step in any SCED workflow.
Howard et al. (2019) and Tyrer et al. (2006) look like contradictions at first. They warn that visual analysis and statistics can disagree. The key difference is timing. Daniel et al. test data extraction, not the later step of deciding what the data mean. Once the points are pulled, you still need the rules those papers provide.
Lanovaz et al. (2017) hands you one such rule: keep at least three points in A and five in B before you trust dual-criteria lines drawn on the graph you just digitized.
Why it matters
If you meta-analyze single-case data or check a graph in a grant proposal, you no longer need to eyeball the figure. Open WebPlotDigitizer, trace the line, and paste the numbers into Excel. The study shows the risk of coder error is now lower than the risk of skipping the tool.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Try tracing one old graph from your files; export the values and compare with your last hand entry.
02At a glance
03Original abstract
Quantitative synthesis of data from single-case designs (SCDs) is becoming increasingly common in psychology and education journals. Because researchers do not ordinarily report numerical data in addition to graphical displays, reliance on plot digitizing tools is often a necessary component of this research. Intercoder reliability of data extraction is a commonly overlooked, but potentially important, step of this process. The purpose of this study was to examine the intercoder reliability and validity of WebPlotDigitizer (Rohatgi, 2015), a web-based plot digitizing tool for extracting data from a variety of plots, including XY coordinates of interrupted time-series data. Two coders extracted 3,596 data points from 168 data series in 36 graphs across 18 studies. Results indicated high levels of intercoder reliability and validity. Implications of and recommendations based on these results are discussed in relation to researchers involved in quantitative synthesis of data from SCDs.
Behavior modification, 2017 · doi:10.1177/0145445516673998