Assessment & Research

Big data in autism research: Methodological challenges and solutions.

Lee et al. (2023) · Autism research : official journal of the International Society for Autism Research 2023
★ The Verdict

Giant autism data sets promise breakthroughs, yet they need the same pre-registered plans and team oversight you demand in a single-case design.

✓ Read this if BCBAs who mine large autism data sets or sit on multi-site research teams.
✗ Skip if Practitioners who only run one-to-one sessions with no plan to share data.

01Research in Context

01

What this study did

Scior et al. (2023) wrote a theoretical paper. They looked at giant autism data sets. They asked how to keep those sets clean and useful.

The authors said big data can fool you. Without tight controls, noise looks like truth. They urged team science and strict design.

02

What they found

The paper found no new facts. Instead, it gave a warning. Huge samples mean huge mistakes if you skip the checks you use in small trials.

They listed fixes: pre-register your plan, share code, and invite statisticians, clinicians, and autistic people to the table.

03

How this fits with other research

LaPoint et al. (2025) extends this call. Two years later, they told autism intervention journals to demand trial registration and open protocols. The 2023 big-data plea became 2025 editorial policy.

Tromans et al. (2018) shows why the warning matters. Their survey of 529 RCTs found most had only 36 participants. Small studies stay small because teams work alone; big data promises scale, but K et al. say scale without rigor just makes bigger errors.

Swenson (2008) sang the same tune 15 years earlier. That paper warned autism genetics needed thousands of families and ancestry matching. Scior et al. (2023) echoes: large samples are fine only if you control confounds, whether genes or gigabytes.

04

Why it matters

If you sit on a data-sharing team, treat the upload like an RCT. Write the analysis plan before you touch the file. Lock it in a registry. Invite a BCBA, a statistician, and an autistic advocate to weekly calls. Big autism data can reveal new patterns, but only if you keep the small-study discipline that LaPoint and others keep demanding.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Draft a one-page analysis plan and share it with your team before opening the next data file.

02At a glance

Intervention
not applicable
Design
theoretical
Finding
not reported

03Original abstract

While the concept of big data has emerged over the past decade as a hot topic in nearly all areas of scientific inquiry, it has rarely been discussed in the context of autism research. In this commentary we describe aspects of big data that are relevant to autism research and methodological issues such as confounding and data error that can hamper scientific investigation. Although big data studies can have transformative impact, bigger is not always better, and big data require the same methodological considerations and interdisciplinary collaboration as "small data" to extract useful scientific insight.

Autism research : official journal of the International Society for Autism Research, 2023 · doi:10.1001/jamanetworkopen.2019.0154