Assessment & Research

Toward an explicit technology of ecological validity

Fahmie et al. (2023) · Journal of Applied Behavior Analysis 2023
★ The Verdict

Drop the new ecological-validity checklist into your next study plan to keep your procedures, rooms, and people identical to where the child lives.

✓ Read this if BCBAs who write or read single-case research in schools, homes, or clinics.
✗ Skip if Clinicians who only follow packaged protocols and never tweak settings.

01Research in Context

01

What this study did

Fahmie et al. (2023) read every JABA article from 2019 to 2021. They looked for the words ecological validity. They wanted to see how often authors said their study looked like the real world.

The team then wrote a one-page checklist. It lists 12 places to add real-world detail when you plan a study. Things like: use the same room, toys, and people the child sees every day.

02

What they found

Most JABA papers never mention ecological validity. When they do, they rarely say how they achieved it.

The new checklist gives clear yes/no items. A reader can open any paper and quickly see if the study mirrors everyday life.

03

How this fits with other research

Wallander et al. (1983) warned that JABA authors skip key details about how they picked subjects. Fahmie’s 2023 paper shows the same gap now applies to ecological detail. Both papers end with the same fix: add a short checklist to every report.

Bergmann et al. (2023) audited JABA the same year. They found authors rarely explain procedural fidelity. Like Fahmie, they offered a checklist. Together the two papers give BCBAs twin tools: one for doing the steps right, one for keeping the steps real.

Stephens et al. (2025) found social-validity data are also scarce in functional analyses. Fahmie’s ecological checklist can piggy-back on that call: add two quick boxes for parent and teacher ratings and you cover both social and ecological validity in one go.

04

Why it matters

If your study looks nothing like the child’s classroom, the beautiful behavior change may never leave the lab. Use the checklist while you write the method section. Check off items such as ‘same lighting,’ ‘peer partners present,’ ‘materials from the classroom shelf.’ In 5 minutes you raise the odds that next month the teacher will actually run your intervention.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Open your last study draft, add the 12-item ecological-validity checklist to the method section, and tick each box you already meet.

02At a glance

Intervention
not applicable
Design
methodology paper
Finding
not reported

03Original abstract

Ecological validity refers to how closely an experiment aligns with real-world phenomena. In applied behavioral research, ecological validity may guide decisions about experimental settings, stimuli, people, and other design features. However, inconsistent use of the term ecological validity in the published literature has led to a somewhat disjointed technology. The purposes of this paper were to review current uses of the term "ecological validity" in the Journal of Applied Behavior Analysis, propose ways to make a study more ecologically valid, and develop a checklist to assist in identifying the type and degree of ecological validity in any given study.

Journal of Applied Behavior Analysis, 2023 · doi:10.1002/jaba.972