Assessment & Research

Experimental functional analyses for challenging behavior: a study of validity and reliability.

Martin et al. (1999) · Research in developmental disabilities 1999
★ The Verdict

FA results can change with both the interpreter and the calendar, so treat them as temporary drafts, not final labels.

✓ Read this if BCBAs who rely on a single FA to write long-term behavior plans for adults with intellectual disability.
✗ Skip if Clinicians using daily or weekly FA probes in fast-moving treatment cycles.

01Research in Context

01

What this study did

The team ran experimental functional analyses on adults with intellectual disability. They wanted to know if different ways of reading the same data would give the same answer.

They also ran the same FA again two weeks to three months later. They checked if the second round gave the same function as the first.

02

What they found

Different experts looking at the same graphs picked different functions. One viewer might say escape, another might say attention.

When they repeated the FA weeks later, the function often flipped. The same person who once showed escape now showed attention.

03

How this fits with other research

Matson et al. (2013) seems to disagree. They found FA results stayed the same when they swapped therapists or moved from clinic to home. The key difference is time. Same-day changes in staff or room did not shake the function, but weeks of real life did.

Kahng et al. (1999) gives a same-year fix. They showed that watching minute-by-minute shifts inside one session can clear up muddy data. If T et al. had used this within-session rule, their second test might have matched the first.

Tassé et al. (2013) later cataloged hundreds of tweaks clinicians add when the standard FA is unclear. Their list of idiosyncratic antecedents and consequences is a direct answer to the poor reliability T et al. uncovered.

04

Why it matters

Your FA snapshot can age fast. Before you write a behavior plan, rerun the analysis if the last one is more than a couple of weeks old. Add within-session checks or idiosyncratic conditions if the data look fuzzy. Treat the first FA as a draft, not a verdict.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Rerun one FA condition from last month and plot the new data next to the old; note any shift in level or trend before finalizing the plan.

02At a glance

Intervention
functional analysis
Design
other
Sample size
27
Population
intellectual disability
Finding
mixed

03Original abstract

The convergent validity of an experimental (analog) functional analysis was investigated by a comparison of three separate ways of interpreting the data derived from such an assessment: two previously published methods and the criterion Z method derived by the authors. Data from the experimental functional analysis of the challenging behavior(s) of 27 individuals with intellectual disabilities were analyzed to assess agreement between the three forms of interpretation. The test-retest reliability of all three methods over periods of 2 weeks, 1 month, and 3 months was also calculated. The results suggest that the methods of interpreting function from experimental assessments can give different results and that the test-retest reliability of the experimental functional analyses is poor. The implications of these findings are discussed in relation to clinical practice.

Research in developmental disabilities, 1999 · doi:10.1016/s0891-4222(98)00037-7