Assessment & Research

Performance improvement in behavioral health care: collateral effects of planned treatment integrity observations as an applied example of schedule-induced responding.

Reed et al. (2010) · Behavior modification 2010
★ The Verdict

Calendar-based integrity checks create a month-end rush that hides poor treatment—scatter your observations to beat the scallop.

✓ Read this if BCBAs who supervise staff in residential or school settings.
✗ Skip if Practitioners who only treat clients 1:1 without staff to monitor.

01Research in Context

01

What this study did

The authors pulled old treatment-integrity logs from a brain-injury residential program.

They plotted when staff were watched each month.

The pattern looked like a scallop: almost no checks early, a rush at month-end.

02

What they found

The clustered checks matched a fixed-interval scallop, a sign of schedule-induced responding.

Staff were not being watched for quality; they were being watched because the calendar said so.

The rush at the end makes the data look good on paper but hides what happens most of the month.

03

How this fits with other research

Weisberg et al. (1966) first saw this scallop in lab rats pressing a lever for food.

Byrd (1972) showed the pattern survives even when only 7% of intervals pay off, proving the schedule itself drives the behavior.

Fuesy et al. (2025) later filmed staff in a group home and found integrity only stayed high while the observer was clearly in the room—an echo of the same reactivity.

Together the four papers say: if the cue for being watched is the calendar, staff will game the calendar, not the treatment.

04

Why it matters

You can’t fix what you can’t see. Spread your integrity checks across the month like a variable schedule. Walk in on Tuesday morning week two, not Friday afternoon week four. If you must meet a quota, flip a coin each day to decide whether you observe. This keeps staff guessing and keeps your data honest.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Open your calendar and move half of this month’s planned checks to random early-week slots.

02At a glance

Intervention
not applicable
Design
other
Population
traumatic brain injury
Finding
not reported

03Original abstract

With rising interest in the role of treatment integrity on student outcomes, research has primarily focused on isolating the techniques and procedures necessary to improve staff's acquisition and maintenance of adequate levels of integrity. Despite increasing numbers of publications on this topic, there has been little discussion of the variables surrounding the collection of integrity data. Using an archived database of logged integrity observations at a residential school for children with brain injury, the authors sought to examine the degree to which integrity data collection conformed to best practices of behavioral assessment with respect to temporal sequencing. Moreover, due to the agency's goal of collecting integrity on each student per month, the authors sought to examine whether the sequencing of integrity observations scalloped similarly to responding on conjunctive fixed-interval-fixed-ratio schedules. Results indicated that a majority of the staff exhibited some form of scalloping in their collection of integrity data. This article discusses possible sources of stimulus control and the potential for reactivity on the part of the teachers being observed when integrity observations are conducted in scalloped patterns. The authors conclude with a discussion on possible procedures to support the distributed collection of integrity data in applied setting.

Behavior modification, 2010 · doi:10.1177/0145445510383524