Assessment & Research

Variability in staff reports of the frequency of challenging behavior.

McGill et al. (2001) · Research in developmental disabilities 2001
★ The Verdict

Staff daily logs of challenging behavior swing wildly, so confirm them with direct observation before you act.

✓ Read this if BCBAs who rely on staff tallies in group homes or day programs.
✗ Skip if Clinicians already using continuous video or automated measurement.

01Research in Context

01

What this study did

Hastings et al. (2001) asked staff to record how often clients with developmental disabilities showed challenging behavior.

They compared the daily notes made by different staff on the same clients.

The goal was to see if the numbers matched or if they jumped around.

02

What they found

The counts were all over the place.

One staff member might write "10 hand-flaps" while another wrote "40" for the same client on the same day.

Stereotyped and fast behaviors showed the biggest swings.

03

How this fits with other research

Hogg et al. (1995) already showed staff feel sad, mad, and stressed when clients act out.

Hastings et al. (2001) add that these feelings may feed into shaky numbers.

Lambrechts et al. (2009) later found staff who feel more negative also log more challenging acts, backing the idea that mood colors data.

Eisenhower et al. (2006) tried to link staff thoughts to real actions, but the fit was weak, just as P et al. warn that paper tallies can mislead.

04

Why it matters

If you write behavior goals from staff logs alone, you may pick the wrong target or miss real trends.

Use brief direct counts, partial-interval sampling, or video spot checks to double-check staff data.

Train teams to define each behavior the same way and have two people score a sample each week.

Better numbers mean better graphs, better meetings, and faster help for clients.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Pick one high-rate behavior, have two staff count it for 15 min, compare totals, and calibrate if they differ by more than one count.

02At a glance

Intervention
not applicable
Design
survey
Sample size
22
Population
developmental disability
Finding
not reported

03Original abstract

Information was collected from 88 staff about their observations of the occurrence and frequency of challenging behaviors in 22 individuals with developmental disabilities with whom they worked. Staff reports suggested considerable variability in challenging behavior in the presence of different staff and, from day to day, in the presence of the same staff. Variability was greater for stereotyped than for aggressive/destructive behavior, and for more frequent behavior. Managers reported generally less challenging behavior than their staff. The validity of the findings was discussed and their implications for research and practice considered.

Research in developmental disabilities, 2001 · doi:10.1016/s0891-4222(01)00069-5