Practitioner Development

The effects of in-service training alone and in-service training with feedback on data collection accuracy for direct-care staff working with individuals with intellectual disabilities.

Jerome et al. (2014) · Research in developmental disabilities 2014
★ The Verdict

Add brief, specific feedback to in-service training to double data-collection accuracy of residential staff.

✓ Read this if BCBAs who supervise direct-care staff in group homes, day programs, or schools.
✗ Skip if Practitioners who already use daily feedback as part of BST.

01Research in Context

01

What this study did

Three residential staff who support adults with intellectual disabilities took part.

Each worker first got a one-hour in-service lesson on how to record problem behavior.

Then a supervisor watched them collect data and gave two minutes of spoken feedback.

The researchers tracked how many data points each staff member scored correctly.

02

What they found

Before feedback, staff scored only 42 % of data points correctly.

After two or three feedback rounds, accuracy jumped to 85 %.

The gains lasted when staff worked with new clients and at different times of day.

03

How this fits with other research

Moss et al. (2009) looked at 55 earlier studies and already said, "Pair class time with on-the-job coaching." Yaw et al. (2014) now shows that recipe works for data collection in real homes.

Blackman et al. (2022) seemed to disagree. They saw that some trainees got better just by watching others. But most still needed direct feedback to reach mastery. The two papers agree: feedback is the key ingredient, not a nice extra.

Morante et al. (2024) used video feedback to fix running form. Both studies used the same multiple-baseline design and got big, fast gains. The sport study extends the idea that brief, visual feedback works across very different skills.

04

Why it matters

Accurate data drive every treatment decision we make. This paper gives you a cheap, five-minute tool to double staff accuracy: watch, praise what went right, correct what did not, and walk away. No extra apps, no overtime. Try it in your next supervision visit.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Pick one staff, shadow data collection for ten minutes, give two minutes of spoken praise and correction, then recheck accuracy next shift.

02At a glance

Intervention
behavioral skills training
Design
multiple baseline across participants
Sample size
3
Population
intellectual disability
Finding
positive
Magnitude
large

03Original abstract

Three residential staff aged 22-38 years participated in this study which measured the accuracy of their data collection, following instruction, in-service, and in-service plus feedback. The experimenter trained them to collect data on targeted maladaptive behavior of one consumer at one time of the day. Following the in-service and the in-service plus feedback trainings, the experimenters assessed whether data collection accuracy increased for that consumer at that time and whether these improved data collection skills generalized to the other consumers and different times. The experimenter used a multiple-baseline-across-participants design to demonstrate experimental control. All three staff improved their data-collection-accuracy from instruction to in-service, and then from in-service to in-service plus feedback. Additionally, improved data collection generalized to two different consumers and two separate time periods. Future research should extend these findings of this study to measuring the effects of more accurate data collection on other functional dependent variables such as accuracy of staff implementation of behavior plans, frequency of maladaptive behavior and amount of prescribed psychotropic medications.

Research in developmental disabilities, 2014 · doi:10.1016/j.ridd.2013.11.009