Practitioner Development

The Effects of Remote Instructions, Rehearsal, and Feedback on Preference Assessment Implementation

Ruppel et al. (2023) · Journal of Organizational Behavior Management 2023
★ The Verdict

One short Zoom feedback session after slides and rehearsal pushed staff to a large share preference-assessment fidelity that lasted a week.

✓ Read this if BCBAs who train new RBTs or teachers on preference assessments in any setting.
✗ Skip if Practitioners who already run in-vivo feedback with perfect results and don’t need telehealth options.

01Research in Context

01

What this study did

Ruppel and team trained three new staff to run preference assessments over Zoom. First they sent a short slide deck explaining the steps. Next each staffer rehearsed on camera with a mock client. After that the trainer gave live feedback for five minutes.

They used a multiple-baseline design across the three staff. Fidelity was scored from 20-step checklists filled out by blind observers watching the Zoom recording.

02

What they found

Every staffer jumped from a large share fidelity after slides alone to 90-a large share right after the feedback session. Scores stayed above a large share one week later with no extra coaching.

When the staff ran a new assessment with different toys and a new learner, fidelity stayed high, showing the skill carried over.

03

How this fits with other research

Ausenhus et al. (2019) also used Zoom to teach preference assessments, but they gave real-time pointers while the staff worked. Ruppel waited until after the rehearsal, yet both hit mastery. The new study shows you can trim trainer time by batching feedback.

Sivaraman et al. (2020) reviewed nine global telehealth ABA projects and flagged language and cultural tweaks as must-haves. Ruppel kept everything in English with local toys, so future teams should test if the same three-step model works when materials or language change.

Sureshkumar et al. (2024) taught kids first-aid skills through telehealth video prompts. Their strong results line up with Ruppel’s: brief, well-timed remote instruction can lock in skills for people with developmental disabilities, whether you’re training staff or learners.

04

Why it matters

You can now train staff on preference assessments without leaving your office. Send the slides, watch a five-minute rehearsal on Zoom, give feedback, and you’re done. The skill sticks for at least a week and transfers to new clients, saving drive time and trainer hours.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Email your next new hire the preference-assessment slide deck, schedule a 15-minute Zoom for them to rehearse, and give live feedback using a 20-step checklist.

02At a glance

Intervention
behavioral skills training
Design
multiple baseline across participants
Sample size
3
Finding
positive
Magnitude
large

03Original abstract

The use of telehealth has seen recent growth due to the coronavirus disease, resulting in large-scale service delivery changes, which may also necessitate a shift in staff training and performance management procedures. One effective in-vivo procedure is the delivery of performance feedback. There are many characteristics that affect the efficacy of performance feedback (e.g., immediacy). Thus, it may be important to understand how remote technology also affects performance feedback. We evaluated the effects of remote feedback on the accuracy of preference assessment implementation using telehealth-based coaching with three individuals following a history of written instructions and remote rehearsal. Remote feedback was effective for all three participants. Additionally, skills maintained at high levels 1-week post-training and occurred in the presence of a novel confederate and novel stimuli for two of the three participants.

Journal of Organizational Behavior Management, 2023 · doi:10.1080/01608061.2022.2078455