Practitioner Development

The effect of feedback on the accuracy of checklist completion during instrument flight training.

Rantz et al. (2009) · Journal of applied behavior analysis 2009
★ The Verdict

Pair a simple bar graph with verbal praise to turn shaky checklist work into near-perfect performance that lasts.

✓ Read this if BCBAs who train staff or clients on multi-step protocols in clinics, schools, or homes.
✗ Skip if Practitioners whose trainees already score 100% without reminders.

01Research in Context

01

What this study did

Lambrechts et al. (2009) taught flight students to fill out safety checklists without errors.

After each simulator flight the instructor showed them a simple bar graph of their checklist hits and misses. He added quick verbal tips and praise for any gain.

The study used a multiple-baseline design across three trainee pilots.

02

What they found

Once the graphic plus verbal feedback started, checklist scores shot to nearly 100% for every pilot.

The high scores stayed even after the instructor stopped giving the feedback sessions.

03

How this fits with other research

Aznar et al. (2005) got the same jump in fidelity with teachers using behavior support plans. They used bi-weekly feedback instead of post-flight, but the pattern matches: brief, timed feedback plus praise equals skill that sticks.

Lattal (2004) also lifted trainer accuracy with immediate verbal feedback alone. G et al. show that adding a simple graphic gives the same lift, so you can pick either tool or pair them.

Vance et al. (2025) later moved the graphic-only idea to preschool staff and cut stationary behavior. This extends the same visual feedback trick from cockpit to classroom.

04

Why it matters

If you train staff on any step-by-step protocol, borrow this package: one graph, one sentence of praise, one quick tip. It takes two minutes after the session and pushes performance to the ceiling. Try it with RBT skill checklists, parent training data sheets, or clinic opening routines. The pilots kept the skill with zero extra work, so your team can too.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

After the next session, show the learner a quick bar graph of their checklist hits, say one thing they improved, and give genuine praise.

02At a glance

Intervention
behavioral skills training
Design
multiple baseline across participants
Sample size
8
Population
neurotypical
Finding
strongly positive
Magnitude
very large

03Original abstract

This study examined whether pilots completed airplane checklists more accurately when they receive postflight graphic and verbal feedback. Participants were 8 college students who are pilots with an instrument rating. The task consisted of flying a designated flight pattern using a personal computer aviation training device (PCATD). The dependent variables were the number of checklist items completed correctly. A multiple baseline design across pairs of participants with withdrawal of treatment was employed in this study. During baseline, participants were given postflight technical feedback. During intervention, participants were given postflight graphic feedback on checklist use and praise for improvements along with technical feedback. The intervention produced near perfect checklist performance, which was maintained following a return to the baseline conditions.

Journal of applied behavior analysis, 2009 · doi:10.1901/jaba.2009.42-497