Assessment & Research

Assessing the Within‐Trial Treatment Integrity of Discrete‐Trial Teaching Programs Using Sequential Analysis

Brand et al. (2017) · Behavioral Interventions 2017
★ The Verdict

Markov transition matrices expose hidden within-trial DTT errors that percent-correct scores miss so you can retrain staff with laser focus.

✓ Read this if BCBAs who supervise DTT programs in clinics or schools.
✗ Skip if Practitioners who only run naturalistic or purely verbal behavior programs.

01Research in Context

01

What this study did

Brand et al. (2017) looked at how we check staff accuracy during discrete-trial teaching. They swapped the old way—counting percent correct steps—for Markov transition matrices. These matrices map every move the therapist makes inside one trial.

The team tested kids with developmental delay or intellectual disability. They recorded each second of the trial to see if the therapist gave prompts, praise, or moved on too soon.

02

What they found

The new matrix caught tiny errors that percent-correct scores missed. For example, a therapist who skipped praise after a right answer still looked perfect on the old score sheet. The matrix flagged the missing step.

With the clearer picture, supervisors knew exactly which staff needed retraining and on which step.

03

How this fits with other research

Weinsztok et al. (2022) extend this idea. They show that bigger or better reinforcers can protect DRA from staff slip-ups. Brand shows how to spot the slip; Weinsztok shows how to cushion the fallout.

Lambert et al. (2021) also fine-tune DTT. They add quick discrimination trials after FCT so kids only ask for items that are really there. Both papers push for razor-sharp trials, one by measuring, one by teaching.

O'mara (1991) used graph theory to map equivalence links. Brand uses Markov chains to map therapist moves. Both give us math tools to see what the eye alone can’t.

04

Why it matters

If you run DTT sessions, switch from percent-correct checklists to Markov matrices. You will see inside-trial errors while they happen, not after the child stalls. Pinpoint the exact step the therapist skips—prompt, praise, or pause—and retrain only that step. Cleaner data, faster fixes, better learner progress.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Pick one learner’s program, code each therapist move in the next five trials, and build a simple Markov map to spot any skipped praise or prompt.

02At a glance

Intervention
not applicable
Design
methodology paper
Population
developmental delay, intellectual disability
Finding
positive

03Original abstract

Discrete‐trial teaching is a strategy frequently used to teach functional skills to individuals with developmental and intellectual disabilities. Research has shown that the within‐trial components of the procedure should be administered with ≥90% treatment integrity to facilitate optimal learning. Usually within‐trial treatment integrity is measured using whole‐session methods such as percentage of trials correctly administered. This study demonstrated one‐step Markov transition matrices as a method of assessing within‐trial treatment integrity. All components of discrete trials were coded and time‐stamped from video recordings of therapist–learner dyads in their typical setting (home or school). Several types of within‐trial treatment integrity errors were identified using the Markov transition matrices, error sequences that could not be identified using a percentage correct analysis. Better identification of errors has the potential both to enhance treatment integrity and to gain efficiency by targeted retraining of therapists. Copyright © 2016 John Wiley & Sons, Ltd.

Behavioral Interventions, 2017 · doi:10.1002/bin.1455