Assessment & Research

Review of Methods to Equate Target Sets in the Adapted Alternating Treatments Design.

Cariveau et al. (2021) · Behavior modification 2021
★ The Verdict

Most AATD studies do not say how they matched target sets, so start telling us your method and why you chose it.

✓ Read this if BCBAs who teach new skills with alternating-treatments designs or who write for journals.
✗ Skip if Clinicians who only use simple AB designs or work in non-research settings.

01Research in Context

01

What this study did

Cariveau et al. (2021) looked at how researchers make sure target sets are equal in AATD studies. They read every AATD paper they could find and wrote down how authors said they matched the tasks.

The team wanted to see if people follow any one way to equate targets. They also asked, 'Do authors even tell us what they did?'

02

What they found

Just over half of the studies said anything at all about equating. When authors did speak up, the steps were all over the map. Random assignment was the most common trick, but many other ways showed up too.

No single best practice stood out. The review makes it clear that most AATD papers leave readers guessing.

03

How this fits with other research

Cariveau et al. (2022) picked up where Tom et al. left off. They looked at control quality in the same design and also found about half of studies missing key steps. Together, the two reviews show that AATD papers often skip both equating and control details.

Stoddard et al. (1988) warned about this problem decades ago. They offered a way to match task difficulty, yet Tom et al. show most modern studies still do not follow a standard plan.

Bolte et al. (2013) saw the same scatter-shot style when they counted outcome measures in autism trials. Across topics, reviewers keep finding wide, unhelpful variety in how researchers describe their methods.

04

Why it matters

If you run an AATD study, spell out exactly how you made the targets equal and why you picked that way. Add a no-treatment control and graph the data so readers can see the effect. Clear, matched sets plus strong controls give BCBAs confidence that the better score really came from the intervention, not from an easier list of tasks.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Write one sentence in your next AATD plan that says, 'Targets were equated by ___ because ___.'

02At a glance

Intervention
not applicable
Design
scoping review
Finding
not reported

03Original abstract

The adapted alternating treatments design is a commonly used experimental design in skill acquisition research. This design allows for the evaluation of two or more independent variables on responding to unique target sets. Equating target sets is necessary to ensure a valid comparison of the independent variables. To date, there is little guidance on best practice when equating target sets and it is unclear how researchers have done so previously. We reviewed the reported methods used to equate target sets in articles published using the adapted alternating treatments design in five behavior-analytic journals. Just over half of the studies published using the adapted alternating treatments design reported any method to equate target sets and the methods varied considerably. Alternative methods, such as random assignment, were prevalent. Considerations for best practice and avenues for future research are discussed.

Behavior modification, 2021 · doi:10.1177/0145445520903049