Review of Methods to Equate Target Sets in the Adapted Alternating Treatments Design.
Most AATD studies do not say how they matched target sets, so start telling us your method and why you chose it.
01Research in Context
What this study did
Cariveau et al. (2021) looked at how researchers make sure target sets are equal in AATD studies. They read every AATD paper they could find and wrote down how authors said they matched the tasks.
The team wanted to see if people follow any one way to equate targets. They also asked, 'Do authors even tell us what they did?'
What they found
Just over half of the studies said anything at all about equating. When authors did speak up, the steps were all over the map. Random assignment was the most common trick, but many other ways showed up too.
No single best practice stood out. The review makes it clear that most AATD papers leave readers guessing.
How this fits with other research
Cariveau et al. (2022) picked up where Tom et al. left off. They looked at control quality in the same design and also found about half of studies missing key steps. Together, the two reviews show that AATD papers often skip both equating and control details.
Stoddard et al. (1988) warned about this problem decades ago. They offered a way to match task difficulty, yet Tom et al. show most modern studies still do not follow a standard plan.
Bolte et al. (2013) saw the same scatter-shot style when they counted outcome measures in autism trials. Across topics, reviewers keep finding wide, unhelpful variety in how researchers describe their methods.
Why it matters
If you run an AATD study, spell out exactly how you made the targets equal and why you picked that way. Add a no-treatment control and graph the data so readers can see the effect. Clear, matched sets plus strong controls give BCBAs confidence that the better score really came from the intervention, not from an easier list of tasks.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Write one sentence in your next AATD plan that says, 'Targets were equated by ___ because ___.'
02At a glance
03Original abstract
The adapted alternating treatments design is a commonly used experimental design in skill acquisition research. This design allows for the evaluation of two or more independent variables on responding to unique target sets. Equating target sets is necessary to ensure a valid comparison of the independent variables. To date, there is little guidance on best practice when equating target sets and it is unclear how researchers have done so previously. We reviewed the reported methods used to equate target sets in articles published using the adapted alternating treatments design in five behavior-analytic journals. Just over half of the studies published using the adapted alternating treatments design reported any method to equate target sets and the methods varied considerably. Alternative methods, such as random assignment, were prevalent. Considerations for best practice and avenues for future research are discussed.
Behavior modification, 2021 · doi:10.1177/0145445520903049