Development of a scale to measure fidelity to manualized group-based cognitive behavioural interventions for people with intellectual disabilities.
The 30-item MAGIC scale gives BCBAs a fast, reliable way to guard fidelity in group CBT for adults with ID—and high scores forecast better anger control.
01Research in Context
What this study did
Jahoda et al. (2013) built a 30-item checklist called the MAGIC scale. It tracks how closely staff run group CBT for adults with intellectual disability.
Two raters watched the same sessions and scored items like "used simple words" and "checked mood." The team then tested if high scores matched better client anger control.
What they found
Raters agreed strongly on each item. Higher fidelity scores predicted bigger drops in anger outbursts after the group ended.
In short, when staff followed the manual, clients got better.
How this fits with other research
Eussen et al. (2016) reviewed every trial they could find on mental-health care for adults with mild ID. They saw only weak proof for any method, yet group CBT had the best signal. The MAGIC scale gives teams a tool to protect that fragile signal by keeping quality high.
Goodwin et al. (2012) listed many ID mood scales but none for fidelity. MAGIC fills that gap, so researchers can now link process to outcome.
Reiss et al. (1993) built a scale for psychiatrist interview skills. Like MAGIC, it showed raters can reliably score subtle clinician behaviors on video, proving the method travels across decades and roles.
Why it matters
You now have a free, 30-item scale that takes 10 minutes to complete. Use it after you film any group CBT session. Share the scores with staff the same day, praise the steps they hit, and retrain the ones they missed. This quick loop keeps your anger-management groups sharp and outcomes strong.
Get CEUs on This Topic — Free
The ABA Clubhouse has 60+ on-demand CEUs including ethics, supervision, and clinical topics like this one. Plus a new live CEU every Wednesday.
Film your next group CBT session, score it with MAGIC that afternoon, and praise the first three items you marked as "done well" at start of next group.
02At a glance
03Original abstract
The context for the present study was a cluster-randomized controlled trial of a group-based anger-management intervention, delivered by day-service staff. We aimed to develop a scale to measure the fidelity of manualized cognitive-behavioural therapy (CBT) delivered to adults with intellectual disabilities in group-based settings. A 30-item monitoring instrument (the MAnualized Group Intervention Check: MAGIC) was adapted from an existing fidelity-monitor instrument for individual CBT. Two sessions for 27 groups were observed by pairs of monitors who had no other contact with the intervention. 16 observers participated, in 15 unique pairings. Observers recorded high levels of inter-rater reliability and the scale had good internal consistency. Fidelity ratings predicted two key outcomes of the intervention, and were themselves predicted by the therapists' clinical supervisors.
Research in developmental disabilities, 2013 · doi:10.1016/j.ridd.2013.09.006