Assessment & Research

Development of a scale to measure fidelity to manualized group-based cognitive behavioural interventions for people with intellectual disabilities.

Jahoda et al. (2013) · Research in developmental disabilities 2013
★ The Verdict

The 30-item MAGIC scale gives BCBAs a fast, reliable way to guard fidelity in group CBT for adults with ID—and high scores forecast better anger control.

✓ Read this if BCBAs running or supervising group CBT for adults with intellectual disability.
✗ Skip if Clinicians who only do 1:1 therapy or work with children under 16.

01Research in Context

01

What this study did

Jahoda et al. (2013) built a 30-item checklist called the MAGIC scale. It tracks how closely staff run group CBT for adults with intellectual disability.

Two raters watched the same sessions and scored items like "used simple words" and "checked mood." The team then tested if high scores matched better client anger control.

02

What they found

Raters agreed strongly on each item. Higher fidelity scores predicted bigger drops in anger outbursts after the group ended.

In short, when staff followed the manual, clients got better.

03

How this fits with other research

Eussen et al. (2016) reviewed every trial they could find on mental-health care for adults with mild ID. They saw only weak proof for any method, yet group CBT had the best signal. The MAGIC scale gives teams a tool to protect that fragile signal by keeping quality high.

Goodwin et al. (2012) listed many ID mood scales but none for fidelity. MAGIC fills that gap, so researchers can now link process to outcome.

Reiss et al. (1993) built a scale for psychiatrist interview skills. Like MAGIC, it showed raters can reliably score subtle clinician behaviors on video, proving the method travels across decades and roles.

04

Why it matters

You now have a free, 30-item scale that takes 10 minutes to complete. Use it after you film any group CBT session. Share the scores with staff the same day, praise the steps they hit, and retrain the ones they missed. This quick loop keeps your anger-management groups sharp and outcomes strong.

FREE CEUs

Get CEUs on This Topic — Free

The ABA Clubhouse has 60+ on-demand CEUs including ethics, supervision, and clinical topics like this one. Plus a new live CEU every Wednesday.

60+ on-demand CEUs (ethics, supervision, general)
New live CEU every Wednesday
Community of 500+ BCBAs
100% free to join
Join The ABA Clubhouse — Free →
→ Action — try this Monday

Film your next group CBT session, score it with MAGIC that afternoon, and praise the first three items you marked as "done well" at start of next group.

02At a glance

Intervention
not applicable
Design
methodology paper
Population
intellectual disability
Finding
positive

03Original abstract

The context for the present study was a cluster-randomized controlled trial of a group-based anger-management intervention, delivered by day-service staff. We aimed to develop a scale to measure the fidelity of manualized cognitive-behavioural therapy (CBT) delivered to adults with intellectual disabilities in group-based settings. A 30-item monitoring instrument (the MAnualized Group Intervention Check: MAGIC) was adapted from an existing fidelity-monitor instrument for individual CBT. Two sessions for 27 groups were observed by pairs of monitors who had no other contact with the intervention. 16 observers participated, in 15 unique pairings. Observers recorded high levels of inter-rater reliability and the scale had good internal consistency. Fidelity ratings predicted two key outcomes of the intervention, and were themselves predicted by the therapists' clinical supervisors.

Research in developmental disabilities, 2013 · doi:10.1016/j.ridd.2013.09.006