Can findings from randomized controlled trials of social skills training in autism spectrum disorder be generalized? The neglected dimension of external validity.
Most autism social-skills trials hide the facts you need to repeat them—demand the checklist before you bet your program on them.
01Research in Context
What this study did
Ulf and his team read every randomized trial on social-skills training for kids with autism. They hunted for details that let you copy the program in real life.
Fifteen trials met the rules. The authors scored each paper on a 12-item checklist: who was in the study, where it ran, who gave the lessons, and how long it lasted.
What they found
Most papers skipped half of the checklist. Few said if kids had other diagnoses, what country the study was in, or how many quit early.
Without these facts you cannot tell if the same plan will work in your clinic or school.
How this fits with other research
Stewart et al. (2018) pooled parent-training trials and still found only tiny gains. Their meta-analysis shows that weak reporting is not just a social-skills problem; it haunts parent-training studies too.
Mammarella et al. (2022) looked at school-based behavior plans and saw the same hole: only most studies checked if the plan fit real classrooms. Together these papers say the field keeps designing great treatments but forgets to test if they travel.
Breider et al. (2024) is the bright spot. Their new parent-training RCT tells you the exact clinic type, staff credentials, and dropout rate—exactly what Ulf’s checklist asks for. It shows the gap can be closed when teams plan for it.
Why it matters
Before you pick a social-skills manual, flip to the methods page. If you cannot find the kids’ IQ range, setting, or lesson length, treat the results as a maybe. Use Ulf’s 12-item list when you write your next study or grant so your findings stand up in the real world.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Open the last social-skills manual you used and check if it lists participant age, IQ, setting, and dose—if any are missing, call the author before you run the next cycle.
02At a glance
03Original abstract
Systematic reviews have traditionally focused on internal validity, while external validity often has been overlooked. In this study, we systematically reviewed determinants of external validity in the accumulated randomized controlled trials of social skills group interventions for children and adolescents with autism spectrum disorder. We extracted data clustered into six overarching themes: source population, included population, context, treatment provider, treatment intervention, and outcome. A total of 15 eligible randomized controlled trials were identified. The eligible population was typically limited to high-functioning school-aged children with autism spectrum disorder, and the included population was predominantly male and Caucasian. Scant information about the recruitment of participants was provided, and details about treatment providers and settings were sparse. It was not evident from the trials to what extent acquired social skills were enacted in everyday life and maintained over time. We conclude that the generalizability of the accumulated evidence is unclear and that the determinants of external validity are often inadequately reported. At this point, more effectiveness-oriented randomized controlled trials of equally high internal and external validity are needed. More attention to the determinants of external validity is warranted when this new generation of randomized controlled trials are planned and reported. We provide a tentative checklist for this purpose.
Autism : the international journal of research and practice, 2016 · doi:10.1177/1362361315583817