Diagnostic reliability of the DSM-III-R anxiety disorders. Mediating effects of patient and diagnostician characteristics.
Comorbidities and invisible anxiety symptoms cut diagnostic agreement in half—get a second opinion and demand observable data.
01Research in Context
What this study did
Delaney et al. (1998) looked at how often two clinicians give the same anxiety diagnosis. They checked if comorbid problems or clear behavior signs change the odds of agreement. The study used DSM-III-R criteria and multi-informant data, but did not report sample size or effect size.
What they found
Agreement drops when clients have extra disorders alongside anxiety. Agreement also drops when anxiety lacks obvious behavioral cues. In short, invisible or mixed pictures are harder to label the same way twice.
How this fits with other research
Szatmari (1992) already warned that DSM-III-R autism criteria over-identify cases. F et al. echo the same manual's weakness, but now for anxiety. The message across both papers: DSM-III-R labels need extra care when symptoms overlap or hide.
Reus et al. (2013) later showed that tacking ADHD onto ASD inflates parent-rated ASD severity. F et al. foreshadowed this by showing any comorbidity muddles anxiety diagnosis. Together they signal: always assess extra conditions before trusting a single severity score.
Harrop et al. (2024) found that visible behavioral inflexibility best predicts anxiety in autistic youth. F et al. made the same point in 1998: overt signs boost agreement. The two studies, 26 years apart, agree—if you can see it, you can diagnose it more reliably.
Why it matters
When you evaluate a client for anxiety, pause if comorbidities are present or if anxiety is mostly internal. Bring in a second rater, add behavior checklists, and document observable episodes. This extra step guards against mislabeling and keeps treatment plans precise.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Add a brief behavior observation checklist to your anxiety intake and have a coworker rate the same client.
02At a glance
03Original abstract
Factors influencing diagnostic reliability were examined using a sample of 267 patients who underwent two independent administrations of the Anxiety Disorders Interview Schedule--Revised (ADIS-R). Several potential mediators were examined in terms of their association with interrater agreement as measured by kappa coefficients. These included comorbidity, disorder severity, diagnostician training, patient education, presence of behavioral feature, and time separating interviews. Results suggest that several factors appear to have an important effect on diagnostic agreement, most notably, the presence or absence of comorbidity and the presence or absence of overt behavioral symptoms. Details of these influences and the impact of other selected mediators on the diagnosis of anxiety disorders are presented.
Behavior modification, 1998 · doi:10.1177/01454455980223006