Assessment & Research

Diagnostic reliability of the DSM-III-R anxiety disorders. Mediating effects of patient and diagnostician characteristics.

Chorpita et al. (1998) · Behavior modification 1998
★ The Verdict

Comorbidities and invisible anxiety symptoms cut diagnostic agreement in half—get a second opinion and demand observable data.

✓ Read this if BCBAs who diagnose or refer clients with anxiety plus other conditions.
✗ Skip if Practitioners who only run skill-acquisition programs with already-defined diagnoses.

01Research in Context

01

What this study did

Delaney et al. (1998) looked at how often two clinicians give the same anxiety diagnosis. They checked if comorbid problems or clear behavior signs change the odds of agreement. The study used DSM-III-R criteria and multi-informant data, but did not report sample size or effect size.

02

What they found

Agreement drops when clients have extra disorders alongside anxiety. Agreement also drops when anxiety lacks obvious behavioral cues. In short, invisible or mixed pictures are harder to label the same way twice.

03

How this fits with other research

Szatmari (1992) already warned that DSM-III-R autism criteria over-identify cases. F et al. echo the same manual's weakness, but now for anxiety. The message across both papers: DSM-III-R labels need extra care when symptoms overlap or hide.

Reus et al. (2013) later showed that tacking ADHD onto ASD inflates parent-rated ASD severity. F et al. foreshadowed this by showing any comorbidity muddles anxiety diagnosis. Together they signal: always assess extra conditions before trusting a single severity score.

Harrop et al. (2024) found that visible behavioral inflexibility best predicts anxiety in autistic youth. F et al. made the same point in 1998: overt signs boost agreement. The two studies, 26 years apart, agree—if you can see it, you can diagnose it more reliably.

04

Why it matters

When you evaluate a client for anxiety, pause if comorbidities are present or if anxiety is mostly internal. Bring in a second rater, add behavior checklists, and document observable episodes. This extra step guards against mislabeling and keeps treatment plans precise.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Add a brief behavior observation checklist to your anxiety intake and have a coworker rate the same client.

02At a glance

Intervention
not applicable
Design
other
Sample size
267
Population
anxiety disorder
Finding
not reported

03Original abstract

Factors influencing diagnostic reliability were examined using a sample of 267 patients who underwent two independent administrations of the Anxiety Disorders Interview Schedule--Revised (ADIS-R). Several potential mediators were examined in terms of their association with interrater agreement as measured by kappa coefficients. These included comorbidity, disorder severity, diagnostician training, patient education, presence of behavioral feature, and time separating interviews. Results suggest that several factors appear to have an important effect on diagnostic agreement, most notably, the presence or absence of comorbidity and the presence or absence of overt behavioral symptoms. Details of these influences and the impact of other selected mediators on the diagnosis of anxiety disorders are presented.

Behavior modification, 1998 · doi:10.1177/01454455980223006