A validity study of the Working Group's Orientation Test for individuals with moderate to severe intellectual disability.
The Working Group Orientation Test makes too many mistakes to screen for dementia in adults with intellectual disability.
01Research in Context
What this study did
The team asked adults with moderate to severe intellectual disability to take the Working Group’s Orientation Test. Some had dementia. Some did not. The goal was to see if the quick quiz could tell the two groups apart.
It is a case-control design. Staff gave the same short test to both groups and then checked how many labels were right and how many were wrong.
What they found
The test missed a lot. It flagged many healthy adults as possibly demented and missed some who really were. In short, too many false alarms and too many misses.
Because of that, the authors say the Orientation Test should not be used alone to spot early Alzheimer’s in adults with ID.
How this fits with other research
Stevens et al. (2018) got the opposite news. Their 5-item OERA screener for autism in young kids hit 93 % sensitivity and 91 % specificity. One short test failed; another soared. The difference is age and target. G et al. tested adults with ID for memory loss. S et al. tested preschoolers for autism traits.
Faso et al. (2016) also built a new tool, the 75-item DABS, and used fancy math to make it sharp at the ID cutoff. Like G et al., they checked if scores mean what we think, but they started from scratch instead of borrowing an old dementia screen.
Kaufman et al. (2010) remind us that even getting adults with ID into a study is hard. Non-invasive tasks and clear consent help. G et al. followed that path, yet the tool itself still failed.
Why it matters
If you assess adults with ID, do not trust a quick orientation quiz to rule dementia in or out. Pair it with caregiver reports, adaptive checks, or medical work-ups. Save time and avoid wrong labels.
Get CEUs on This Topic — Free
The ABA Clubhouse has 60+ on-demand CEUs including ethics, supervision, and clinical topics like this one. Plus a new live CEU every Wednesday.
Add a second data source—like the DABS or a structured caregiver interview—before you write any dementia-related goal.
02At a glance
03Original abstract
BACKGROUND: Decline in orientation skill has been reported as an early indicator of Dementia of Alzheimer's Type (DAT). Orientation subtest of the Working Group's Test Battery was examined whether this test is useful to identify DAT patients among adults with moderate to severe ID. METHODS: Sixteen DAT patients and 35 non-demented normal controls with moderate to severe ID were followed for a year using Orientation Test. The scores on the baseline evaluation and the longitudinal changes over a 1-year period among the DAT patients and the normal controls were compared. The effects of age and etiologies of ID on the performance of Orientation were also examined. RESULTS: The DAT group's score was significantly poorer than that of the normal control group on the baseline evaluation. The score changes over the 1-year period were not significantly different between the groups. However, there was a considerable overlap between the score distributions of the two groups. The effects of age and etiologies of ID on the performance of Orientation were not significant. CONCLUSIONS: Screening DAT patients based only on the score of the Orientation Test of the Working Group's Test Battery may produce a large number of diagnostic errors.
Journal of intellectual disability research : JIDR, 2009 · doi:10.1111/j.1365-2788.2009.01191.x