Assessment & Research

A preliminary investigation of procedural refinements to the performance diagnostic checklist - human services

Vance et al. (2022) · Journal of Organizational Behavior Management 2022
★ The Verdict

A cutoff score plus decision model on the PDC-HS lets rookie supervisors pick the right staff intervention as well as seasoned pros.

✓ Read this if BCBAs who supervise adults in human-service settings.
✗ Skip if Clinicians who only treat clients, not staff.

01Research in Context

01

What this study did

The team tweaked the Performance Diagnostic Checklist-Human Services (PDC-HS). They added a clear cutoff score and a simple decision model. Novice practitioners used the new tool to pick staff-intervention categories.

The study compared their choices to experts’ answers. It was a quasi-experiment with adult participants.

02

What they found

Newcomers who used the refined tool chose the right category about five times more often. The extra rules removed most guesswork.

03

How this fits with other research

Brand et al. (2022) published the basic PDC-HS guide the same year. Vance et al. built on that guide and added the cutoff layer.

Rader et al. (2021) showed that even doctoral BCBAs misread graphs without help. Vance’s team proves that simple decision aids can lift novice accuracy just as much.

Mount et al. (2011) found that high data variability trips up novices. The new PDC-HS cutoff works like the IV/DV labels in that study—it gives a fixed anchor so variability does not steer the choice.

04

Why it matters

If you train new supervisors, give them the refined PDC-HS sheet. The cutoff and model turn a long team discussion into a two-minute scoring task. You will spend less time fixing wrong intervention picks and more time coaching staff.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Print the refined PDC-HS, circle the cutoff, and have your new supervisor score one live case before lunch.

02At a glance

Intervention
not applicable
Design
quasi experimental
Population
not specified
Finding
positive
Magnitude
large

03Original abstract

The Performance Diagnostic Checklist – Human Services (PDC-HS) is a functional assessment tool used in the field of Organizational Behavior Management (OBM) to assess reasons for employee performance problems and inform intervention development. There are two aspects of the intervention-selection process that could inhibit the objectivity and utility of the tool, particularly for practitioners with limited experience conducting the assessment. Proposed refinements to address these drawbacks include (a) identifying a cutoff threshold to objectively identify the categories requiring intervention based on the PDC-HS outcome, and (b) developing decision-making models to identify a single category that should be the focus of intervention. A between-groups design was used to evaluate the degree to which access to components of these proposed refinements resulted in appropriate intervention selections when practitioners in the field were presented with scenarios derived from published case studies. Binary logistic regressions indicated that practitioners with refinement access were 4.97 times more likely to select the most appropriate category for intervention, relative to those who did not have access to the refinements (p < .001, 95% OR CI [2.38,10.41]). Secondary analyses indicated variables such as certification level and experience in organizational behavior management did not significantly influence the selection of an appropriate category for intervention. Preliminary findings suggest that future applications of the PDC-HS, particularly as it relates to the intervention-selection process, may benefit from the supplemented refinements.

Journal of Organizational Behavior Management, 2022 · doi:10.1080/01608061.2022.2043218