By Matt Harrington, BCBA · Behaviorist Book Club · Clinical decision guide

Direct Observation vs. Permanent Product Review for Procedural Integrity Monitoring

In This Guide

Side-by-Side Comparison
Clinical Decision Framework
Key Takeaways

One of the most consequential decisions a behavior analyst makes is not just what intervention to use, but how to approach the clinical question in the first place. For prioritizing procedural integrity in service settings: insights from the opi task force, the difference between an evidence-based, individualized approach and a traditional, protocol-driven one can significantly impact outcomes.

This guide lays out the key factors side by side to support your clinical decision-making.

Side-by-Side Comparison

Factor	Evidence-Based Approach	Traditional Approach
Accuracy of measurement	Direct observation: Highest accuracy — observer can capture all procedural steps including those not visible in permanent products	Permanent product review: Accuracy limited to what products actually capture — important steps may occur between product records
Resource requirements	Direct observation: High — requires trained observer available during the session at the same time and location	Permanent product review: Lower — can be conducted asynchronously by reviewer at a convenient time
Reactive effects	Direct observation: Higher — staff awareness of being observed typically improves implementation, which may inflate integrity estimates during measurement periods	Permanent product review: Lower — staff may not know when products will be reviewed, reducing reactivity
Feasibility for high-volume monitoring	Direct observation: Limited — cannot be practically applied to every session across a large caseload	Permanent product review: Higher — one reviewer can assess multiple sessions asynchronously, enabling broader sampling
Suitability for feedback delivery	Direct observation: Strong — observer can deliver feedback proximate to the observed performance, increasing its instructive value	Permanent product review: Weaker — delayed feedback requires contextual reconstruction and loses immediacy
Best applications	Direct observation: High-stakes procedures, newly trained skills, integrity probes following identified concerns	Permanent product review: Documentation compliance monitoring, low-frequency integrity sampling, organizational-level trend analysis

FREE CEUs

Get CEUs on This Topic — Free

The ABA Clubhouse has 60+ on-demand CEUs including ethics, supervision, and clinical topics like this one. Plus a new live CEU every Wednesday.

✓ 60+ on-demand CEUs (ethics, supervision, general)

✓ New live CEU every Wednesday

✓ Community of 500+ BCBAs

✓ 100% free to join

Join The ABA Clubhouse — Free →

Clinical Decision Framework

Use this framework when approaching prioritizing procedural integrity in service settings: insights from the opi task force in your practice:

Step 1: Is intervention warranted?

Does the data support a need for intervention? Is there a meaningful impact on the individual's quality of life, safety, or access to reinforcement?

YES → Proceed to assessment NO → Document reasoning, monitor

Step 2: Have you conducted an individualized assessment?

A functional assessment should guide intervention selection. Avoid defaulting to standard protocols without individual analysis. Consider environmental variables, setting events, and private events.

YES → Select evidence-based approach matched to function NO → Complete assessment first

Step 3: Is the individual/caregiver involved in decision-making?

Goals should be co-developed. Assent and informed consent are ethical requirements. The individual's preferences and values matter in selecting both goals and methods.

YES → Proceed with collaborative plan NO → Engage in shared decision-making

Step 4: Verify your approach

✓ Is your intervention matched to the assessed function?
✓ Are you using the least restrictive effective approach?
✓ Is assent being monitored throughout?
✓ Do you have a data collection plan?
✓ Is there a plan for generalization and maintenance?

Key Takeaways

Individualization is non-negotiable. The best approach for one individual may not be appropriate for another, even with the same topography.
Assessment drives intervention. Function-based approaches consistently outperform topography-based ones in the literature.
Ethics are active, not passive. Ethical practice requires ongoing analysis, not just initial compliance.
Document everything. Both the decision to intervene and the decision not to intervene require documentation and justification.
Stay current. The evidence base in this area is evolving. What was standard practice five years ago may not reflect current best practices.

Go Deeper With This CEU

This course covers the clinical and ethical dimensions in detail with structured learning objectives and CEU credit.

Prioritizing Procedural Integrity in Service Settings: Insights from the OPI Task Force — Florence DiGennaro Reed · 1 BACB Supervision CEUs · $0

Take This Course →

📚 Browse All 60+ Free CEUs — ethics, supervision & clinical topics in The ABA Clubhouse →

Clinical Disclaimer

All behavior-analytic intervention is individualized. The information on this page is for educational purposes and does not constitute clinical advice. Treatment decisions should be informed by the best available published research, individualized assessment, and obtained with the informed consent of the client or their legal guardian. Behavior analysts are responsible for practicing within the boundaries of their competence and adhering to the BACB Ethics Code for Behavior Analysts.