Leading with Procedural Integrity: Why OPI Scores and Performance Management Define ABA Clinical Quality

Overview & Clinical Significance

Procedural integrity — the degree to which a procedure is implemented as designed — is one of the most consequential and least consistently measured variables in applied behavior analysis. When a client fails to make expected progress, two possibilities exist: the intervention itself is not producing the intended effects, or the intervention is not being implemented as designed. Without systematic procedural integrity data, it is impossible to distinguish between these two explanations. Yet clinical supervisors routinely make program modification decisions based on outcome data alone, without controlling for the integrity variable. This practice is not just methodologically problematic — it is a source of harm. Clients may be subjected to unnecessary program changes, reinforcement schedule modifications, or even functional assessment restarts when the actual problem is implementation failure.

The organizational performance integrity (OPI) score provides a quantitative index of procedural integrity at the organizational level — aggregating individual integrity data across providers, programs, and time to produce a system-level metric that can guide leadership decisions. This is a meaningful advance over case-level integrity tracking, which provides no mechanism for identifying systemic performance patterns across a caseload or an organization.

For BCBAs in supervisory and leadership roles, procedural integrity data serve a dual function: they are clinical decision-making tools at the case level and performance management tools at the organizational level. This course addresses both functions, with particular emphasis on how investment in integrity measurement systems produces returns that extend far beyond any individual case.

Background & Context

The measurement of procedural integrity has a history in the ABA literature that predates widespread clinical implementation by several decades. Gresham (2004) established a foundational framework for understanding integrity as a multicomponent construct that includes adherence (were the correct steps performed?), exposure (was the intervention delivered at the correct frequency and duration?), quality (was the intervention delivered with appropriate skill?), and participant responsiveness (did the client engage with the intervention as intended?). Sanetti and Kratochwill (2009) further developed these dimensions into a clinical assessment framework applicable across educational and therapeutic settings.

Despite this conceptual development, procedural integrity measurement remains inconsistently practiced. Reviews of the published ABA literature have repeatedly found that integrity data are collected in fewer than half of published studies and reported even less frequently. In clinical practice, the rates are likely lower. The barriers are well-documented: time constraints, observer availability, lack of standardized measurement tools, and competing performance management priorities.

The OPI score framework described in this course addresses the organizational barriers to integrity measurement by building it into a systematic performance management structure. Rather than treating integrity observations as episodic quality checks, the OPI framework conceptualizes them as continuous organizational data that are aggregated, graphed, and used to drive management decisions. This approach aligns integrity measurement with the same data-based decision-making philosophy that governs ABA practice at the case level — a philosophically coherent extension of the science into organizational management.

Clinical Implications

The clinical implications of a procedural integrity data system extend across three levels: the individual client, the treatment team, and the organization as a whole.

At the client level, continuous integrity data allow BCBAs to distinguish treatment effects from implementation effects. When a graphed data path shows stalled or reversed progress, the first diagnostic question should be: is the procedure being implemented as designed? An integrity data system that provides real-time information about provider performance answers this question immediately, preventing the misattribution of implementation failures to the intervention itself. This reduces unnecessary program modifications and protects clients from extended contact with ineffective conditions.

At the treatment team level, OPI scores provide a fair and objective basis for performance feedback. Rather than relying on supervisory impressions or anecdotal observations, feedback grounded in integrity data is specific, behavior-based, and defensible. This kind of feedback is both more effective at producing behavior change and more aligned with the OBM literature on performance management than impressionistic evaluations.

At the organizational level, aggregate OPI data identify systemic training needs that cannot be detected through case-level review. If 70% of providers across an organization show low fidelity on a specific step of a discrete trial procedure, this is a training curriculum problem, not an individual performance problem. Without an OPI tracking system, this pattern would remain invisible, and supervisors would continue attempting to correct a systemic issue through individual-level performance management — an inefficient and often demoralizing approach.

Ethical Considerations

The BACB Ethics Code (2022) provides multiple touchpoints for understanding the ethical imperative of procedural integrity measurement. Standard 2.05 requires BCBAs to provide adequate training and supervision to the staff who implement their programs. Standard 2.06 requires ongoing evaluation of supervisee performance. Standard 2.19 requires that BCBAs design and oversee the implementation of behavior change programs in ways that are consistent with the best available scientific evidence.

Each of these standards has direct relevance to procedural integrity. Training and supervision that do not include systematic integrity observation are incomplete — they cannot detect or correct the implementation errors that determine whether clients receive the service that was designed for them. Performance evaluation that is not grounded in behavioral observation data does not meet the standard of objective, evidence-based management practice. And program implementation that is not monitored for integrity cannot be claimed to be consistent with the evidence base, because the evidence base describes procedures as designed, not procedures as variably implemented.

Beyond the code, there is a fundamental ethical argument for integrity measurement: clients in ABA settings are often unable to advocate for the quality of the services they receive. They cannot identify when a procedure is being implemented incorrectly, compare it to the designed version, and raise a concern. BCBAs and organizational leaders who are responsible for those clients carry the full weight of this advocacy function. A systematic integrity measurement system is one of the most direct ways an organization can fulfill that responsibility.

Assessment & Decision-Making

Implementing an organizational procedural integrity system requires decisions at three levels: what to measure, how to measure it, and how to use the data.

Decisions about what to measure should be guided by clinical risk and organizational priorities. High-risk procedures — those involving restrictive interventions, intensive reinforcement modifications, or complex instructional sequences — warrant the highest measurement priority. Universal integrity monitoring of all procedures is rarely feasible; a stratified approach that concentrates resources on high-risk and high-impact procedures is both more practical and more defensible.

Decisions about measurement method involve a tradeoff between sensitivity and feasibility. Direct observation by a trained integrity observer provides the most accurate data but requires significant resource investment. Permanent product review — examining data sheets, session notes, and program documentation for adherence indicators — is lower fidelity but feasible at high volume. Self-report and video-assisted review offer intermediate options. A robust OPI system typically combines methods, using direct observation for high-risk procedures and permanent product review for routine programming.

Decisions about how to use OPI data are the most consequential. The organizational value of an integrity measurement system is realized only when the data drive decisions — about training priorities, staffing adjustments, program modifications, and performance management. Organizations that collect OPI data but do not integrate them into decision-making processes have incurred the cost of measurement without capturing its benefit. Building OPI data review into regular leadership meetings and supervision structures is the structural mechanism by which measurement is converted into organizational improvement.

What This Means for Your Practice

If you are a clinical supervisor or organizational leader in an ABA setting, the most actionable takeaway from this course is straightforward: begin measuring procedural integrity systematically, and build the resulting data into your performance management and clinical decision-making processes.

Start with a needs assessment at your organization. Where is procedural integrity currently being measured? Where is it not? What decisions are being made without integrity data that would benefit from it? This audit will reveal the highest-leverage starting points for system development.

Next, select or design an integrity measurement tool that is specific to the procedures used in your setting. Generic integrity checklists are less sensitive than procedure-specific tools. For each priority procedure, develop a checklist that operationalizes each step at the level of precision needed to distinguish correct from incorrect implementation.

Build integrity observation into supervision structures as a non-negotiable component, not an optional add-on. Schedule integrity observations at regular intervals, and communicate clearly to staff that these observations are used to support training and organizational improvement — not to surveil or punish. When the supervisory relationship around integrity data is framed correctly, staff welcome these observations as sources of actionable feedback.

Finally, use your OPI data to have informed conversations with organizational leadership about resource allocation. Training investments, staffing ratios, and program modification decisions all look different when viewed through the lens of organizational-level integrity data. This is one of the most powerful ways BCBAs in leadership roles can advocate for clinical quality.