Supervising for Competence: Moving Beyond Hours to Mastery-Based Behavior Analyst Training

Overview & Clinical Significance

The predominant model for credentialing behavior analysts has been organized around supervised hours — a specified number of fieldwork hours logged, documented, and verified before a candidate is eligible for certification. This model has the virtues of clarity and verifiability, but it rests on an implicit and largely untested assumption: that time spent in supervised fieldwork reliably produces the competencies required for independent practice.

Leah Fennema's presentation challenges this assumption directly. Drawing on lessons from safety-critical industries — aviation, maritime operations, and healthcare — where the consequences of undertrained practitioners are severe and unambiguous, she makes the case that hours accumulation and competence development are related but not synonymous. An individual can log every required hour and emerge with significant gaps in clinical reasoning, judgment under uncertainty, or the ability to apply behavioral principles to novel presentations. Conversely, with the right supervisory structure, some candidates may reach genuine competency well before their hours are complete — or may need extended support in specific areas regardless of their total hours logged.

The clinical significance of this distinction is substantial. Behavior analysts make consequential decisions: they design interventions that alter behavior in ways that affect quality of life, safety, and learning. When those decisions are made by practitioners who are credentialed on the basis of time served rather than demonstrated competency, the risk to clients is real and systematic. Fennema's competency-based supervision model offers a framework for organizing fieldwork around what actually matters: whether the supervisee can perform, reason, and decide at the level required for independent practice.

Background & Context

The comparison to safety-critical industries is instructive. Aviation training does not simply require a specified number of flight hours before granting a pilot's license — it requires demonstrated mastery of specific maneuvers, judgment in simulated emergencies, and proficiency checks at defined milestones. A student pilot who has accumulated hours but cannot demonstrate the required competencies does not advance, regardless of time invested. The same principle governs surgical training in medicine, where competency-based medical education has been formalized as a framework that explicitly links advancement to demonstrated performance rather than calendar time.

Behavior analysis has historically relied more heavily on the hours model, though this has been evolving. The BACB's updates to supervised fieldwork requirements over recent years have added more specificity about the content and structure of supervision, and the Task List approach to training provides a competency map — but the mechanism for verifying genuine mastery of those competencies remains less rigorous than in fields like aviation or surgery.

Fennema's presentation draws on this cross-industry evidence to argue that competency-based supervision is not merely aspirational — it is the model that safety-critical fields have demonstrated is necessary when practitioner errors carry meaningful consequences. For behavior analysts working with individuals with autism, intellectual disabilities, or behavioral health conditions, the parallel is apt.

The conceptual shift required — from hours-based to competency-based thinking — is significant for both supervisors and supervisees. Supervisors accustomed to treating hours tracking as the core supervisory task must reorient toward asking different questions: not simply how many hours have been logged, but what competencies have been demonstrated, at what level of independence, under what conditions, and what mastery evidence exists.

Clinical Implications

Implementing competency-based supervision requires practical changes to how supervisory time is structured and what it produces. At minimum, it requires a clear competency map: a specific set of skills and knowledge areas that the supervisee is expected to demonstrate, with defined criteria for what adequate performance looks like at each stage of training. The BACB Task List provides a starting point, but supervisors will typically need to translate those abstract task descriptors into observable, measurable performance criteria tied to the specific clinical context in which the supervisee is working.

Assessment against this competency map should be ongoing rather than summative. The goal is not a final competency evaluation at the end of fieldwork, but a continuous diagnostic process that allows the supervisor to identify areas of strength and areas requiring additional support throughout the training period. When gaps are identified, supervision time and experiences should be deliberately structured to address them — not simply by providing more exposure to the activity, but by designing graduated practice, feedback, and generalization experiences specific to the identified gap.

The clinical implications extend to how supervisors think about supervisee independence. One of the most important decisions in any supervision relationship is determining when a supervisee is ready to perform a given skill without direct oversight. A competency-based framework provides a principled answer: a supervisee is ready to operate independently in an area when they have demonstrated the relevant competencies at a defined performance criterion, under appropriate conditions, with adequate stability across opportunities. This is more defensible, and more protective of clients, than simply noting that the required hours have been accumulated.

For supervisors operating in organizations or clinics, Fennema's model also has staffing implications. A supervision system that accurately tracks competency development — rather than just hours — provides better information for decisions about case assignment, caseload expansion, and readiness for promotion. Supervisees whose competency profiles are well-characterized can be assigned cases that match their current developmental level, while areas of weakness receive targeted support.

Ethical Considerations

The BACB Ethics Code (2022) Section 5.01 requires supervisors to be competent in the areas they supervise. Section 5.04 specifies the design and implementation of effective supervision. Together, these sections establish a clear ethical mandate for the kind of deliberate, competency-focused supervision design Fennema describes. A supervisor who relies solely on hours tracking as evidence that supervision is occurring is not, in the Ethics Code's terms, designing or implementing effective supervision — they are completing a documentation requirement.

Section 5.05 requires that performance feedback be based on direct observation. Competency-based supervision takes this seriously by specifying what is being observed, what performance criterion is being applied, and what the feedback is designed to achieve. Documentation of competency assessments, in addition to hour logs, creates a richer and more defensible record of supervisory activity.

The ethical stakes for clients are directly implicated. When supervisees who lack genuine competence are allowed to operate with independence they have not demonstrated, clients bear the risk. Section 2.01 of the Ethics Code obligates behavior analysts to provide only services within their scope of competence. A competency-based supervision model makes scope-of-competence determinations more rigorous by grounding them in performance data rather than credential status alone.

Fennema's cross-industry framing also resonates with the Ethics Code's emphasis on social responsibility. In aviation, the argument for competency-based training is straightforward: the consequences of a gap between credential and actual capability can be catastrophic. The field of behavior analysis, while operating with different consequences and populations, serves vulnerable individuals who are often unable to self-advocate about service quality. The ethical case for ensuring genuine competency before granting independence is at least as strong.

Assessment & Decision-Making

Competency-based supervision requires a more structured assessment infrastructure than hours-based models. This includes, at minimum: a defined competency framework tied to the clinical context; assessment tools for evaluating performance against that framework; documentation systems that capture competency evidence rather than just time; and decision rules for when specific competencies have been achieved.

Supervisors implementing this model will benefit from adapting existing tools to their specific context. Direct observation scoring rubrics that specify both the behavior being observed and the performance criterion for mastery provide a foundation. These rubrics can be developed for individual competency domains — discrete trial teaching, functional analysis conduct, report writing, caregiver training — and applied across multiple observation opportunities to establish consistency of performance.

Role-play and simulation are underutilized assessment tools in behavior analytic supervision. Aviation uses simulators precisely because not every high-stakes scenario can be safely experienced in real operations. Supervisors can use structured role-play to assess supervisees' ability to navigate difficult clinical conversations, respond to unexpected client behavior, or apply decision-making frameworks in novel situations. These simulations provide assessment data that real-world observation alone may not yield, particularly for low-frequency but high-stakes clinical situations.

Decision-making about supervisee advancement should follow from competency data rather than hours thresholds. When a supervisee has demonstrated mastery of a defined competency domain under appropriate conditions, that domain can be managed with reduced direct supervision. When gaps remain, supervision intensity in those areas should increase — even if total hours are accumulating according to schedule. This requires supervisors to be willing to hold the competency standard rather than treating hours completion as automatic progression.

What This Means for Your Practice

If you supervise BCBA candidates or trainees, Fennema's framework invites you to ask a direct question about your current practice: do you know, with evidence, what competencies each of your supervisees has genuinely achieved, and which they have not? If your honest answer is that you track hours and cover required task areas but don't have systematic competency assessment data, there is a meaningful gap between your current practice and the model she describes.

A practical starting point is to select one competency domain that is central to your supervisees' caseloads — functional behavior assessment, data-based decision-making, or treatment integrity monitoring, for example — and develop a simple observation rubric with a clear performance criterion for that domain. Apply it across several direct observations, document the results, and use the data to guide your next supervision session. This is the competency-based model at its most basic level.

Over time, expanding this approach to cover the full range of competencies required for independent practice creates a supervision system that is both more rigorous and more individualized. It allows you to allocate your supervision time where it is most needed, advance supervisees on the basis of demonstrated mastery, and document a defensible record of the supervisory relationship that supports both their development and your own ethical accountability.