By Matt Harrington, BCBA · Behaviorist Book Club · Research-backed answers for behavior analysts
Applied behavior analysis identifies several primary dimensions of behavior that measurement systems can target. Frequency (or count) measures how often a behavior occurs within a defined observation period. Rate standardizes frequency against time, allowing comparison across sessions of different lengths. Duration measures how long a behavior lasts. Latency measures the time between an antecedent event and the onset of the behavior. Inter-response time measures the time between successive occurrences. Magnitude measures the intensity of the behavior. The choice of dimension depends on which aspect of the behavior is clinically significant — for a behavior that is dangerous when prolonged, duration matters more than frequency.
Inter-observer agreement (IOA) is a measure of how consistently two independent observers record the same behavior during the same observation period. It is calculated by comparing the two observers' records and expressing the proportion of agreement as a percentage. IOA is important because it provides objective evidence that the measurement system is reliable — that the data reflect actual behavior rather than observer interpretation. Without regular IOA checks, data quality is assumed rather than demonstrated. BACB standards and best practice guidelines recommend collecting IOA data regularly as part of any systematic behavior change program.
RBTs should document the observation accurately in session data, note any contextual variables that may be relevant, and communicate the observation to their BCBA supervisor promptly — not at the next scheduled supervision meeting if the change is significant. Most organizations have protocols for how staff should escalate clinical observations; staff should be familiar with and follow those protocols. BACB Ethics Code section 6.02 supports the obligation of all practitioners to communicate concerns about client welfare to the appropriate supervisors. The quality of clinical decision-making depends on BCBAs receiving timely, accurate observational reports from frontline staff.
Both are time-sampling procedures used to measure behaviors that are difficult to count or time precisely. In whole interval recording, the observer divides the observation period into intervals and scores a behavior as having occurred only if it occurred throughout the entire interval. This procedure tends to underestimate the true frequency or duration of behavior. In partial interval recording, the behavior is scored if it occurred at any point during the interval, which tends to overestimate actual occurrence. The clinical choice between them depends on the behavior: whole interval is appropriate for behaviors that should be occurring continuously, while partial interval captures whether a behavior occurred at all within a window.
Effective operational definitions describe the behavior in terms of observable, measurable characteristics that require no inference about intent or internal state. A good operational definition specifies what the behavior looks like topographically, provides examples and non-examples, and includes clear boundary conditions — what counts as one instance of the behavior versus a continuation of the same instance. Definitions that include vague language (e.g., 'significant aggression,' 'attempts to communicate') will produce unreliable data because different staff members will apply different criteria. BCBAs should test new operational definitions by asking two staff members to independently apply them to a common scenario before using them in the field.
Observer drift is among the most common — over time, observers gradually shift their application of operational definitions in a consistent direction, either toward looser or stricter criteria, without awareness of the change. Reactivity occurs when observers alter their recording behavior because they know they are being checked or observed. Expectancy effects occur when an observer's knowledge of treatment conditions or expected outcomes biases their recording. Setting factors — high behavior rates, competing demands, inadequate data systems — produce practical collection errors when the measurement system is not designed for the actual session environment. Training and regular IOA checks address most of these sources systematically.
Data review meetings are among the most powerful training contexts available to supervisors because they make clinical reasoning transparent. When a BCBA reviews a graph with staff and explains what the trend indicates, what decision rule was applied, and why a program modification is being made, they are modeling the entire data-to-decision chain. Staff who observe this repeatedly develop the ability to recognize similar patterns independently. Supervisors who review data in isolation and communicate only the decision — without the reasoning — miss the development opportunity that data meetings provide.
Several provisions bear on this area. Section 2.15 requires that services be based on current and accurate data. Section 2.10 requires maintaining thorough, accurate documentation. Section 5.05 requires supervisors to evaluate supervisee performance, which includes data collection accuracy. Section 6.02 supports reporting client welfare concerns. Taken together, these provisions establish data collection accuracy and systematic documentation as ethical obligations, not merely technical recommendations. BCBAs who delegate data collection without training staff to criterion and monitoring accuracy are not meeting their Ethics Code obligations under supervision.
Different measurement procedures capture different aspects of behavior, and these differences matter for treatment decisions. A frequency measure that is high may not indicate a problem if most instances are brief; a duration measure would reveal this. A behavior that appears to have decreased by frequency may have increased in intensity — a magnitude measure would capture that. Measurement procedures also have different sensitivities to change: some detect gradual shifts across sessions; others require more dramatic changes to show a signal. Selecting a measurement procedure that is sensitive to the clinical question being asked — not simply the easiest procedure to implement — is a supervisory responsibility that directly affects decision quality.
Momentary time sampling divides an observation period into intervals and records whether the target behavior is occurring at the precise moment the interval ends. The observer looks at the client at the interval boundary and scores based on what is happening at that instant, not across the interval. This procedure is more practical for behaviors that occur at high rates or for observers who must monitor multiple learners simultaneously, because active observation is required only at brief, scheduled moments. It provides an estimate of the proportion of time a behavior occurs and is most appropriate for ongoing, state behaviors such as engagement, on-task behavior, or stereotypy where the proportion of time is the clinically relevant dimension.
The ABA Clubhouse has 60+ on-demand CEUs including ethics, supervision, and clinical topics like this one. Plus a new live CEU every Wednesday.
Ready to go deeper? This course covers this topic with structured learning objectives and CEU credit.
Staff Training Series – Data and Decision-Making in ABA — How to ABA · 1 BACB Supervision CEUs · $
Take This Course →1 BACB Supervision CEUs · $ · How to ABA
Research-backed educational guide with practice recommendations
Side-by-side comparison with clinical decision framework
All behavior-analytic intervention is individualized. The information on this page is for educational purposes and does not constitute clinical advice. Treatment decisions should be informed by the best available published research, individualized assessment, and obtained with the informed consent of the client or their legal guardian. Behavior analysts are responsible for practicing within the boundaries of their competence and adhering to the BACB Ethics Code for Behavior Analysts.