Assessment & Research

The Behavior Observation Instrument: a method of direct observation for program evaluation.

Alevizos et al. (1978) · Journal of applied behavior analysis 1978
★ The Verdict

Watch each learner for 15-30 seconds, rotate, and tally—cheap, fast group data you can trust.

✓ Read this if BCBAs managing classrooms, day-treatment rooms, or social-skills groups who need quick program-level checks.
✗ Skip if Clinicians who only do 1:1 therapy and already have steady trial-by-trial data.

01Research in Context

01

What this study did

The authors built a simple time-sampling form called the Behavior Observation Instrument (BOI). They trained college students to watch groups of kids for 15 or 30 seconds, mark what happened, then move to the next kid.

Seventy-six children in day-treatment classrooms served as the test group. Observers recorded on-task, off-task, and disruptive behaviors during regular lessons.

02

What they found

Two different observers agreed on 85-95 % of the marks, even with only one hour of training. Fifteen-second intervals caught most behavior changes without exhausting the staff.

The method let one adult track an entire class in under ten minutes, making large-scale program checks cheap and fast.

03

How this fits with other research

Renne et al. (1976) hid a tiny microphone on kids to record home behavior without anyone knowing. BOI keeps the “no-distraction” spirit but switches from secret audio to quick live looks, so you can use it in classrooms where recording is illegal.

MacDonald et al. (2006) later copied the same interval logic to measure joint attention in toddlers with autism. Their 15-minute structured play mirrors BOI’s 15-second rule: short, timed samples give reliable data without tiring the child or the coder.

Cox et al. (2022) mined old clinic charts to see if behavior plans or med changes helped most. Like BOI, they show you can evaluate program-wide effects with tools already on the shelf—no fancy gear needed.

04

Why it matters

If you run social-skills groups, classroom token systems, or day-program rotations, BOI gives you a fast health check. Grab a clipboard, pick 15-second intervals, and rotate through learners. One staff member can score an entire room during a single activity, spot dips in engagement, and fix them before the week ends. No extra budget, no extra manpower.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Pick one group period, set a timer for 15 s observe / 5 s record, and cycle through every student once—graph the on-task percent before and after you add a group contingency.

02At a glance

Intervention
not applicable
Design
methodology paper
Population
mixed clinical
Finding
positive

03Original abstract

The background and development of a multicategory direct observation system, the Behavior Observation Instrument (BOI), is described. This time-sampling procedure for recording the behavior of persons is demonstrated in several treatment settings and the results applied to issues of program evaluation. Elements that have prevented direct observation from being widely adopted, such as costs, manpower, and training requirements, are systematically analyzed. A basic psychometric analysis of the instrument is used to determine optimum frequency and duration of observation intervals as well as observer agreement. The results imply that direct observation methods, once assumed by some to belong to the special province of the single-subject design, can be used to assess the effects of programs on groups of psychiatric clients in an efficient and economic manner.

Journal of applied behavior analysis, 1978 · doi:10.1901/jaba.1978.11-243