The Behavior Observation Instrument: a method of direct observation for program evaluation.
Watch each learner for 15-30 seconds, rotate, and tally—cheap, fast group data you can trust.
01Research in Context
What this study did
The authors built a simple time-sampling form called the Behavior Observation Instrument (BOI). They trained college students to watch groups of kids for 15 or 30 seconds, mark what happened, then move to the next kid.
Seventy-six children in day-treatment classrooms served as the test group. Observers recorded on-task, off-task, and disruptive behaviors during regular lessons.
What they found
Two different observers agreed on 85-95 % of the marks, even with only one hour of training. Fifteen-second intervals caught most behavior changes without exhausting the staff.
The method let one adult track an entire class in under ten minutes, making large-scale program checks cheap and fast.
How this fits with other research
Renne et al. (1976) hid a tiny microphone on kids to record home behavior without anyone knowing. BOI keeps the “no-distraction” spirit but switches from secret audio to quick live looks, so you can use it in classrooms where recording is illegal.
MacDonald et al. (2006) later copied the same interval logic to measure joint attention in toddlers with autism. Their 15-minute structured play mirrors BOI’s 15-second rule: short, timed samples give reliable data without tiring the child or the coder.
Cox et al. (2022) mined old clinic charts to see if behavior plans or med changes helped most. Like BOI, they show you can evaluate program-wide effects with tools already on the shelf—no fancy gear needed.
Why it matters
If you run social-skills groups, classroom token systems, or day-program rotations, BOI gives you a fast health check. Grab a clipboard, pick 15-second intervals, and rotate through learners. One staff member can score an entire room during a single activity, spot dips in engagement, and fix them before the week ends. No extra budget, no extra manpower.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Pick one group period, set a timer for 15 s observe / 5 s record, and cycle through every student once—graph the on-task percent before and after you add a group contingency.
02At a glance
03Original abstract
The background and development of a multicategory direct observation system, the Behavior Observation Instrument (BOI), is described. This time-sampling procedure for recording the behavior of persons is demonstrated in several treatment settings and the results applied to issues of program evaluation. Elements that have prevented direct observation from being widely adopted, such as costs, manpower, and training requirements, are systematically analyzed. A basic psychometric analysis of the instrument is used to determine optimum frequency and duration of observation intervals as well as observer agreement. The results imply that direct observation methods, once assumed by some to belong to the special province of the single-subject design, can be used to assess the effects of programs on groups of psychiatric clients in an efficient and economic manner.
Journal of applied behavior analysis, 1978 · doi:10.1901/jaba.1978.11-243