The natural mathematics of behavior analysis
Use MCMC-ABC to test behavioral models against multiple data dimensions at once and spot where classic models fall short.
01Research in Context
What this study did
Li et al. (2018) wrote a how-to guide for testing old operant models. They used VI schedule data and checked many measures at once. The tool is called MCMC-ABC, a kind of smart computer search.
They wanted to see where classic models break. Instead of eye-balling graphs, they let the computer hunt for mismatches.
What they found
The model fit some parts of the data but missed others. The paper shows the exact spots where the fit goes bad. The Bayesian search made the flaws easy to see.
How this fits with other research
Li et al. (2018) pairs with Li et al. (2018) on ETBD. Both papers use multivariate checks on VI data. One tests Catania’s Operant Reserve, the other tests McDowell’s ETBD. Same method, different theory.
Morris et al. (2021) took the ETBD idea and aimed it at clinical data. They modeled self-injury subtypes instead of lever presses. The 2018 math stays the same; only the target behavior changes.
Hake et al. (1983) asked analysts to borrow new lab tools. Li et al. (2018) answers that call by handing over MCMC-ABC. The 1983 wish list finally gets a 2018 tool.
Why it matters
You no longer have to trust a model just because the curve looks close. Run MCMC-ABC on your own schedule data to see where the model slips. If the fit fails, you know the theory needs work before you use it in treatment. That keeps your decisions honest and your graphs truthful.
Get CEUs on This Topic — Free
The ABA Clubhouse has 60+ on-demand CEUs including ethics, supervision, and clinical topics like this one. Plus a new live CEU every Wednesday.
Download the paper’s code and rerun the VI example with your last dataset to see if the model misses any measures.
02At a glance
03Original abstract
Models that generate event records have very general scope regarding the dimensions of the target behavior that we measure. From a set of predicted event records, we can generate predictions for any dependent variable that we could compute from the event records of our subjects. In this sense, models that generate event records permit us a freely multivariate analysis. To explore this proposition, we conducted a multivariate examination of Catania's Operant Reserve on single VI schedules in transition using a Markov Chain Monte Carlo scheme for Approximate Bayesian Computation. Although we found systematic deviations between our implementation of Catania's Operant Reserve and our observed data (e.g., mismatches in the shape of the interresponse time distributions), the general approach that we have demonstrated represents an avenue for modelling behavior that transcends the typical constraints of algebraic models.
Journal of the Experimental Analysis of Behavior, 2018 · doi:10.1002/jeab.330