Rank‐permutation tests for behavior analysis, and a test for trend allowing unequal data numbers for each subject
Swap your parametric trend test for the free rank-permutation version when single-case data are short, skewed, or uneven across clients.
01Research in Context
What this study did
Elliffe et al. (2019) built a new trend test for single-case data. The test uses rank-permutation logic. It works even when each client gives a different number of data points.
The authors give free code so you can run the test in R. They also show how it beats older parametric tests when data are skewed or measured on a small scale.
What they found
The paper is a how-to guide, not an outcome study. It shows the test keeps the false-positive rate low while still catching real trends.
How this fits with other research
Killeen (1978) gave rules for knowing when baseline is stable. Elliffe’s test is the next step: once the line is flat, use the rank test to see if the next phase really bends.
Vos et al. (2013) compared two ways to measure response-stimulus links. Elliffe does the same job for trend: it lines up several options and tells you which one to pick.
Baek et al. (2023) teach multilevel modeling for meta-analysis. Their guide and Elliffe’s test are sister tools: one helps pool many small graphs, the other keeps each single graph honest.
Why it matters
If you run single-case sessions and the numbers look messy, skip the t-test. Plug the data into the free rank-permutation test instead. It keeps your error rate clean without forcing you to drop clients who missed a few sessions.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Download the R script from Elliffe et al. (2019) and re-run last week’s baseline-to-treatment check with the new test.
02At a glance
03Original abstract
We advocate for rank-permutation tests as the best choice for null-hypothesis significance testing of behavioral data, because these tests require neither distributional assumptions about the populations from which our data were drawn nor the measurement assumption that our data are measured on an interval scale. We provide an algorithm that enables exact-probability versions of such tests without recourse to either large-sample approximation or resampling approaches. We particularly consider a rank-permutation test for monotonic trend, and provide an extension of this test that allows unequal number of data points, or observations, for each subject. We provide an extended table of critical values of the test statistic for this test, and both a spreadsheet implementation and an Oracle® Java Web Start application to generate other critical values at https://sites.google.com/a/eastbayspecialists.co.nz/rank-permutation/.
Journal of the Experimental Analysis of Behavior, 2019 · doi:10.1002/jeab.502