Assessment & Research

Multivariate effects of demand characteristics on the analogue assessment of heterosocial competence.

Martinez-Diaz et al. (1979) · Journal of applied behavior analysis 1979
★ The Verdict

Weak demand hints barely move social behavior in analogue tasks, so focus on real contingencies instead.

✓ Read this if BCBAs who run brief social-skills probes or analogue assessments with teens and adults.
✗ Skip if Clinicians who only do naturalistic caregiver interviews.

01Research in Context

01

What this study did

The team ran a lab test with neurotypical college students.

They wanted to see if telling students what results the study "should" give would change how the students acted.

Each student did a short role-play chat with an opposite-sex partner.

Some students got hints that shy behavior was normal. Others got hints that outgoing behavior was expected.

The researchers then scored 16 different social skills.

02

What they found

Only 3 of the 16 scores moved at all.

Those shifts were tiny and showed up only on self-rating sheets, not on observer counts.

In plain words, the hints barely nudged the students.

03

How this fits with other research

Cullinan et al. (2001) and Lancioni et al. (2008) also used short lab tests, but with kids who had developmental disabilities. Their tests quickly showed clear behavior changes when consequences changed.

That looks like a clash: why did their analogue tests pick up big effects while Annable et al. (1979) did not? The gap is in what was manipulated. The later studies changed real reinforcers like attention or escape. The 1979 study only changed verbal hints about what was "normal." Hints are weaker than consequences.

Foti et al. (2015) used a similar college-lab set-up and found strong learning effects after brief naming training. Together these papers show that analogue sessions work fine; you just need to use powerful variables, not weak demand cues.

04

Why it matters

You can relax about demand cues in brief social-skills probes. Telling a client what is "expected" probably will not swamp your data. Spend your time controlling real reinforcers instead of hunting for hidden hints. If you need a clean test, run a short functional analysis like Cullinan et al. (2001) rather than trying to out-smart every possible expectancy.

Free CEUs

Want CEUs on This Topic?

The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.

Join Free →
→ Action — try this Monday

Stop adding extra demand-cue checks to your role-play probes; just run the test and watch what actually reinforces the client.

02At a glance

Intervention
not applicable
Design
randomized controlled trial
Population
neurotypical
Finding
mixed
Magnitude
small

03Original abstract

The present study assessed the effects of a contextual demand manipulation (pretreatment assessment versus experiment) and an instructional demand manipulation (high demand for competent behavior versus neutral demand) on the analogue assessment of heterosocial competence. Also assessed was the interaction between each demand manipulation and subject characteristics (high-frequency dating/low heterosocially anxious versus low-frequency dating/high heterosocially anxious college males). Students were assigned randomly to one of four groups receiving differential information and instructions. Students completed a battery of five standard paper-and-pencil questionnaires, responded out loud to 10 taped social situations, and conversed with a female confederate while being videotaped for five minutes. Multivariate analyses revealed highly significant differences between subject groups and between contextual manipulation groups. Univariate analyses revealed that only 3 of the 16 dependent measures, including 2 of the self-reports, were significantly affected by the contextual demand. Results are discussed in light of previous studies of phobic behavior and social skills. Various avenues for future research were presented.

Journal of applied behavior analysis, 1979 · doi:10.1901/jaba.1979.12-679