EXTEROCEPTIVE CONTROL OF RESPONSE UNDER DELAYED REINFORCEMENT.
A simple dark cue during the delay interval can steady and boost response rates under delayed reinforcement.
01Research in Context
What this study did
MOORHEARSKELLEHER et al. (1964) worked with rats in a small lab box. The rats pressed a lever for food, but the food always came 1 to 20 seconds late.
The team then turned the lights off during the wait. They wanted to see if this simple dark cue could keep the rats pressing smoothly.
What they found
Without the dark cue, response rates wobbled. When darkness filled the delay, pressing became steady and faster for every rat.
The external cue acted like a bridge, letting the rat link the press to the later food.
How this fits with other research
Okouchi (2009) later showed the same idea works with people. College students learned a two-button sequence even when praise came up to 30 seconds late, proving the delayed-reinforcement effect crosses species.
Baer et al. (1984) moved the idea into preschool. Kids kept their words and actions in sync even when the teacher's praise was delayed, again showing the cue can be social, not just darkness.
Berler et al. (1982) looked at the flip side: they used a 20-second cue that only signaled upcoming free food. Lever pressing rose during the cue, much like darkness boosted pressing in the 1964 study. Both papers show that inserting any clear external event can override schedule-induced pauses.
Why it matters
If you run DRA, DRL, or any procedure where reinforcement can't be immediate, add a salient cue during the wait. Turn the room lights off, ring a chime, or point to a colored card. One quick change can keep responding steady and reduce the drop-off you see with pure delay.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →During wait times, turn off the overhead lights or present a distinct visual cue to bridge the delay.
02At a glance
03Original abstract
Three white rats, after 50 continuous reinforcements, were exposed successively, under dim illumination, to reinforcement delays of 1, 3, 5, 7.5, 10, 15, and 20 sec, with prolonged training at the 20-sec level. Behavior was maintained at each level, and an increase in interval was accompanied by an increase in post-reinforcement pause. Subsequently, under both 20- and 30-sec delays, the animals were tested during half of each daily session to determine the effect of introducing darkness during each delay interval. The result of this stimulus "support" was to regularize and increase response rate for each animal at both interval values.
Journal of the experimental analysis of behavior, 1964 · doi:10.1901/jeab.1964.7-159