Read my lips: The importance of the face in a computer-animated tutor for vocabulary learning by children with autism.
Add an animated talking face to computer vocabulary lessons for kids with autism.
01Research in Context
What this study did
The team built a computer tutor named Baldi. Baldi shows an animated face that moves its lips while it speaks.
Kids with autism heard new words either with the face on screen or with voice only. The study switched the two conditions back-to-back so each child served as their own control.
What they found
Children learned the new words faster when the animated face was present. They also remembered the words better the next day.
Voice-only lessons worked, but the face gave a clear boost.
How this fits with other research
Rice et al. (2015) and IFaso et al. (2016) later used animated faces too. They moved from vocabulary to emotion recognition and still saw gains, showing the idea stretches beyond word learning.
Iarocci et al. (2010) seems to disagree. They found autistic kids gain little from lip-reading cues during noisy speech. The tasks differ, though. Grace tested speech-in-noise perception; W et al. taught vocabulary on a quiet computer. When the goal is clear teaching, the face helps.
Bloh et al. (2025) used the same back-and-forth design. They compared animated videos to real-person videos and saw mixed results. Their data echo W et al.: animated models can win, but individual preference matters.
Why it matters
If you run computer lessons, turn on the face. A simple animated mouth can speed up vocabulary growth without extra staff time. Try it next session: play your usual audio lesson on half the trials and add a lip-sync face on the other half. Track which set reaches mastery first.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Run a quick alternating-treatments probe: same vocabulary list with and without the on-screen face, then graph which condition hits mastery first.
02At a glance
03Original abstract
A computer-animated tutor, Baldi, has been successful in teaching vocabulary and grammar to children with autism and those with hearing problems. The present study assessed to what extent the face facilitated this learning process relative to the voice alone. Baldi was implemented in a Language Wizard/Tutor, which allows easy creation and presentation of a vocabulary lesson involving the association of pictures and spoken words. The lesson plan included both the receptive identification of pictures and the production of spoken words. A within-subject design with five children with autism followed an alternating treatment in which each child continuously learned to criterion sets of words with and without the face. The rate of learning was significantly faster and the retention was better with the face. The research indicates that at least some children with autism benefit from the face in learning new language within an automated program.
Autism : the international journal of research and practice, 2006 · doi:10.1177/1362361306066599