Augmented reality-based self-facial modeling to promote the emotional expression and social skills of adolescents with autism spectrum disorders.
Augmented-reality selfies that paint emotions on a teen’s own face can teach them to read feelings in others.
01Research in Context
What this study did
Three teens with autism used a tablet camera that pasted 3-D happy, sad, angry and other faces on top of their own.
They practiced in a quiet school room for short sessions while the app asked them to copy or name each feeling.
Staff watched through a mirror and gave praise for correct answers.
What they found
All three students got better at spotting and showing the six basic emotions.
The gains held when staff later showed them new photos and during short chats with classmates.
How this fits with other research
Pérez-Fuster et al. (2022) later used a different AR game to teach joint attention to younger kids.
Together the two studies show the same tech can work for both little and big students.
Romero (2017) ran a plain computer lesson with preschoolers and also saw emotion gains, so the fancy AR overlay may not be needed for every age.
Kuusikko et al. (2009) had already shown that autistic teens start out behind on emotion tests; Chen et al. (2015) proves we can close that gap with practice.
Why it matters
If you run social-skills groups for middle or high schoolers, try letting them see their own face with an emotion filter before they role-play.
The quick visual feedback can jump-start correct expressions and save you from long verbal explanations.
Want CEUs on This Topic?
The ABA Clubhouse has 60+ free CEUs — live every Wednesday. Ethics, supervision & clinical topics.
Join Free →Record a short video of the student smiling, frowning, etc., then replay it in slow motion and label each emotion together.
02At a glance
03Original abstract
Autism spectrum disorders (ASD) are characterized by a reduced ability to understand the emotions of other people; this ability involves recognizing facial expressions. This study assessed the possibility of enabling three adolescents with ASD to become aware of facial expressions observed in situations in a school setting simulated using augmented reality (AR) technology. The AR system provided three-dimensional (3-D) animations of six basic facial expressions overlaid on participant faces to facilitate practicing emotional judgments and social skills. Based on the multiple baseline design across subjects, the data indicated that AR intervention can improve the appropriate recognition and response to facial emotional expressions seen in the situational task.
Research in developmental disabilities, 2015 · doi:10.1016/j.ridd.2014.10.015