Seeing through a robot's eyes: A cross-sectional exploratory study in developing a robotic screening technology for autism

Autism Res. 2024 Feb;17(2):366-380. doi: 10.1002/aur.3087. Epub 2024 Jan 6.

Abstract

The present exploratory cross-sectional case-control study sought to develop a reliable and scalable screening tool for autism using a social robot. The robot HUMANE, installed with computer vision and linked with recognition technology, detected the direction of eye gaze of children. Children aged 3-8 (M = 5.52; N = 199) participated, 87 of whom had been confirmed with autism, 55 of whom were suspected to have autism, and 57 of whom were not considered to cause any concern for having autism. Before a session, a human experimenter instructed HUMANE to narrate a story to a child. HUMANE prompted the child to return his/her eye gaze to the robot if the child looked away, and praised the child when it re-established its eye gaze quickly after a prompt. The reliability of eye gaze detection was checked across all pairs of human raters and HUMANE and reached 0.90, indicating excellent interrater agreement. Using the pre-specified reference standard (Autism Spectrum Quotient), the sensitivity and specificity of the index tests (i.e., the number of robot prompts and duration of inattentiveness) reached 0.88 or above and the Diagnostic Odds Ratios were beyond 190. These results show that social robots may detect atypical eye patterns, suggesting a potential future for screening autism using social robots.

Keywords: autism severity; autism spectrum disorder; eye gaze detection; screening; social robot.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Autism Spectrum Disorder* / diagnosis
  • Autistic Disorder* / diagnosis
  • Case-Control Studies
  • Child
  • Cross-Sectional Studies
  • Female
  • Fixation, Ocular
  • Humans
  • Male
  • Reproducibility of Results
  • Robotic Surgical Procedures*
  • Robotics*
  • Social Interaction