Video Based Computational Coding of Movement Anomalies in ASD Children

Priya Singh, Abhishek Pathak, Umer Jon Ganai, Braj Bhushan, Venkatesh K. Subramanian; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024, pp. 400-409

Autism spectrum disorder (ASD) is a neurodevelopmental disorder. Early detection and diagnosis are instrumental in early intervention yet diagnosis often remains delayed due to the limited availability of clinical practitioners and specialists. We propose a Computer Vision and Machine Learning based novel framework for quantitative screening of autism spectrum disorder. This is aimed to minimize the need for trained professionals at the initial stage but not substitute for it. We designed simple activities in consultation with ASD clinical psychologists and therapists for children in the 3-7 years age group that could be performed in their natural environment (home). The temporal features extracted from these activities encode the behavioral differences between Autism Spectrum Disorder (ASD) and Typically Developing (TD) control groups. Due to the unavailability of a public dataset of children performing the designed task we created our video dataset of 210 videos taken in uncontrolled natural settings. The dataset was collected from a single RGB camera. The proposed vision and learning-based algorithms extract features from the collected data for a comprehensive set of indicators including the visual attention span name-calling response neck pose of the subjects gross motor movement and establish a parametrized automated protocol for early detection without the need to take the subjects out of their natural daily environment. This forestalls the possibility of misperformance by the subject out of nervousness due to unfamiliar surroundings. Results show that our ASD screening methodology can achieve superior performance compared to the single phenotype approaches and thus has a prognostic value that could be helpful for both clinical and research applications.