Human gesture and gait analysis for autism detection

Document Type

Conference Proceeding

Publication Title

2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)

Publisher

IEEE

School

School of Science

RAS ID

60778

Funders

Australian Research Council / Australian Government / University of Western Australia International Fee Scholarship

Grant Number

ARC Number : FT210100268

Grant Link

http://purl.org/au-research/grants/arc/FT210100268

Comments

Zahan, S., Gilani, Z., Hassan, G. M., & Mian, A. (2023). Human gesture and gait analysis for autism detection. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (pp. 3328-3337). IEEE. https://doi.org/10.1109/CVPRW59228.2023.00335

Abstract

Autism diagnosis presents a major challenge due to the vast heterogeneity of the condition and the elusive nature of early detection. Atypical gait and gesture patterns are dominant behavioral characteristics of autism and can provide crucial insights for diagnosis. Furthermore, these data can be collected efficiently in a non-intrusive way, facilitating early intervention to optimize positive outcomes. Existing research mainly focuses on associating facial and eye-gaze features with autism. However, very few studies have investigated movement and gesture patterns which can reveal subtle variations and characteristics that are specific to autism. To address this gap, we present an analysis of gesture and gait activity in videos to identify children with autism and quantify the severity of their condition by regressing autism diagnostic observation schedule scores. Our proposed architecture addresses two key factors: (1) an effective feature representation to manifest irregular gesture patterns and (2) a two-stream co-learning framework to enable a comprehensive understanding of its relation to autism from diverse perspectives without explicitly using additional data modality. Experimental results demonstrate the efficacy of utilizing gesture and gait-activity videos for autism analysis. © 2023 IEEE.

DOI

10.1109/CVPRW59228.2023.00335

Access Rights

subscription content

Link to Full Text

Share

 
COinS