Automated detection of childhood autism through multimodal fusion remains a cutting-edge and underexplored field. The primary challenges include limited data and the strong heterogeneity among multimodal data. In this paper, we propose a childhood autism spectrum disorder (ASD) detection method based on environmental variables. It dynamically adjusts the weights of each modality using a dominant modality confirmation algorithm guided by environmental variables. The dominant modality serves as a basis for augmenting the other modalities, promoting the complementarity of information through attentional mechanisms, and effectively strengthening intermodal correlations. To analyze children’s behavior, language, and expressive characteristics, we create a multimodal dataset encompassing interaction scenarios involving both children with ASD and typically developing children. Extensive experimental evaluations were conducted on this dataset, and our findings demonstrate that our method effectively adapts to the characteristics of multimodal data in diverse scenarios.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Preliminary Exploration of Children Autism Spectrum Disorder Detection Based on Environmental Variables

  • Siyu Wang,
  • Guitao Cao,
  • Qiaoyun Liu,
  • Min Liu,
  • Xidong Xi

摘要

Automated detection of childhood autism through multimodal fusion remains a cutting-edge and underexplored field. The primary challenges include limited data and the strong heterogeneity among multimodal data. In this paper, we propose a childhood autism spectrum disorder (ASD) detection method based on environmental variables. It dynamically adjusts the weights of each modality using a dominant modality confirmation algorithm guided by environmental variables. The dominant modality serves as a basis for augmenting the other modalities, promoting the complementarity of information through attentional mechanisms, and effectively strengthening intermodal correlations. To analyze children’s behavior, language, and expressive characteristics, we create a multimodal dataset encompassing interaction scenarios involving both children with ASD and typically developing children. Extensive experimental evaluations were conducted on this dataset, and our findings demonstrate that our method effectively adapts to the characteristics of multimodal data in diverse scenarios.