Early detection of mild cognitive impairment (MCI) and Alzheimer’s disease (AD) is crucial for timely intervention, yet existing cognitive screening tools are often time–consuming, resource–intensive, and culturally biased. We introduced a Mandarin spontaneous speech dataset collected from elderly participants in inland China, accompanied by demographic, affective, and cognitive assessments. We further designed a culturally adapted picture description stimulus (Chinese Kitchen) addressing limitations of the widely used Cookie Theft picture. Leveraging both handcrafted paralinguistic features (eGeMAPS) and self-supervised speech representations (HuBERT and wav2vec 2.0 XLSR-53), we benchmarked several contemporary pipelines for speech-based cognitive screening on our dataset, including MLP, Bi-LSTM, and a CNN-Transformer backend. Experiments with 10-fold cross-validation demonstrated that self-supervised features substantially outperformed engineered features, proving the effectiveness of our culturally adapted stimulus at the same time. Future work may extend to dialect robustness and multimodal fusion research (speech-gesture fusion) via synchronized high-quality audio-video.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Culturally Adapted Picture-Description Driven Mandarin Speech Approach for Cognitive Impairment Screening

  • An-Jie Dai,
  • Dan Chen,
  • Zhen-Tao Liu,
  • Zong-Qin Wang,
  • Bao-Liang Zhong

摘要

Early detection of mild cognitive impairment (MCI) and Alzheimer’s disease (AD) is crucial for timely intervention, yet existing cognitive screening tools are often time–consuming, resource–intensive, and culturally biased. We introduced a Mandarin spontaneous speech dataset collected from elderly participants in inland China, accompanied by demographic, affective, and cognitive assessments. We further designed a culturally adapted picture description stimulus (Chinese Kitchen) addressing limitations of the widely used Cookie Theft picture. Leveraging both handcrafted paralinguistic features (eGeMAPS) and self-supervised speech representations (HuBERT and wav2vec 2.0 XLSR-53), we benchmarked several contemporary pipelines for speech-based cognitive screening on our dataset, including MLP, Bi-LSTM, and a CNN-Transformer backend. Experiments with 10-fold cross-validation demonstrated that self-supervised features substantially outperformed engineered features, proving the effectiveness of our culturally adapted stimulus at the same time. Future work may extend to dialect robustness and multimodal fusion research (speech-gesture fusion) via synchronized high-quality audio-video.