Scholarlink

Abstract <p>Parkinson’s disease (PD) is a progressive neurodegenerative disorder marked by motor symptoms, but early diagnosis is challenging due to symptom overlap with other conditions and a lack of definitive biomarkers (clinical assessments). In this study, we propose a novel multimodal artificial intelligence (AI)-based decision support system aimed at the early diagnosis of idiopathic PD. To the best of our knowledge, this is the first framework to enable the synchronous analysis of four distinct modalities: walking, facial expression, voice, and posture, whereas prior studies have typically focused on unimodal or partially multimodal approaches. We also constructed a new dataset by establishing a controlled clinical testing environment equipped with an L-shaped walking track and an integrated audiovisual recording system to capture natural walking, turning, facial, vocal, and postural characteristics. For each modality, specialized AI models were developed and evaluated. For the walking modality, the proposed Bidirectional GRU model achieved the best performance in terms of both <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(F_1\)</EquationSource> </InlineEquation> score (92.74%) and area under the curve (AUC) (97.86%), demonstrating superior gait-based classification performance. Similarly, in the face modality, the ensemble model integrating eXtreme Gradient Boosting (XGBoost), Random Forest (RF), and Categorical Boosting (CatBoost) yielded the highest <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\(F_1\)</EquationSource> </InlineEquation> score (92.31%) while also achieving the best AUC (97.96%). For the voice and posture modalities, although the highest <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(F_1\)</EquationSource> </InlineEquation> scores were not obtained, the RF-based models achieved the highest AUC values (99.85% and 97.56%, respectively) within their respective modality comparisons in the literature, reflecting strong class separability and discriminative capability.</p> Graphical abstract <p></p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

A novel multimodal AI framework for early diagnosis of idiopathic Parkinson’s disease

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年3月13日

查看全文
  • Efe Yılmaz Taşyürek,
  • Şaban Murat Altun,
  • Ata Emir Uncu,
  • Sefa Tunca,
  • Sevinç İlhan Omurca,
  • Meltem Kurt Pehlivanoğlu,
  • Aybala Neslihan Alagöz,
  • Oğulcan Kalkan

摘要

Abstract

Parkinson’s disease (PD) is a progressive neurodegenerative disorder marked by motor symptoms, but early diagnosis is challenging due to symptom overlap with other conditions and a lack of definitive biomarkers (clinical assessments). In this study, we propose a novel multimodal artificial intelligence (AI)-based decision support system aimed at the early diagnosis of idiopathic PD. To the best of our knowledge, this is the first framework to enable the synchronous analysis of four distinct modalities: walking, facial expression, voice, and posture, whereas prior studies have typically focused on unimodal or partially multimodal approaches. We also constructed a new dataset by establishing a controlled clinical testing environment equipped with an L-shaped walking track and an integrated audiovisual recording system to capture natural walking, turning, facial, vocal, and postural characteristics. For each modality, specialized AI models were developed and evaluated. For the walking modality, the proposed Bidirectional GRU model achieved the best performance in terms of both \(F_1\) score (92.74%) and area under the curve (AUC) (97.86%), demonstrating superior gait-based classification performance. Similarly, in the face modality, the ensemble model integrating eXtreme Gradient Boosting (XGBoost), Random Forest (RF), and Categorical Boosting (CatBoost) yielded the highest \(F_1\) score (92.31%) while also achieving the best AUC (97.96%). For the voice and posture modalities, although the highest \(F_1\) scores were not obtained, the RF-based models achieved the highest AUC values (99.85% and 97.56%, respectively) within their respective modality comparisons in the literature, reflecting strong class separability and discriminative capability.

Graphical abstract