Some basic health information of the human body, such as age, weight, gender, etc., can be obtained through gait analysis. We propose a unified gait health analysis framework for multimodal and multiattribute prediction tasks. In the proposed framework, we integrate silhouette and optical flow modalities and employ a gait feature extractor to extract robust gait features. We also design a Mixture-of-Experts (MoE) fusion module to dynamically combine complementary static and dynamic information, enabling a shared representation for predicting multiple biometric and health-related attributes. The extensive experiments on the Health&Gait dataset show our proposed models outperform baseline single-modality methods across various prediction tasks, validating the effectiveness of multimodal gait analysis in practical health assessment scenarios.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

HealthGait-Uni: Health Assessment by Human Body Appearance and Motion from Videos

  • Shiwen Cao,
  • Rafael Aguilar-Ortega,
  • Dongyang Jin,
  • Manuel J. Marin-Jimenez,
  • Shiqi Yu

摘要

Some basic health information of the human body, such as age, weight, gender, etc., can be obtained through gait analysis. We propose a unified gait health analysis framework for multimodal and multiattribute prediction tasks. In the proposed framework, we integrate silhouette and optical flow modalities and employ a gait feature extractor to extract robust gait features. We also design a Mixture-of-Experts (MoE) fusion module to dynamically combine complementary static and dynamic information, enabling a shared representation for predicting multiple biometric and health-related attributes. The extensive experiments on the Health&Gait dataset show our proposed models outperform baseline single-modality methods across various prediction tasks, validating the effectiveness of multimodal gait analysis in practical health assessment scenarios.