Automated depression detection from audio-visual cues faces a key challenge: subtle behavioral indicators are often masked by dominant low-frequency signals. To address this, we propose WavGateMamba, a novel architecture integrating wavelet analysis with state space models. Our method employs Discrete Wavelet Transform (DWT) to decompose inputs into multi-scale frequency components, a gating mechanism for dynamic feature recalibration, and Mamba blocks with shared state-space matrices for cross-modal modeling. Extensive experiments show our approach significantly outperforms existing methods, achieving consistent improvements of 3–4% on key evaluation metrics including Accuracy, Precision, Recall, and F1-Score. This work presents an effective paradigm for incorporating frequency-domain inductive bias into behavioral analysis, enabling better capture of subtle depressive cues.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

WavGateMamba: A Frequency-Enhanced and Gated Mamba Model for Multimodal Depression Detection

  • Haiyang Ye,
  • Dengshi Li,
  • Wei Li,
  • Yulin Wu,
  • Yu Fang,
  • YuXin Li

摘要

Automated depression detection from audio-visual cues faces a key challenge: subtle behavioral indicators are often masked by dominant low-frequency signals. To address this, we propose WavGateMamba, a novel architecture integrating wavelet analysis with state space models. Our method employs Discrete Wavelet Transform (DWT) to decompose inputs into multi-scale frequency components, a gating mechanism for dynamic feature recalibration, and Mamba blocks with shared state-space matrices for cross-modal modeling. Extensive experiments show our approach significantly outperforms existing methods, achieving consistent improvements of 3–4% on key evaluation metrics including Accuracy, Precision, Recall, and F1-Score. This work presents an effective paradigm for incorporating frequency-domain inductive bias into behavioral analysis, enabling better capture of subtle depressive cues.