Depression is a rapidly expanding mental health issue that affects people psychologically, physically, and emotionally. This report outlines our work for DAIC (Distress Analysis Interview Corpus) as our third-year BTech project, addressing the rising need for automated depression detection using machine learning. Historically, identifying depression involved thorough clinical interviews, during which psychologists analyzed the subject’s responses to assess their mental well-being. In our model, we have constructed a custom convolutional neural network (CNN) on three different formats: text, video, and audio to predict the mental health status of the patient where the accuracy for the models are 86%, 85% and 90% respectively. We have implemented a deep learning architecture where each modality is assigned specific weights to collectively generate an output. This fusion approach addresses the following issues- handling noise in one of the modalities, regulating the impact of a specific modality on the overall result.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhancing Depression Detection Through Multimodal Analysis: A Custom CNN-Based Approach

  • Shubham Dodia,
  • Priyansh Chhajed,
  • Gajanan Shegdar,
  • Indranil Thakare,
  • Vaibhavi Gaikwad

摘要

Depression is a rapidly expanding mental health issue that affects people psychologically, physically, and emotionally. This report outlines our work for DAIC (Distress Analysis Interview Corpus) as our third-year BTech project, addressing the rising need for automated depression detection using machine learning. Historically, identifying depression involved thorough clinical interviews, during which psychologists analyzed the subject’s responses to assess their mental well-being. In our model, we have constructed a custom convolutional neural network (CNN) on three different formats: text, video, and audio to predict the mental health status of the patient where the accuracy for the models are 86%, 85% and 90% respectively. We have implemented a deep learning architecture where each modality is assigned specific weights to collectively generate an output. This fusion approach addresses the following issues- handling noise in one of the modalities, regulating the impact of a specific modality on the overall result.