MLEM for Human Emotion Detection using Dynamic Visual Perception
摘要
Facial expression-based emotion detection has recently been widely used in decision-analysis processes, including mental health assessments. Although various methods have been employed to evaluate the psychological state of college students, limited research has explored the use of Dynamic Facial Expression Recognition (D-FER) for this purpose. This study introduces a model-conscious inspired Organized-Integrate-Voting (OIV) model to assess the mental health of engineering students in India. Using transfer learning, four highly accurate deep CNN classifiers (each exceeding 95% accuracy) independently recognize student emotions through D-FER. Multilevel fusion techniques are applied, where emotions are first integrated using Choquet and Sugeno fuzzy integrals and then further refined using a score-level voting approach. The results indicate that neutral emotions dominate (50-51%), with negative emotions (39-40%) significantly outweighing positive ones (9-10%), highlighting a concerning psychological state among students. The Year and gender-wise analyses further support this observation. The proposed OIV model could serve as a prototype for assessing student psychological distress, with publicly available repositories on GitHub and Zenodo facilitate future research and development.