<p>Facial emotion recognition is an important topic of study in artificial intelligence and computer vision. In this paper, we offer a novel automated system for facial emotion identification that uses fusion approaches and a novel model architecture based on different flavors of MobileNet. MobileNet is widely used as a lightweight deep learning model; nonetheless, its application fusion technique with a range of its own flavors is novel. This paper introduces <InlineEquation ID="IEq3"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="11042_2025_20809_Article_IEq1.gif" Format="GIF" Height="16" Rendition="HTML" Resolution="72" Type="Linedraw" Width="26" /> </InlineMediaObject> <EquationSource Format="TEX">\(M^3\)</EquationSource> <EquationSource Format="MATHML"><math> <msup> <mi>M</mi> <mn>3</mn> </msup> </math></EquationSource> </InlineEquation>SI-Net, a novel facial emotion recognition model that leverages a fusion approach based on variants of MobileNet (MobileNetV2, MobileNetV3Small, and MobileNetV3Large). The model integrates Inception blocks and a re-parameterized Swish1 function to enhance feature extraction and classification accuracy. Through extensive experiments on the Jaffe and Cohn-Kanade datasets, we demonstrate that <InlineEquation ID="IEq4"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="11042_2025_20809_Article_IEq4.gif" Format="GIF" Height="16" Rendition="HTML" Resolution="72" Type="Linedraw" Width="26" /> </InlineMediaObject> <EquationSource Format="TEX">\(M^{3}\)</EquationSource> <EquationSource Format="MATHML"><math> <msup> <mi>M</mi> <mn>3</mn> </msup> </math></EquationSource> </InlineEquation>SI-Net achieves state-of-the-art performance, outperforming existing methods in terms of accuracy, precision, recall, and F1-score. Our approach provides new insights into facial emotion recognition and showcases the potential of fusion models in improving the accuracy and robustness of deep learning-based systems. This research looks at the importance of face expression recognition, which is important in human-computer interaction, affective computing, and a variety of applications in healthcare, entertainment, and security. Because of the intrinsic complexity and diversity of human face emotions, we needed to come up with creative solutions, which led us to use siameze learning approaches. The Siameze multiflavoured mobilenet model for a data fusion-based technique is a fundamental contribution of this work, boosting its expressiveness for greater adaptability. Our technique effectively leverages different information by merging multiple base models with various pre-processings, resulting in higher facial emotion identification accuracy. The combination of complimentary data from diverse sources improves the system’s accuracy and robustness. Our code will be made publicly available through this <a href="https://github.com/stuj2019/M-3SI">https://github.com/stuj2019/M-3SI</a>.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

\(M^3\)SI-Net: a fusion model for facial emotion recognition with inception blocks and re-parameterized Swish1 function

  • Sabyasachi Tribedi,
  • Ranjit Kumar Barai

摘要

Facial emotion recognition is an important topic of study in artificial intelligence and computer vision. In this paper, we offer a novel automated system for facial emotion identification that uses fusion approaches and a novel model architecture based on different flavors of MobileNet. MobileNet is widely used as a lightweight deep learning model; nonetheless, its application fusion technique with a range of its own flavors is novel. This paper introduces \(M^3\) M 3 SI-Net, a novel facial emotion recognition model that leverages a fusion approach based on variants of MobileNet (MobileNetV2, MobileNetV3Small, and MobileNetV3Large). The model integrates Inception blocks and a re-parameterized Swish1 function to enhance feature extraction and classification accuracy. Through extensive experiments on the Jaffe and Cohn-Kanade datasets, we demonstrate that \(M^{3}\) M 3 SI-Net achieves state-of-the-art performance, outperforming existing methods in terms of accuracy, precision, recall, and F1-score. Our approach provides new insights into facial emotion recognition and showcases the potential of fusion models in improving the accuracy and robustness of deep learning-based systems. This research looks at the importance of face expression recognition, which is important in human-computer interaction, affective computing, and a variety of applications in healthcare, entertainment, and security. Because of the intrinsic complexity and diversity of human face emotions, we needed to come up with creative solutions, which led us to use siameze learning approaches. The Siameze multiflavoured mobilenet model for a data fusion-based technique is a fundamental contribution of this work, boosting its expressiveness for greater adaptability. Our technique effectively leverages different information by merging multiple base models with various pre-processings, resulting in higher facial emotion identification accuracy. The combination of complimentary data from diverse sources improves the system’s accuracy and robustness. Our code will be made publicly available through this https://github.com/stuj2019/M-3SI.