<p>As multimodal sentiment analysis technology continues to evolve, it is increasingly important to accurately capture and interpret sentiment information from different modalities. However, the traditional attention mechanism model employs a fixed number of attention heads across different attention levels, which makes it difficult to flexibly capture feature information at varying levels in text. This paper has proposed a deformable improvement strategy, comprising two key elements: Adaptive Attention Hierarchy and Head Optional Strategy, collectively referred to as the <InlineEquation ID="IEq3"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="10844_2025_974_Article_IEq1.gif" Format="GIF" Height="16" Rendition="HTML" Resolution="72" Type="Linedraw" Width="42" /> </InlineMediaObject> <EquationSource Format="TEX">\(A^{2} H^{2}\)</EquationSource> </InlineEquation> strategy. The experimental results demonstrate that the sentiment analysis model shows improved performance, with an accuracy of 87.97% using the <InlineEquation ID="IEq4"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="10844_2025_974_Article_IEq1.gif" Format="GIF" Height="16" Rendition="HTML" Resolution="72" Type="Linedraw" Width="42" /> </InlineMediaObject> <EquationSource Format="TEX">\(A^{2} H^{2}\)</EquationSource> </InlineEquation> strategy. In comparison to the prevailing sentiment analysis models, this deformable improvement strategy not only enhances the accuracy rate, but also reduces the information redundancy, improves the extraction efficiency of important features, and maintains the computational efficiency of the model in large-scale tasks. The codes are available at <a href="https://github.com/mmm587/A2H2">https://github.com/mmm587/A2H2</a>.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

\(A^{2} H^{2}\) for multimodal emotional data analysis

  • Jun Wu,
  • Jinyu Liu,
  • Tianfeng Zhang,
  • Shuai Guo,
  • Yu Chen,
  • Jiahui Huang,
  • Fang Deng

摘要

As multimodal sentiment analysis technology continues to evolve, it is increasingly important to accurately capture and interpret sentiment information from different modalities. However, the traditional attention mechanism model employs a fixed number of attention heads across different attention levels, which makes it difficult to flexibly capture feature information at varying levels in text. This paper has proposed a deformable improvement strategy, comprising two key elements: Adaptive Attention Hierarchy and Head Optional Strategy, collectively referred to as the \(A^{2} H^{2}\) strategy. The experimental results demonstrate that the sentiment analysis model shows improved performance, with an accuracy of 87.97% using the \(A^{2} H^{2}\) strategy. In comparison to the prevailing sentiment analysis models, this deformable improvement strategy not only enhances the accuracy rate, but also reduces the information redundancy, improves the extraction efficiency of important features, and maintains the computational efficiency of the model in large-scale tasks. The codes are available at https://github.com/mmm587/A2H2.