Recent methods for affective analysis have made progress in polarity prediction. However while they work to generate accurate natural language explanations, the transparency and user trust is limited–especially in complex, multi-aspect social media scenarios. To bridge this gap, we propose a method named EMAA(Explainable Multimodal Affective Analysis), a two-stage framework that integrates explanation generation into aspect-based sentiment analysis, combining self-training with direct preference optimization. Additionally, we develop a filter model to automatically evaluate and select high-quality explanations, thereby significantly improving the reliability of training data. Experiments on benchmark datasets show that our method outperforms the baselines in both classification accuracy and explanation quality. Furthermore, we demonstrate that high-quality explanations can improve the robustness and interpretability of sentiment classifications.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

EMAA: Towards Explainable Multimodal Affective Analysis

  • JiaQi Zhang,
  • JunJia Feng,
  • ShiYi Zhou,
  • YuTing Sun,
  • Lin Shang

摘要

Recent methods for affective analysis have made progress in polarity prediction. However while they work to generate accurate natural language explanations, the transparency and user trust is limited–especially in complex, multi-aspect social media scenarios. To bridge this gap, we propose a method named EMAA(Explainable Multimodal Affective Analysis), a two-stage framework that integrates explanation generation into aspect-based sentiment analysis, combining self-training with direct preference optimization. Additionally, we develop a filter model to automatically evaluate and select high-quality explanations, thereby significantly improving the reliability of training data. Experiments on benchmark datasets show that our method outperforms the baselines in both classification accuracy and explanation quality. Furthermore, we demonstrate that high-quality explanations can improve the robustness and interpretability of sentiment classifications.