AMNet: an attention-enhanced multi-branch network for micro-expression recognition
摘要
Micro-expressions, subtle facial movements revealing concealed emotions, are challenging to recognize due to their short duration, low intensity, and limited balanced datasets. This paper proposes an attention-enhanced multi-branch network (AMNet) with three core innovations to overcome these limitations in micro-expression recognition. First, an improved attention mechanism is designed to dynamically emphasize discriminative facial regions critical for identifying subtle expressions. Second, a spatiotemporal fusion module, built on the synergy of lightweight STSTNet and ConvLSTM, efficiently integrates spatial and temporal information for the comprehensive micro-expression dynamics modeling. Third, a hierarchical feature fusion strategy is implemented to progressively refine multi-branch features, ensuring the robust learning of micro-expression characteristics. Extensive experiments on CASME II, SAMM, SMIC, 3DB-composite and CAS(ME)3 datasets demonstrate AMNet’s superiority over state-of-the-art approaches, with exceptional accuracy and generalization. The code is available at https://github.com/yilin-succeed/AMNET.