In micro-action recognition, accurately locating coarse-grained action boundaries and capturing detailed fine-grained actions are both crucial. We introduce DualActNet, which integrates the benefits of the SlowFast network architecture with advanced attention mechanisms. The slow channel employs HaloNet Attention to enhance local information processing and delineate coarse-grained actions. Conversely, the fast channel utilizes CBAM (Convolutional Block Attention Module) Attention, which merges spatial and channel attention to heighten sensitivity to fine-grained actions. In the fusion stage, SE (Squeeze-and-Excitation) Attention re-weights channel features to integrate insights from both channels synergistically. A dynamic loss function is introduced to address the class imbalance. Testing on the MA-52 dataset, DualActNet demonstrates superior performance over the baseline SlowFast and the MANet models, achieving higher \(F1_{mean}\) and Acc-Top1 metrics for both action types.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

DualActNet: Exploiting SlowFast Architecture for Micro-action Recognition

  • Churan Yu,
  • Yiwei Ru,
  • Zhenbo Xu,
  • Huijia Wu,
  • Hujiang Yang,
  • Zhaofeng He

摘要

In micro-action recognition, accurately locating coarse-grained action boundaries and capturing detailed fine-grained actions are both crucial. We introduce DualActNet, which integrates the benefits of the SlowFast network architecture with advanced attention mechanisms. The slow channel employs HaloNet Attention to enhance local information processing and delineate coarse-grained actions. Conversely, the fast channel utilizes CBAM (Convolutional Block Attention Module) Attention, which merges spatial and channel attention to heighten sensitivity to fine-grained actions. In the fusion stage, SE (Squeeze-and-Excitation) Attention re-weights channel features to integrate insights from both channels synergistically. A dynamic loss function is introduced to address the class imbalance. Testing on the MA-52 dataset, DualActNet demonstrates superior performance over the baseline SlowFast and the MANet models, achieving higher \(F1_{mean}\) and Acc-Top1 metrics for both action types.