Cross-View Online Action Detection (CV-OAD) aims to learn action feature representations from videos of known viewpoints and generalize to unseen viewpoints for real-time action detection. It holds significant application value in intelligent surveillance, multi-camera systems, and related fields. However, existing methods face challenges in handling viewpoint discrepancies, feature domain adaptation, and temporal modeling. This paper proposes a novel Contrastive Learning with Future frame Guided method for cross-view Online Action Detection (CLFG-OAD). The method employs a GRU architecture to process inputs from different viewpoints and innovatively introduces a future frame-guided contrastive learning strategy during the training phase. Specifically, we design a Future-Guided Contrastive Learning loss function, which enhances feature representation quality through triplet contrastive learning, effectively suppressing background frame interference. Experiments on the IKEA and DAHLIA datasets demonstrate that our method significantly outperforms state-of-the-art approaches. Furthermore, ablation studies confirm the contribution of each component to the model’s cross-view performance, providing a new technical direction for cross-view online action detection. The related code is available at https://github.com/LuYang-2023/ISAIR_2025.git .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Cross-View Online Action Detection via Contrastive Learning with Future Frame Guidance

  • Yang Lu,
  • Liping Xie,
  • Yang Tan,
  • Jingyu Zhang

摘要

Cross-View Online Action Detection (CV-OAD) aims to learn action feature representations from videos of known viewpoints and generalize to unseen viewpoints for real-time action detection. It holds significant application value in intelligent surveillance, multi-camera systems, and related fields. However, existing methods face challenges in handling viewpoint discrepancies, feature domain adaptation, and temporal modeling. This paper proposes a novel Contrastive Learning with Future frame Guided method for cross-view Online Action Detection (CLFG-OAD). The method employs a GRU architecture to process inputs from different viewpoints and innovatively introduces a future frame-guided contrastive learning strategy during the training phase. Specifically, we design a Future-Guided Contrastive Learning loss function, which enhances feature representation quality through triplet contrastive learning, effectively suppressing background frame interference. Experiments on the IKEA and DAHLIA datasets demonstrate that our method significantly outperforms state-of-the-art approaches. Furthermore, ablation studies confirm the contribution of each component to the model’s cross-view performance, providing a new technical direction for cross-view online action detection. The related code is available at https://github.com/LuYang-2023/ISAIR_2025.git .