Aerial-Ground Person Re-identification (AGPReID) aims to retrieve target individuals across UAV and ground cameras, focusing on the perspective variations due to altitude changes. The unique overhead perspective of UAVs presents challenges in achieving accurate semantic alignment for person re-identification (ReID). We propose a novel method named Perspective-Driven Prototype Alignment (PDPA) to address this issue. First, we design two learnable prompts for each identity to obtain view representations from different perspectives. Second, we propose a View-Guided Progressive Alignment (VGPA) module for cross-perspective refinement of text descriptions, exploring the intermediate feature space between different perspectives by combining the image and text features using a memory bank. To reduce the gap between image feature space and intermediate feature space, we propose an image-to-prototype cross-entropy loss to train the image encoder. Extensive experiments show that our method achieves SOTA performance on the CARGO and AG-ReID_v1 datasets.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Perspective Driven Prototype Alignment for Aerial-Ground Person Re-identification

  • Yuli Huang,
  • Hongxu Chen,
  • Zhanxiang Feng,
  • Jianhuang Lai

摘要

Aerial-Ground Person Re-identification (AGPReID) aims to retrieve target individuals across UAV and ground cameras, focusing on the perspective variations due to altitude changes. The unique overhead perspective of UAVs presents challenges in achieving accurate semantic alignment for person re-identification (ReID). We propose a novel method named Perspective-Driven Prototype Alignment (PDPA) to address this issue. First, we design two learnable prompts for each identity to obtain view representations from different perspectives. Second, we propose a View-Guided Progressive Alignment (VGPA) module for cross-perspective refinement of text descriptions, exploring the intermediate feature space between different perspectives by combining the image and text features using a memory bank. To reduce the gap between image feature space and intermediate feature space, we propose an image-to-prototype cross-entropy loss to train the image encoder. Extensive experiments show that our method achieves SOTA performance on the CARGO and AG-ReID_v1 datasets.