Visible-infrared person re-identification (VI-ReID) aims to match people with the same identity between visible and infrared modalities. VI-ReID is a challenging task due to the large differences in individual appearance under different modalities. Existing methods generally try to bridge the cross-modal differences at the image or feature-level, which lacks exploring the discriminative embeddings. Effectively minimizing these cross-modal discrepancies relies on obtaining representations that are guided by identity and consistent across modalities, while also filtering out representations that are irrelevant to identity. To address these challenges, we introduce a dynamic identity-guided attention network (DIAN) to mine identity-guided and modality-consistent embeddings, facilitating effective bridging of the gap between different modalities. Specifically, in DIAN, to pursue a semantically richer representation, we first use orthogonal projection to generate rich semantic features. Furthermore, we first use dynamic convolution kernels to mine identity-guided and modality-consistent representations. More notably, a cross embedding balancing loss is introduced to effectively bridge cross-modal discrepancies. Experimental results on SYSU-MM01 and RegDB datasets show that DIAN achieves remarkable performance. The code is available at https://github.com/gaopenghkbu/DIAN .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Dynamic Identity-Guided Attention Network for Visible-Infrared Person Re-identification

  • Peng Gao,
  • Yujian Lee,
  • Hui Zhang,
  • Zailong Chen,
  • Xubo Liu

摘要

Visible-infrared person re-identification (VI-ReID) aims to match people with the same identity between visible and infrared modalities. VI-ReID is a challenging task due to the large differences in individual appearance under different modalities. Existing methods generally try to bridge the cross-modal differences at the image or feature-level, which lacks exploring the discriminative embeddings. Effectively minimizing these cross-modal discrepancies relies on obtaining representations that are guided by identity and consistent across modalities, while also filtering out representations that are irrelevant to identity. To address these challenges, we introduce a dynamic identity-guided attention network (DIAN) to mine identity-guided and modality-consistent embeddings, facilitating effective bridging of the gap between different modalities. Specifically, in DIAN, to pursue a semantically richer representation, we first use orthogonal projection to generate rich semantic features. Furthermore, we first use dynamic convolution kernels to mine identity-guided and modality-consistent representations. More notably, a cross embedding balancing loss is introduced to effectively bridge cross-modal discrepancies. Experimental results on SYSU-MM01 and RegDB datasets show that DIAN achieves remarkable performance. The code is available at https://github.com/gaopenghkbu/DIAN .