Dynamic Identity-Guided Attention Network for Visible-Infrared Person Re-identification
摘要
Visible-infrared person re-identification (VI-ReID) aims to match people with the same identity between visible and infrared modalities. VI-ReID is a challenging task due to the large differences in individual appearance under different modalities. Existing methods generally try to bridge the cross-modal differences at the image or feature-level, which lacks exploring the discriminative embeddings. Effectively minimizing these cross-modal discrepancies relies on obtaining representations that are guided by identity and consistent across modalities, while also filtering out representations that are irrelevant to identity. To address these challenges, we introduce a dynamic identity-guided attention network (DIAN) to mine identity-guided and modality-consistent embeddings, facilitating effective bridging of the gap between different modalities. Specifically, in DIAN, to pursue a semantically richer representation, we first use orthogonal projection to generate rich semantic features. Furthermore, we first use dynamic convolution kernels to mine identity-guided and modality-consistent representations. More notably, a cross embedding balancing loss is introduced to effectively bridge cross-modal discrepancies. Experimental results on SYSU-MM01 and RegDB datasets show that DIAN achieves remarkable performance. The code is available at https://github.com/gaopenghkbu/DIAN .