Hashing techniques are widely adopted in cross-modal retrieval owing to low memory consumption and computational cost. However, there are two issues: (1) The semantic correlations implied in modal features are not fully explored; (2) The complementarity between modality-specific semantics and label semantics is not adequately utilized. To address these problems, we propose a method called Multimodal Pseudo-label Guided Semantic Enhanced Hashing Learning for Cross-Modal Retrieval (MPGSE). The method consists of three main steps: (1) Constructing pseudo-labels for each modality by using fuzzy clustering to capture semantic correlations among modal features. (2) Exploring the complementarity between modality-specific semantics and label semantics, while reducing semantic differences between modalities through consensus learning. (3) Generating discriminative hash codes for each modality. Comprehensive experiments on two benchmark datasets fully demonstrate the excellent performance of MPGSE. The relevant code can be accessed at https://github.com/WuhahaWU/whh_code

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multimodal Pseudo-label Guided Semantic Enhanced Hashing Learning for Cross-modal Retrieval

  • Changhong Wu,
  • Shaohua Teng,
  • Zefeng Zheng,
  • Wei Zhang,
  • Peipei Kang

摘要

Hashing techniques are widely adopted in cross-modal retrieval owing to low memory consumption and computational cost. However, there are two issues: (1) The semantic correlations implied in modal features are not fully explored; (2) The complementarity between modality-specific semantics and label semantics is not adequately utilized. To address these problems, we propose a method called Multimodal Pseudo-label Guided Semantic Enhanced Hashing Learning for Cross-Modal Retrieval (MPGSE). The method consists of three main steps: (1) Constructing pseudo-labels for each modality by using fuzzy clustering to capture semantic correlations among modal features. (2) Exploring the complementarity between modality-specific semantics and label semantics, while reducing semantic differences between modalities through consensus learning. (3) Generating discriminative hash codes for each modality. Comprehensive experiments on two benchmark datasets fully demonstrate the excellent performance of MPGSE. The relevant code can be accessed at https://github.com/WuhahaWU/whh_code