<p>Traditional supervised learning methods achieve remarkable performance in high-resolution remote sensing image retrieval, but are limited by the dependence on large-scale annotated images. Contrastive learning can leverage unlabeled images to learn powerful visual features, demonstrating its potential in many unsupervised tasks. Moreover, hash algorithms show significant potential in the field of image retrieval with their advantages in efficiency and storage. Therefore, we propose the Contrastive Hashing Framework based on Automatic Weight Allocation. The framework employs a two-stage training strategy. In the feature learning stage, we propose the Automatic Weighted Contrastive Loss (AWCLoss). It incorporates Gaussian weighting and dynamic adjustment strategies to improve loss functions, enabling them to focus on the distinctiveness and importance of samples. Gaussian weighting assigns different weight values based on the similarity of sample pairs, enhancing the learning of critical sample pairs. Meanwhile, the dynamic adjustment strategy sets a threshold to identify hard negative samples and then adjusts the weight values to weaken the model from being disturbed by hard negative samples. In the hashing learning stage, a hashing layer is added to the end of the network, which converts high-dimensional representations into hash codes. The Quantization loss is introduced to learn the hash codes so that the semantic similarity structure between data can be preserved in hamming space. Additionally, the AWCLoss is utilized to enhance the discriminative power of the hash codes. Extensive experiments on three remotely sensed datasets UCM, AID and NWPU-RESISC45 have demonstrated the significant superiority of our approach in remote sensing image retrieval. Our source code is available at <a href="https://github.com/WANGSJ77/AWCH">https://github.com/WANGSJ77/AWCH</a>.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Automatic Weight Allocation: optimizing remote sensing image retrieval from contrastive learning perspective

  • Sijia Wang,
  • Yun Ge,
  • Qiyang Liu,
  • Yan Zeng

摘要

Traditional supervised learning methods achieve remarkable performance in high-resolution remote sensing image retrieval, but are limited by the dependence on large-scale annotated images. Contrastive learning can leverage unlabeled images to learn powerful visual features, demonstrating its potential in many unsupervised tasks. Moreover, hash algorithms show significant potential in the field of image retrieval with their advantages in efficiency and storage. Therefore, we propose the Contrastive Hashing Framework based on Automatic Weight Allocation. The framework employs a two-stage training strategy. In the feature learning stage, we propose the Automatic Weighted Contrastive Loss (AWCLoss). It incorporates Gaussian weighting and dynamic adjustment strategies to improve loss functions, enabling them to focus on the distinctiveness and importance of samples. Gaussian weighting assigns different weight values based on the similarity of sample pairs, enhancing the learning of critical sample pairs. Meanwhile, the dynamic adjustment strategy sets a threshold to identify hard negative samples and then adjusts the weight values to weaken the model from being disturbed by hard negative samples. In the hashing learning stage, a hashing layer is added to the end of the network, which converts high-dimensional representations into hash codes. The Quantization loss is introduced to learn the hash codes so that the semantic similarity structure between data can be preserved in hamming space. Additionally, the AWCLoss is utilized to enhance the discriminative power of the hash codes. Extensive experiments on three remotely sensed datasets UCM, AID and NWPU-RESISC45 have demonstrated the significant superiority of our approach in remote sensing image retrieval. Our source code is available at https://github.com/WANGSJ77/AWCH.