Effective receptive field is crucial for accurately detecting remote sensing objects. However, the universally employed Convolutional Neural Networks suffer from a constrained receptive field, while the substantial computational demands of Transformers render them impractical for processing high-resolution remote sensing imagery. To this end, we propose Cross-Scan Mamba (CSM) based on Mamba, which is a selective state space model (SSM) capable of dynamically adjusting to input in order to efficiently model long-range dependencies. To address the issue of uneven and discontinuous target distribution in remote sensing images, we propose a Cross-Scan Mamba Block (CSMB): a framework that effectively integrates continuous scanning, regional scanning, and skip scanning methods to model the rich global context and local features within remote sensing scenes. Compared to a single scanning method, CSMB combines different scanning approaches to reduce the required scanning distance, while also introducing large convolutional kernels to supplement spatial features, enabling rapid and precise recognition of remote sensing targets. CSM showcases state-of-the-art performance on benchmark datasets, notably achieving an impressive 81.07% mAP on DOTA-v1.0 and 90.68% mAP on HRSC2016, thereby substantiating its efficacy in remote sensing object detection endeavors.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

CSM:Cross-Scan Mamba for Remote Sensing Object Detection

  • Jiachen Chen,
  • Qifeng Lin,
  • Longyuan Lin,
  • Yuanlong Yu,
  • Daoye Zhu,
  • Gang Fu

摘要

Effective receptive field is crucial for accurately detecting remote sensing objects. However, the universally employed Convolutional Neural Networks suffer from a constrained receptive field, while the substantial computational demands of Transformers render them impractical for processing high-resolution remote sensing imagery. To this end, we propose Cross-Scan Mamba (CSM) based on Mamba, which is a selective state space model (SSM) capable of dynamically adjusting to input in order to efficiently model long-range dependencies. To address the issue of uneven and discontinuous target distribution in remote sensing images, we propose a Cross-Scan Mamba Block (CSMB): a framework that effectively integrates continuous scanning, regional scanning, and skip scanning methods to model the rich global context and local features within remote sensing scenes. Compared to a single scanning method, CSMB combines different scanning approaches to reduce the required scanning distance, while also introducing large convolutional kernels to supplement spatial features, enabling rapid and precise recognition of remote sensing targets. CSM showcases state-of-the-art performance on benchmark datasets, notably achieving an impressive 81.07% mAP on DOTA-v1.0 and 90.68% mAP on HRSC2016, thereby substantiating its efficacy in remote sensing object detection endeavors.