<p>The problem of remote sensing image object detection is one of the important research contents of visual image recognition tasks. Compared with convolutional neural networks, the third-generation brain-like spike neural networks have great potential advantages for on-orbit processing of remote sensing images (RSI) due to its high energy efficiency and low consumption. This paper studies how to increase accuracy of SpikeYOLO for RSI analysis, and proposes an improvement method. First, a dynamic membrane potential attenuation mechanism is constructed and the fixed attenuation factor is reconstructed into a learnable parameter. Then, the membrane potential is updated through vectorized parallel computing. Learnable residual weights are introduced to improve the feature fusion capability and; finally, the calculation fl ow is adjusted. On the RSOD remote sensing dataset, we obtained 96.8% mAP50 and 64.8% mAP50:95, which are 6.7% and 2.3% higher than the previous state-of-the-art SpikeYOLO, respectively. On the NWPU-VHR-10 dataset, we obtained 92.8% mAP50, which is 1.5% higher than SpikeYOLO with the same architecture.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Spikeyolo-RS: Improved Spike-Convolution Neural Network for Remote Sensing Image Object Detection

  • Xianyi Wu,
  • Sergey Ablameyko

摘要

The problem of remote sensing image object detection is one of the important research contents of visual image recognition tasks. Compared with convolutional neural networks, the third-generation brain-like spike neural networks have great potential advantages for on-orbit processing of remote sensing images (RSI) due to its high energy efficiency and low consumption. This paper studies how to increase accuracy of SpikeYOLO for RSI analysis, and proposes an improvement method. First, a dynamic membrane potential attenuation mechanism is constructed and the fixed attenuation factor is reconstructed into a learnable parameter. Then, the membrane potential is updated through vectorized parallel computing. Learnable residual weights are introduced to improve the feature fusion capability and; finally, the calculation fl ow is adjusted. On the RSOD remote sensing dataset, we obtained 96.8% mAP50 and 64.8% mAP50:95, which are 6.7% and 2.3% higher than the previous state-of-the-art SpikeYOLO, respectively. On the NWPU-VHR-10 dataset, we obtained 92.8% mAP50, which is 1.5% higher than SpikeYOLO with the same architecture.