<p>Addressing the technical challenges of low detection accuracy for small targets in UAV monitoring scenarios, this paper proposes MicroSight-DETR, an enhanced real-time detection model based on RT-DETR-r18. Through systematic analysis of RT-DETR’s behavior on UAV aerial imagery, we identify three stage-specific degradation mechanisms operating at successive stages of the detection pipeline: a receptive field bottleneck at the feature extraction stage, a single-domain representation limitation at the feature enhancement stage, and a spatial information collapse at the feature fusion stage. Guided by this analysis, the model introduces three complementary modules each targeting a specific identified weakness: the Global Efficient Modeling (GEM) backbone utilizes EfficientViM’s linear-complexity Mamba architecture combined with CGLU gating mechanisms to achieve global feature modeling with <InlineEquation ID="IEq1"><EquationSource Format="TEX">\(\mathscr {O}(L)\)</EquationSource></InlineEquation> complexity; the Multi-domain Adaptive Fusion Dynamics (MAFD) encoder integrates polarized attention, spectral frequency enhancement (SEFM), efficient feature mixing (MonarchMixer), and dynamic multi-scale aggregation (DyHead) to achieve adaptive spatial-frequency dual-domain fusion; and the Spatial Preserving Aggregation with Multi-scale (SPAM) neck employs SPDConv spatial-preserving transformation and CSPOmniKernel multi-scale convolutions to preserve shallow detail features critical for small target detection. Extensive experiments on the VisDrone2019 dataset demonstrate that MicroSight-DETR achieves 51.3% mAP@0.5, representing a 9.9% relative improvement over the baseline, while mAP@0.5:0.95 increases by 12% from 28.4% to 31.8%. Progressive ablation experiments show that the three modules contribute largely additive improvements, providing empirical evidence for their complementary design. The proposed MicroSight-DETR achieves real-time inference (78 FPS) on server-grade GPUs with only 16.1M parameters and 64.5 GFLOPs, providing a robust solution for ground station-based processing of UAV-captured imagery.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

MicroSight-DETR: spatial-preserving real-time transformer with multi-domain fusion for UAV micro-object detection

  • Junhao Guo,
  • Jinhao Jiang,
  • Zijing Yang,
  • Hao Zhang

摘要

Addressing the technical challenges of low detection accuracy for small targets in UAV monitoring scenarios, this paper proposes MicroSight-DETR, an enhanced real-time detection model based on RT-DETR-r18. Through systematic analysis of RT-DETR’s behavior on UAV aerial imagery, we identify three stage-specific degradation mechanisms operating at successive stages of the detection pipeline: a receptive field bottleneck at the feature extraction stage, a single-domain representation limitation at the feature enhancement stage, and a spatial information collapse at the feature fusion stage. Guided by this analysis, the model introduces three complementary modules each targeting a specific identified weakness: the Global Efficient Modeling (GEM) backbone utilizes EfficientViM’s linear-complexity Mamba architecture combined with CGLU gating mechanisms to achieve global feature modeling with \(\mathscr {O}(L)\) complexity; the Multi-domain Adaptive Fusion Dynamics (MAFD) encoder integrates polarized attention, spectral frequency enhancement (SEFM), efficient feature mixing (MonarchMixer), and dynamic multi-scale aggregation (DyHead) to achieve adaptive spatial-frequency dual-domain fusion; and the Spatial Preserving Aggregation with Multi-scale (SPAM) neck employs SPDConv spatial-preserving transformation and CSPOmniKernel multi-scale convolutions to preserve shallow detail features critical for small target detection. Extensive experiments on the VisDrone2019 dataset demonstrate that MicroSight-DETR achieves 51.3% mAP@0.5, representing a 9.9% relative improvement over the baseline, while mAP@0.5:0.95 increases by 12% from 28.4% to 31.8%. Progressive ablation experiments show that the three modules contribute largely additive improvements, providing empirical evidence for their complementary design. The proposed MicroSight-DETR achieves real-time inference (78 FPS) on server-grade GPUs with only 16.1M parameters and 64.5 GFLOPs, providing a robust solution for ground station-based processing of UAV-captured imagery.