<p>Detecting small objects in unmanned aerial vehicle (UAV) imagery remains a formidable challenge attributed to sparse pixel representation, intricate background compositions, and stringent computational limitations on edge devices. Conventional detection methodologies encounter substantial difficulties in establishing adequate feature representations and integrating contextual information when processing targets typically occupying fewer than <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(32 \times 32\)</EquationSource> </InlineEquation> pixels. AGEC-DETR, an enhanced RT-DETR-based framework specifically engineered for UAV small object detection through three novel architectural components, is introduced. The Attention-Gated Enhanced Backbone (AGEB) incorporates single-head self-attention mechanisms alongside convolutional gated linear units to strengthen feature extraction while capturing both local and global contextual dependencies. The Efficient Small Object Pyramid maintains and amplifies small object characteristics through SPDConv and CSP-MSFE structures, effectively mitigating feature dilution prevalent in conventional pyramid architectures. The Context-Aware Fusion Module enables adaptive multi-scale feature integration via context-aware mechanisms, substantially enhancing target-background discrimination capabilities. Extensive validation on the VisDrone 2019 dataset reveals that the proposed approach achieves 23.1% AP and 18.8% <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\(\hbox {AP}_{\text {small}}\)</EquationSource> </InlineEquation>, demonstrating improvements of 2.3% and 3.1% respectively compared to baseline RT-DETR-R18. When contrasted with RT-DETR-R50, the method preserves superior accuracy while reducing parameters and computational overhead by 65.5% and 51.3% respectively. Cross-dataset evaluation on DOTA and UAVDT datasets validates the method’s robust generalization capabilities, establishing its suitability for deployment on resource-constrained UAV platforms across diverse applications including urban surveillance, traffic monitoring, and smart city infrastructure.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhanced small object detection in UAV aerial imagery through attention gated backbone and context aware fusion

  • WenFeng Li,
  • YuCheng Zhang

摘要

Detecting small objects in unmanned aerial vehicle (UAV) imagery remains a formidable challenge attributed to sparse pixel representation, intricate background compositions, and stringent computational limitations on edge devices. Conventional detection methodologies encounter substantial difficulties in establishing adequate feature representations and integrating contextual information when processing targets typically occupying fewer than \(32 \times 32\) pixels. AGEC-DETR, an enhanced RT-DETR-based framework specifically engineered for UAV small object detection through three novel architectural components, is introduced. The Attention-Gated Enhanced Backbone (AGEB) incorporates single-head self-attention mechanisms alongside convolutional gated linear units to strengthen feature extraction while capturing both local and global contextual dependencies. The Efficient Small Object Pyramid maintains and amplifies small object characteristics through SPDConv and CSP-MSFE structures, effectively mitigating feature dilution prevalent in conventional pyramid architectures. The Context-Aware Fusion Module enables adaptive multi-scale feature integration via context-aware mechanisms, substantially enhancing target-background discrimination capabilities. Extensive validation on the VisDrone 2019 dataset reveals that the proposed approach achieves 23.1% AP and 18.8% \(\hbox {AP}_{\text {small}}\) , demonstrating improvements of 2.3% and 3.1% respectively compared to baseline RT-DETR-R18. When contrasted with RT-DETR-R50, the method preserves superior accuracy while reducing parameters and computational overhead by 65.5% and 51.3% respectively. Cross-dataset evaluation on DOTA and UAVDT datasets validates the method’s robust generalization capabilities, establishing its suitability for deployment on resource-constrained UAV platforms across diverse applications including urban surveillance, traffic monitoring, and smart city infrastructure.