Scholarlink

<p>To address the problem of insufficient detection accuracy in drone aerial and remote sensing images due to factors such as small target size, background interference, and occlusion, we propose a lightweight small object detection model, MDI-YOLO, based on multi-dimensional feature fusion of Transformer and CNN. In the MDI-YOLO model, we utilize a channel grouping strategy that combines the advantages of Transformer and CNN, proposing the C2f-Multi-Head Self-Attention-Convolutional Gated Linear Unit-Convolutional Neural Network (C2f-MCC) structure to improve the ability of the You Only Look Once v8 (YOLOv8) backbone network in extracting global features. Additionally, we propose Directional Fusion Attention (DFA), an attention mechanism that focuses on spatial and channel features across different dimensions, enhancing the model’s feature representation ability. Finally, we design the Inner-Shape-Intersection over Union (Inner-Shape-IoU) loss function, which thoroughly evaluates the bounding boxes by considering their shape, scale, and position, thereby improving the model’s precision in locating objects. The findings from the experiments reveal that the proposed detection model improves mAP@0.5 by 4% and mAP@0.5:0.95 by 2.5% on the VisDrone2019 dataset with nearly the number of parameters remaining unchanged. On the DOTAv1.0 dataset, mAP@0.5 is increased by 3.3%, and mAP@0.5:0.95 by 2.8%. The improved detection model not only enhances recognition accuracy but also maintains lightweight characteristics, making it suitable for drone aerial and remote sensing image detection, and strengthening the network’s robustness and generalization ability.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

MDI-YOLO a lightweight transformer-CNN-based multidimensional feature fusion model for small object detection

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年2月4日

查看全文
  • Hong Shi,
  • Yiming Wu,
  • Yong Xu,
  • Xiaofang Mu,
  • Mingxing Hou,
  • Bowen Shi,
  • Lingxiao Zhang

摘要

To address the problem of insufficient detection accuracy in drone aerial and remote sensing images due to factors such as small target size, background interference, and occlusion, we propose a lightweight small object detection model, MDI-YOLO, based on multi-dimensional feature fusion of Transformer and CNN. In the MDI-YOLO model, we utilize a channel grouping strategy that combines the advantages of Transformer and CNN, proposing the C2f-Multi-Head Self-Attention-Convolutional Gated Linear Unit-Convolutional Neural Network (C2f-MCC) structure to improve the ability of the You Only Look Once v8 (YOLOv8) backbone network in extracting global features. Additionally, we propose Directional Fusion Attention (DFA), an attention mechanism that focuses on spatial and channel features across different dimensions, enhancing the model’s feature representation ability. Finally, we design the Inner-Shape-Intersection over Union (Inner-Shape-IoU) loss function, which thoroughly evaluates the bounding boxes by considering their shape, scale, and position, thereby improving the model’s precision in locating objects. The findings from the experiments reveal that the proposed detection model improves mAP@0.5 by 4% and mAP@0.5:0.95 by 2.5% on the VisDrone2019 dataset with nearly the number of parameters remaining unchanged. On the DOTAv1.0 dataset, mAP@0.5 is increased by 3.3%, and mAP@0.5:0.95 by 2.8%. The improved detection model not only enhances recognition accuracy but also maintains lightweight characteristics, making it suitable for drone aerial and remote sensing image detection, and strengthening the network’s robustness and generalization ability.