With the development of autonomous driving technology, object detection in long tail scenarios has become one of the key challenges. Insufficient samples of rare or extreme cases (long tail data) in real-world scenarios limit the model's generalization ability. Therefore, this study proposes a solution based on virtual real transfer learning, combining YOLOv5 algorithm and Cycle Generative Adversarial Networks (CycleGAN) algorithm to achieve cross domain object detection optimization from virtual to real scenes Firstly, YOLOv5 is pretrained on a virtual dataset to learn universal features through its efficient detection capability; Subsequently, CycleGAN was introduced for unsupervised domain adaptation, transforming the virtual image style into a realistic real scene style while preserving the integrity of annotation information, thereby reducing the domain difference between virtual and real data. Experiments have shown that this method significantly improves model performance in object detection tasks in long tail scenes, with Mean Average Precision (mAP) improved compared to the baseline model, especially in rare categories such as special vehicles and extreme weather targets. This study provides a scalable technical path for solving the long tail problem in autonomous driving, and verifies the effectiveness of virtual real transfer learning in cross domain perception tasks.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Research on Virtuality to Reality Transfer Learning Method for Autonomous Driving in Long Tail Scenarios

  • Di Zhang,
  • Zhe Du,
  • Bo Zhang

摘要

With the development of autonomous driving technology, object detection in long tail scenarios has become one of the key challenges. Insufficient samples of rare or extreme cases (long tail data) in real-world scenarios limit the model's generalization ability. Therefore, this study proposes a solution based on virtual real transfer learning, combining YOLOv5 algorithm and Cycle Generative Adversarial Networks (CycleGAN) algorithm to achieve cross domain object detection optimization from virtual to real scenes Firstly, YOLOv5 is pretrained on a virtual dataset to learn universal features through its efficient detection capability; Subsequently, CycleGAN was introduced for unsupervised domain adaptation, transforming the virtual image style into a realistic real scene style while preserving the integrity of annotation information, thereby reducing the domain difference between virtual and real data. Experiments have shown that this method significantly improves model performance in object detection tasks in long tail scenes, with Mean Average Precision (mAP) improved compared to the baseline model, especially in rare categories such as special vehicles and extreme weather targets. This study provides a scalable technical path for solving the long tail problem in autonomous driving, and verifies the effectiveness of virtual real transfer learning in cross domain perception tasks.