Improving Object Detection Models via LLM-Based Training Data Synthesis
摘要
Despite significant advancements in deep generative models, generating high-quality training data for object detection remains a challenging task, primarily due to the complex requirements of precise annotations and diverse scenes. To address this challenge, we propose a novel framework for generating high-quality training data using Large Language Models (LLMs). First, we introduce the Layout Enhancement and Diverse Imagery Synthesis Framework (LE-DIS), which leverages LLMs to create diverse target scenes and systematically constructs synthetic data. Next, we propose a CLIP-based image-layout quality metric (CILQM) to evaluate the global consistency and category alignment of synthetic data, ensuring high-quality outputs. Finally, we employ a mixup-based strategy (SRMix) that integrates synthetic and real data to produce diverse training samples, enhancing the model’s stability and adaptability. Extensive experiments on the COCO benchmark demonstrate that our approach significantly improves the performance of both Transformer-based and CNN-based object detection models, highlighting the potential of deep generative models in synthesizing high-quality datasets for object detection tasks.