Robot arm grasping for cluttered fasteners based on deep learning with synthetic data augmentation
摘要
To address the challenges of grasping cluttered fasteners and the high cost of manual annotation, this paper proposes a deep learning-based cascaded grasping model and a synthetic data generation pipeline for fasteners. The cascaded grasping model first detects graspable fasteners using an improved YOLO v8n, followed by an estimation of the optimal grasping pose using an enhanced Generative Residual Convolutional Neural Network (GRCNN). The synthetic data generation pipeline leverages physics-based simulation with domain randomization to create synthetic cluttered fastener datasets, thereby augmenting the real dataset and effectively reducing the reliance on manual annotation while mitigating the generation of non-independent and identically distributed (non-IID) data. Experimental results demonstrate that the generated synthetic data significantly enhances model performance, and the proposed improvements effectively boost detection accuracy and robustness. In real-world grasping tasks, the proposed cascaded grasping model achieves an average grasping success rate of 92% across different fastener types and varying levels of clutter.