Vision-guided robotic systems play a key role in industrial automation, particularly in flexible pick-and-place tasks. We present a modular approach that integrates automatic data extraction of 2D assembly drawings, object recognition, automatic robotic part placement, and augmented reality for quality inspection. The system combines a YOLOv8-based segmentation pipeline with classical shape-matching techniques to detect, identify, and align components during assembly. We apply a hybrid method to interpret assembly drawings that merge traditional computer vision with neural segmentation masks. The robotic setup features a 6-DOF arm controlled via Robot Operating System (ROS), with overhead cameras for object localization. This paper presents ongoing work. Preliminary results indicate improved segmentation accuracy using AI-based methods for extracting the foundational data from the 2D assembly drawings. Future work will focus on enhancing grasp and path planning, increasing placement precision, and improving the robustness of part detection. Additionally, we aim to generalize the system to previously unseen assembly plans and expand the feature extraction capabilities for complex assembly drawings.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Vision-Guided Approach to Pick-and-Place Robotics: From Assembly Drawings to Industrial Assembly Automation

  • Raphael Seliger,
  • Matthias Micheler,
  • Sebnem Gül-Ficici,
  • Ulrich Göhner

摘要

Vision-guided robotic systems play a key role in industrial automation, particularly in flexible pick-and-place tasks. We present a modular approach that integrates automatic data extraction of 2D assembly drawings, object recognition, automatic robotic part placement, and augmented reality for quality inspection. The system combines a YOLOv8-based segmentation pipeline with classical shape-matching techniques to detect, identify, and align components during assembly. We apply a hybrid method to interpret assembly drawings that merge traditional computer vision with neural segmentation masks. The robotic setup features a 6-DOF arm controlled via Robot Operating System (ROS), with overhead cameras for object localization. This paper presents ongoing work. Preliminary results indicate improved segmentation accuracy using AI-based methods for extracting the foundational data from the 2D assembly drawings. Future work will focus on enhancing grasp and path planning, increasing placement precision, and improving the robustness of part detection. Additionally, we aim to generalize the system to previously unseen assembly plans and expand the feature extraction capabilities for complex assembly drawings.