Development of human-in-the-loop based robot environment awareness and control framework for underwater robot operation
摘要
Operating remotely operated vehicles (ROVs) in underwater environments requires advanced skill due to challenges, such as limited visibility and environmental complexity. To address these issues, a human-in-the-loop system (HILS) is proposed to synchronize real-time robot motion and environment data with operator feedback for enhanced teleoperation control. Our framework integrates a cyber-physical operation system (CPOS) that captures and replicates the robot’s motion, posture, and environmental conditions, allowing operators to intuitively control the ROV as if physically present. The HILS framework uses a 6-DOF motion platform and combines real-time dynamics, sensor data fusion, and haptic feedback for an immersive operator experience. Experimental validation demonstrated that our system accurately translates operator commands into responsive robot motion while providing real-time feedback on environmental conditions. Results indicate that HILS offers a promising solution for effective and efficient ROV teleoperation, even in challenging underwater scenarios. Sensors attached to the platform measured the robot’s movements with high precision, enabling effective, low-latency feedback to the operator.