<p>During the early stages of the Industry 4.0 era, teleoperation with human involvement in manufacturing processes and robot operation remained important. The existing teleoperation technologies have limitations in providing operators with spatial awareness and initiative control mechanisms, making their applications difficult in tasks with high complexity and precision. This study implements the advancements from the internet of things (IoT) and virtual reality (VR) technology to improve the real-time teleoperation for industrial robots. The proposed design utilizes the benefits of the Message Queuing Telemetry Transport (MQTT) protocol in conjunction with a cloud broker, which has not been addressed significantly in previous studies for teleoperation. This setup enables the system to efficiently handle substantial amounts of data in short periods of time, allowing for an uninterrupted user experience while maintaining a consistent connection regardless of distance. Real-time robot control is accomplished by tracking the user’s hand movements with a VR controller while providing the user with visual feedback from the VR environment. The incorporation of VR technology intends to improve the intuitiveness of controlling robot operations, provide more responsive feedback, and improve the quality of work performed by operators. Practical experiments are conducted with an industrial robot to observe the performance against the system under different internet conditions and different QoS setups. The evaluation criteria primarily concern about latency and accuracy. The experiment aims to evaluate the effectiveness and scalability of the suggested system and to offer significant insight into its advantages and limitations relative to existing control system through systematic investigation.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhancing real-time robot teleoperation with immersive virtual reality in industrial IoT networks

  • Toan Luu,
  • Quang Nguyen,
  • Thien Tran,
  • Minh Tran,
  • Songlin Ding,
  • Jonathan Kua,
  • Thuong Hoang

摘要

During the early stages of the Industry 4.0 era, teleoperation with human involvement in manufacturing processes and robot operation remained important. The existing teleoperation technologies have limitations in providing operators with spatial awareness and initiative control mechanisms, making their applications difficult in tasks with high complexity and precision. This study implements the advancements from the internet of things (IoT) and virtual reality (VR) technology to improve the real-time teleoperation for industrial robots. The proposed design utilizes the benefits of the Message Queuing Telemetry Transport (MQTT) protocol in conjunction with a cloud broker, which has not been addressed significantly in previous studies for teleoperation. This setup enables the system to efficiently handle substantial amounts of data in short periods of time, allowing for an uninterrupted user experience while maintaining a consistent connection regardless of distance. Real-time robot control is accomplished by tracking the user’s hand movements with a VR controller while providing the user with visual feedback from the VR environment. The incorporation of VR technology intends to improve the intuitiveness of controlling robot operations, provide more responsive feedback, and improve the quality of work performed by operators. Practical experiments are conducted with an industrial robot to observe the performance against the system under different internet conditions and different QoS setups. The evaluation criteria primarily concern about latency and accuracy. The experiment aims to evaluate the effectiveness and scalability of the suggested system and to offer significant insight into its advantages and limitations relative to existing control system through systematic investigation.