This research focuses on the principle of human-machine interaction (HMI) to develop a real-time teleoperation system for an omnidirectional three-wheeled robot using voice commands. HMI allows humans to interact with machines, and teleoperation enables remote control through IoT technology and machine learning, enhancing the robot’s efficiency and accessibility. The research designs a mobile robot with Jetson Nano developer kit and an IMU 9DOF sensor for localization. The control interface is implemented through a mobile application using the Long Short-Term Memory (LSTM) algorithm for voice command recognition. Extensive testing with 160 trials, 40 repetitions for each voice command, evaluates the system’s accuracy and response time. The real-time teleoperation system demonstrates effective control of the omnidirectional robot with voice commands. Most commands are executed accurately, with slight deviations in specific directions. The internet-based approach ensures global control accessibility, catering to individuals with disabilities, and enhances human-robot interactions. The developed teleoperation system offers a promising solution for intuitive and efficient remote control of omnidirectional three-wheeled robots. The integration of voice commands and IoT-based technology enhances accessibility, convenience, and versatility in robot control. This research contributes to the advancement of HMI technologies and holds potential for various applications in industries and daily life, furthering progress in robotics and automation.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Development of an Omnidirectional Three-Wheeled Real-Time Teleoperation Robot Based on Human-Machine Interaction with Voice Command

  • Andreas Wegiq Adia Hendix,
  • Pringgo Widyo Laksono,
  • Bambang Suhardi,
  • Eko Pujiyanto

摘要

This research focuses on the principle of human-machine interaction (HMI) to develop a real-time teleoperation system for an omnidirectional three-wheeled robot using voice commands. HMI allows humans to interact with machines, and teleoperation enables remote control through IoT technology and machine learning, enhancing the robot’s efficiency and accessibility. The research designs a mobile robot with Jetson Nano developer kit and an IMU 9DOF sensor for localization. The control interface is implemented through a mobile application using the Long Short-Term Memory (LSTM) algorithm for voice command recognition. Extensive testing with 160 trials, 40 repetitions for each voice command, evaluates the system’s accuracy and response time. The real-time teleoperation system demonstrates effective control of the omnidirectional robot with voice commands. Most commands are executed accurately, with slight deviations in specific directions. The internet-based approach ensures global control accessibility, catering to individuals with disabilities, and enhances human-robot interactions. The developed teleoperation system offers a promising solution for intuitive and efficient remote control of omnidirectional three-wheeled robots. The integration of voice commands and IoT-based technology enhances accessibility, convenience, and versatility in robot control. This research contributes to the advancement of HMI technologies and holds potential for various applications in industries and daily life, furthering progress in robotics and automation.