The Human-Robot Interaction (HRI) system to help disabled and elderly community and improve their standard of living is still offers considerable potential for further exploration. This research work focuses on the automatic detection of objects through the automatic recognition of human finger count. The two Deep Learning (DL) techniques, MediaPipe and You Only Look Once (YOLO) v8 are employed for human finger count recognition and object detection, respectively. The study involves a mapping of finger count and corresponding object classes. A new dataset is created from scratch, encompassing four distinct object classes. Utilizing the Intel RealSense depth camera, the system provides position and depth information of the detected objects based on specific finger count. Simulation and experimental results indicate that the proposed approach outperforms recent related studies, demonstrating significant efficacy in developing an advanced HRI system.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Object Detection Through Finger Count Using Deep Learning Techniques for HRI

  • Saurabh Sachan,
  • Aman Deep Singh Gaur,
  • Jalaj Kumar Madaan,
  • Pushparaj Mani Pathak

摘要

The Human-Robot Interaction (HRI) system to help disabled and elderly community and improve their standard of living is still offers considerable potential for further exploration. This research work focuses on the automatic detection of objects through the automatic recognition of human finger count. The two Deep Learning (DL) techniques, MediaPipe and You Only Look Once (YOLO) v8 are employed for human finger count recognition and object detection, respectively. The study involves a mapping of finger count and corresponding object classes. A new dataset is created from scratch, encompassing four distinct object classes. Utilizing the Intel RealSense depth camera, the system provides position and depth information of the detected objects based on specific finger count. Simulation and experimental results indicate that the proposed approach outperforms recent related studies, demonstrating significant efficacy in developing an advanced HRI system.