Hand gesturing with natural hand movement combined with voice controlling is the best-suited model for convenient computer control and voice-assisting experience. The proposed system is divided into three modules comprising an ultrasonic sensor-based basic commanding, hand tracking for live mouse pointer movement, and voice assistance. The microcontroller and ultrasonic sensor are used to process hand gestures. Mouse pointer movement is being implemented with an in-build webcam that captures live video images and is implemented through OpenCV, Machine learning-trained solutions through media pipe, and User interface interpretation. A user interface designed to have a chat session experience with voice-enabled controlling based on natural language processing. The proposed work consists of two gesture control systems, a static gesture system that includes five predefined gestures for navigating the browser, and a dynamic gesture system that incorporates all mouse pointer controls. Based on varying choices, the control system can be used to its fullest potential. Almost all necessary computer controls can be performed using voice commands too, bypassing the requirement for a mouse or keyboard.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Ultrasonic Sensor-Enabled Hand Gesture Commands for Computer Navigation

  • S. Subhashini,
  • S. Revathi,
  • H. Zulfa Ali

摘要

Hand gesturing with natural hand movement combined with voice controlling is the best-suited model for convenient computer control and voice-assisting experience. The proposed system is divided into three modules comprising an ultrasonic sensor-based basic commanding, hand tracking for live mouse pointer movement, and voice assistance. The microcontroller and ultrasonic sensor are used to process hand gestures. Mouse pointer movement is being implemented with an in-build webcam that captures live video images and is implemented through OpenCV, Machine learning-trained solutions through media pipe, and User interface interpretation. A user interface designed to have a chat session experience with voice-enabled controlling based on natural language processing. The proposed work consists of two gesture control systems, a static gesture system that includes five predefined gestures for navigating the browser, and a dynamic gesture system that incorporates all mouse pointer controls. Based on varying choices, the control system can be used to its fullest potential. Almost all necessary computer controls can be performed using voice commands too, bypassing the requirement for a mouse or keyboard.