This paper describes the design and implementation of an affordable vision-based Augmentative and Alternative Communication (AAC) system for paralysis patients who retain eye gaze or blinking control to communicate. The proposed system employs a smartphone camera and a regular computer to detect and analyze eye movements using the Haar Cascade algorithm for real-time facial feature detection. These eye movements are translated into text and then converted into speech using a text-to-speech (TTS) mechanism. Four key eye movements (blink, left, right, up) are utilized to develop communication blocks, enabling individuals with minimal muscle control to communicate easily. Experimental results with 12 participants across varying educational and technological literacy levels demonstrate the system's ability to provide efficient and accurate communication, with participants showing varying degrees of success based on their familiarity with digital tools. The findings highlight the system's potential to enhance communication for individuals with severe motor impairments and emphasize the need for further research into adaptive interfaces and personalized calibration to improve accessibility.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Vision-Based Augmentative and Alternative Communication (AAC) System for Eye-Blink-Based Communication in Individuals with Paralysis

  • Gopi Krishan Ghosh,
  • Buddhadeb Chatterjee,
  • Sourav Kayal,
  • Suchibrata Datta,
  • Sanjib Kundu

摘要

This paper describes the design and implementation of an affordable vision-based Augmentative and Alternative Communication (AAC) system for paralysis patients who retain eye gaze or blinking control to communicate. The proposed system employs a smartphone camera and a regular computer to detect and analyze eye movements using the Haar Cascade algorithm for real-time facial feature detection. These eye movements are translated into text and then converted into speech using a text-to-speech (TTS) mechanism. Four key eye movements (blink, left, right, up) are utilized to develop communication blocks, enabling individuals with minimal muscle control to communicate easily. Experimental results with 12 participants across varying educational and technological literacy levels demonstrate the system's ability to provide efficient and accurate communication, with participants showing varying degrees of success based on their familiarity with digital tools. The findings highlight the system's potential to enhance communication for individuals with severe motor impairments and emphasize the need for further research into adaptive interfaces and personalized calibration to improve accessibility.