Inclusive Health Care Journey: Virtual Communication for Hearing-Impaired Patients in Telugu States Using Gestures
摘要
Sign language, a form of visual communication, utilizes hand and body movements to express meaning, providing a crucial means of communication for people with hearing impairments. This communication gap hinders meaningful interactions, social integration, and access to information for hearing-impaired individuals. Addressing these challenges through technological innovations holds the potential to enhance inclusivity and bridge this linguistic divide. Regional Language (Telugu) aligns more closely with cultural nuances, allowing for richer and more authentic communication as relaying on messages through English sign gestures may lead to misunderstandings. The proposed system aims to facilitate communication with hearing-impaired individuals in Telugu by utilizing various libraries and technologies to establish a robust framework. Google API recognizes the Telugu speech then will be translated into sign language gestures corresponding to the Telugu Gesture dataset using NLP, which will be presented through an avatar animated model created using CC4 and Deep Motion. This interactive approach bridges the communication gap between Telugu-speaking caretakers or hospital staff and hearing-impaired individuals in the region. The incorporation of an avatar and sign language gestures adds a natural and engaging dimension to communication, thereby enhancing the user experience and facilitating more effective interactions.