Virtual Reality (VR) technologies have transformed educational tools, particularly for communities requiring specialized learning solutions. Hearing-impaired individuals face significant challenges that impact their academic and social experiences. This project proposes the development of Ishara, a VR-based sign language chatbot designed to improve communication between deaf and hearing individuals, especially in educational settings, using Artificial Intelligence (AI). Integrating sign language into text translation and text-to-sign language conversion is crucial for fostering inclusion and equality in institutions such as schools, universities, and community centers. Ishara enables deaf students to conveniently share ideas with instructors, enhancing their academic performance and creating a more inclusive learning environment. It also assists teachers in understanding and addressing the needs of deaf students, reducing communication barriers. By leveraging machine learning and VR, Ishara provides an intuitive interface for seamless communication, bridging the accessibility gap. Its immersive VR environment enhances engagement, while AI algorithms adapt to users’ needs, ensuring personalized and effective interactions. The short-term goal is to implement the technology using an Arabic Sign Language dataset in academic settings, while the long-term goal is to expand its application across various sectors, improving interactions between people with special needs and the broader community. This study explores the effectiveness of an AI-driven chatbot integrated with VR to eliminate communication barriers and enhance the learning experience for hearing-impaired students, ultimately contributing to a more inclusive society.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Ishara: Virtual Sign Language Chatbot Proposal for an Interactive Learning Setting

  • Hoda Elsayed,
  • Danah Alharthi,
  • Norah Aleisa,
  • Haifa Alrabiah,
  • Nagham Naseeb

摘要

Virtual Reality (VR) technologies have transformed educational tools, particularly for communities requiring specialized learning solutions. Hearing-impaired individuals face significant challenges that impact their academic and social experiences. This project proposes the development of Ishara, a VR-based sign language chatbot designed to improve communication between deaf and hearing individuals, especially in educational settings, using Artificial Intelligence (AI). Integrating sign language into text translation and text-to-sign language conversion is crucial for fostering inclusion and equality in institutions such as schools, universities, and community centers. Ishara enables deaf students to conveniently share ideas with instructors, enhancing their academic performance and creating a more inclusive learning environment. It also assists teachers in understanding and addressing the needs of deaf students, reducing communication barriers. By leveraging machine learning and VR, Ishara provides an intuitive interface for seamless communication, bridging the accessibility gap. Its immersive VR environment enhances engagement, while AI algorithms adapt to users’ needs, ensuring personalized and effective interactions. The short-term goal is to implement the technology using an Arabic Sign Language dataset in academic settings, while the long-term goal is to expand its application across various sectors, improving interactions between people with special needs and the broader community. This study explores the effectiveness of an AI-driven chatbot integrated with VR to eliminate communication barriers and enhance the learning experience for hearing-impaired students, ultimately contributing to a more inclusive society.