Scholarlink

The primary objective is to link communication barriers between individuals who use American Sign Language (ASL) and those who do not. This project focuses on developing a model that can accurately interpret ASL gestures in real-time during live streams, translating them into both text and audio formats. The methodology influences Natural Language Processing techniques, advanced Machine Learning, Deep Learning and Computer Vision, utilizing sophisticated libraries such as MediaPipe and gTTS. The model captures hand gestures in real-time from live streams, converts them into text similar to YouTube captions, and then translates the text into audio output. The 1990 Americans with Disabilities Act (ADA) bans any form of discrimination against individuals with disabilities. The ADA regulated telecommunication relay services and also closed captioning of federal and public service announcements. While addressing the need for effective communication, auxiliary aids are important. Requests for which are often turned down resulting in inconvenience and multiple litigations. This innovative approach aims to remove communication barriers, facilitating seamless interaction between ASL users and non-ASL users. By offering such interpretation services, this research promotes diversity and enhances accessibility in virtual meetings, ensuring effective engagement for all participants, regardless of their communication preferences.

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Interpreting American Sign Language into Text and Audio for Live Streaming

  • 会议论文

  • 发表日期：

    2026年

查看全文
  • Umadevi Ramamoorthy,
  • Seema Surendran,
  • Maria Sapthika

摘要

The primary objective is to link communication barriers between individuals who use American Sign Language (ASL) and those who do not. This project focuses on developing a model that can accurately interpret ASL gestures in real-time during live streams, translating them into both text and audio formats. The methodology influences Natural Language Processing techniques, advanced Machine Learning, Deep Learning and Computer Vision, utilizing sophisticated libraries such as MediaPipe and gTTS. The model captures hand gestures in real-time from live streams, converts them into text similar to YouTube captions, and then translates the text into audio output. The 1990 Americans with Disabilities Act (ADA) bans any form of discrimination against individuals with disabilities. The ADA regulated telecommunication relay services and also closed captioning of federal and public service announcements. While addressing the need for effective communication, auxiliary aids are important. Requests for which are often turned down resulting in inconvenience and multiple litigations. This innovative approach aims to remove communication barriers, facilitating seamless interaction between ASL users and non-ASL users. By offering such interpretation services, this research promotes diversity and enhances accessibility in virtual meetings, ensuring effective engagement for all participants, regardless of their communication preferences.