Scholarlink

Blindness or visual impairment ranks among the top ten disabilities affecting both men and women, impacting over 35 million individuals of all ages in India. Access to visual information is crucial for enhancing the independence and safety of blind and visually impaired individuals. There exists a compelling imperative to develop assistive technologies that can significantly improve their quality of life. This paper presents SightAssist, a multilingual software solution designed to address the challenges faced by the visually impaired community in India. SightAssist utilizes a camera-based approach to serve as a digital prosthetic eye and virtual assistant, capable of currency detection, facial recognition, and providing various functionalities to assist with daily activities. Initially, a custom-labeled dataset has been prepared using a pre-trained YOLO model. Gradually, dataset pre-processing, normalization, and semantic segmentation are employed to optimize model performance. Additionally, voice-based accessibility features have been integrated using the Web Speech API, enabling users to interact with the application through voice commands. The experimental results show the successful development of SightAssist and its potential to significantly improve the lives of visually impaired people.

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

SightAssist: A Multi-facility Machine Learning Approach for Empowering the Visually Impaired

  • 会议论文

  • 发表日期：

    2025年

查看全文
  • Saikat Bandopadhyay,
  • Jhalak Dutta,
  • Smita Das,
  • Soumyajit Datta,
  • Debaditya Ghosh,
  • Rohit Kumar Dey,
  • Jeet Nandigrami

摘要

Blindness or visual impairment ranks among the top ten disabilities affecting both men and women, impacting over 35 million individuals of all ages in India. Access to visual information is crucial for enhancing the independence and safety of blind and visually impaired individuals. There exists a compelling imperative to develop assistive technologies that can significantly improve their quality of life. This paper presents SightAssist, a multilingual software solution designed to address the challenges faced by the visually impaired community in India. SightAssist utilizes a camera-based approach to serve as a digital prosthetic eye and virtual assistant, capable of currency detection, facial recognition, and providing various functionalities to assist with daily activities. Initially, a custom-labeled dataset has been prepared using a pre-trained YOLO model. Gradually, dataset pre-processing, normalization, and semantic segmentation are employed to optimize model performance. Additionally, voice-based accessibility features have been integrated using the Web Speech API, enabling users to interact with the application through voice commands. The experimental results show the successful development of SightAssist and its potential to significantly improve the lives of visually impaired people.