This work aims to improve social inclusion and communication for the country’s 300,000+ deaf population through the development of recognition technology for Nepali Sign Language (NSL). Social connection has been limited by NSL’s lack of technological focus in comparison to larger sign languages. To address this problem, we developed a high-accuracy NSL gesture detection system based on the YOLOv8 architecture. On the NSL23 dataset, which comprises 1205 motions in 630 videos, its accuracy was 98.6%. The dataset was then accordingly labeled and preprocessed including augmentation to introduce more variation. Due to the capability of our approach being in real-time, it greatly improves accessibility for NSL users in practicing the actual use of the assisting equipment. This work presents a scalable solution for recognizing NSL, which could serve as the starting point of further research into developing sign language technology, especially for less-resourced languages.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Deep Learning Approach for Nepal Sign Detection

  • M. Vignesh,
  • K. Jaidev,
  • T. Taruneshwaran,
  • P. Seetharaman,
  • V. Sowmya

摘要

This work aims to improve social inclusion and communication for the country’s 300,000+ deaf population through the development of recognition technology for Nepali Sign Language (NSL). Social connection has been limited by NSL’s lack of technological focus in comparison to larger sign languages. To address this problem, we developed a high-accuracy NSL gesture detection system based on the YOLOv8 architecture. On the NSL23 dataset, which comprises 1205 motions in 630 videos, its accuracy was 98.6%. The dataset was then accordingly labeled and preprocessed including augmentation to introduce more variation. Due to the capability of our approach being in real-time, it greatly improves accessibility for NSL users in practicing the actual use of the assisting equipment. This work presents a scalable solution for recognizing NSL, which could serve as the starting point of further research into developing sign language technology, especially for less-resourced languages.