Sign language serves as the primary mode of communication for individuals experiencing hearing and speech impairments. This chapter concentrates on vision-based system for recognizing and interpreting the Devnagari Sign Language (DSL). The chapter reviews existing literature on various kinds of systems for detecting and interpreting sign language and discusses different approaches, including glove-based systems, vision-based systems, and depth sensors. The proposed system created a dataset of 47 alphabets of Devnagari Sign Language and applied image augmentation techniques, segmentation, and canny edge detection for preprocessing. The system incorporates convolutional neural network architecture with convolutional layers, max-pooling layers, and fully connected neural networks for sign language recognition. This chapter evaluates the efficiency of a proposed system using precision, recall, F1 score, and support metrics. The proposed model attained an accuracy of 90.43% for 47 Devnagari alphabets.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Devnagari Sign Language Recognition for Deaf and Mute Individuals Using Convolutional Neural Network

  • Deepali R. Naglot,
  • Deepa S. Deshpande

摘要

Sign language serves as the primary mode of communication for individuals experiencing hearing and speech impairments. This chapter concentrates on vision-based system for recognizing and interpreting the Devnagari Sign Language (DSL). The chapter reviews existing literature on various kinds of systems for detecting and interpreting sign language and discusses different approaches, including glove-based systems, vision-based systems, and depth sensors. The proposed system created a dataset of 47 alphabets of Devnagari Sign Language and applied image augmentation techniques, segmentation, and canny edge detection for preprocessing. The system incorporates convolutional neural network architecture with convolutional layers, max-pooling layers, and fully connected neural networks for sign language recognition. This chapter evaluates the efficiency of a proposed system using precision, recall, F1 score, and support metrics. The proposed model attained an accuracy of 90.43% for 47 Devnagari alphabets.