Keyword spotting (KWS) is the task of detecting specific keywords in audio streams and plays a critical role in various applications in the speech domain. This paper presents a multilingual keyword-spotting system for educational applications, particularly speech and hearing-impaired classrooms. We have targeted four languages, namely Hindi, Bengali, Odia, and English, and thirteen classroom instruction-related keywords for each language. We created a dataset containing 1564 training samples employing eight speakers for development. We build the system using an RNN-BiLSTM architecture and use Mel-frequency cepstral coefficients (MFCCs) to extract features. A test dataset of 180 samples is used to test the system, and we achieve a classification accuracy of 97.35% with an average confidence score of 98.65%. This system could bridge communication gaps in inclusive educational environments.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multilingual Keyword-Spotting System in Indian Languages for Inclusive Education System Applications

  • Malay Kumar Majhi,
  • Sujan Kumar Saha

摘要

Keyword spotting (KWS) is the task of detecting specific keywords in audio streams and plays a critical role in various applications in the speech domain. This paper presents a multilingual keyword-spotting system for educational applications, particularly speech and hearing-impaired classrooms. We have targeted four languages, namely Hindi, Bengali, Odia, and English, and thirteen classroom instruction-related keywords for each language. We created a dataset containing 1564 training samples employing eight speakers for development. We build the system using an RNN-BiLSTM architecture and use Mel-frequency cepstral coefficients (MFCCs) to extract features. A test dataset of 180 samples is used to test the system, and we achieve a classification accuracy of 97.35% with an average confidence score of 98.65%. This system could bridge communication gaps in inclusive educational environments.