Scholarlink

<p>Lip reading systems determine the content of speech based on the visual tracking of lips of the speaker and therefore serve to offer communicative substitutes when acoustic information is not available in the environment. The training of strong lip reading models requires acquisition of specialised corpora that not only characterise the linguistic variability but also visual articulatory variability. In the given work, we introduce a new visual corpus which is specific to Kazakh lip reading. The corpus contains a collection of 102 nouns taking place most commonly in the Kazakh language with specific articulatory patterns and are recorded in 26 participants with a wide age range. The resultant series takes up about 34,000 short video clips, which resulted in about 1,2 million single frames. The resulting database is widely annotated, and thus would represent a very useful resource in improving the Kazakh lip reading technologies. It will promise great prospect for further researches in this area and the various researches that can be done in multi modal speech recognition.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

A Kazakh language Dataset of Lip Movements for Command Recognition

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年12月3日

查看全文
  • Batyr Kenzheakhmetov,
  • Alissultan Amankos,
  • Beibut Amirgaliyev,
  • Zhanel Zhanibekova,
  • Aidana Zhalgas,
  • Didar Yedilkhan

摘要

Lip reading systems determine the content of speech based on the visual tracking of lips of the speaker and therefore serve to offer communicative substitutes when acoustic information is not available in the environment. The training of strong lip reading models requires acquisition of specialised corpora that not only characterise the linguistic variability but also visual articulatory variability. In the given work, we introduce a new visual corpus which is specific to Kazakh lip reading. The corpus contains a collection of 102 nouns taking place most commonly in the Kazakh language with specific articulatory patterns and are recorded in 26 participants with a wide age range. The resultant series takes up about 34,000 short video clips, which resulted in about 1,2 million single frames. The resulting database is widely annotated, and thus would represent a very useful resource in improving the Kazakh lip reading technologies. It will promise great prospect for further researches in this area and the various researches that can be done in multi modal speech recognition.