Delving into the realm of automated lip-reading systems, this study conducts a comprehensive evaluation, centering its examination on pivotal components such as audiovisual datasets, feature extraction techniques, classification networks, and frameworks. Through this analysis, significant gaps and shortcomings in existing systems are uncovered. Initially, the study aims to assess the advantages of various architectural approaches, including attention-transformers, temporal convolutional networks (TCNs), long short-term memory (LSTM), and gated recurrent units (GRU). Additionally, it reviews the most recent lip-reading devices available on the market as of early 2023. The goal of this survey is to inform and shape future research in automated lip reading by shedding light on current approaches.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Leveraging Deep Learning for Lip Reading: A Comprehensive Analysis

  • Gaurav Boob,
  • Somya Maheshwari,
  • Abhishek Jain,
  • R. Sreemathy

摘要

Delving into the realm of automated lip-reading systems, this study conducts a comprehensive evaluation, centering its examination on pivotal components such as audiovisual datasets, feature extraction techniques, classification networks, and frameworks. Through this analysis, significant gaps and shortcomings in existing systems are uncovered. Initially, the study aims to assess the advantages of various architectural approaches, including attention-transformers, temporal convolutional networks (TCNs), long short-term memory (LSTM), and gated recurrent units (GRU). Additionally, it reviews the most recent lip-reading devices available on the market as of early 2023. The goal of this survey is to inform and shape future research in automated lip reading by shedding light on current approaches.