Real-time sign language recognition depends on an enhanced CNN-LSTM architecture which uses ASL training data. A new preprocessing approach boosts image resolution to 46 × 46 pixels thus enhancing the recognition precision. Numerous frames enter the system which enables a deep learning model to analyze spatial and temporal features to identify different hand signals in real time. The system integrates with the Flask-React-based frontend which allows real-time predictions through webcam interfaces in order to support practical field use. The system translates acknowledged signs into speech audio through Text-to-Speech APIs which drives inclusion between hearing-impaired users and people who do not use sign language. The system’s effectiveness was validated through experimental testing which reached 95% accuracy. The system’s development will advance by implementing support for local sign languages with mobile platform integration.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

American Sign Language Recognition Using Hybrid Deep Learning Architecture

  • Abhijeet Kumar,
  • Yash Shekhawat,
  • Rahul Kumar,
  • K. Naresh

摘要

Real-time sign language recognition depends on an enhanced CNN-LSTM architecture which uses ASL training data. A new preprocessing approach boosts image resolution to 46 × 46 pixels thus enhancing the recognition precision. Numerous frames enter the system which enables a deep learning model to analyze spatial and temporal features to identify different hand signals in real time. The system integrates with the Flask-React-based frontend which allows real-time predictions through webcam interfaces in order to support practical field use. The system translates acknowledged signs into speech audio through Text-to-Speech APIs which drives inclusion between hearing-impaired users and people who do not use sign language. The system’s effectiveness was validated through experimental testing which reached 95% accuracy. The system’s development will advance by implementing support for local sign languages with mobile platform integration.