Gesture recognition is a pivotal area of research, especially in the domain of sign language recognition, where precise recognition of gestures is crucial for effective communication. In this study, a novel approach for Indian sign language gesture recognition is introduced, leveraging the shifted window transformers (SWIN) architecture. SWIN Transformers, a recent advancement in computer vision, offer a scalable and efficient solution for capturing spatial dependencies in images. This research work provides a detailed overview of the SWIN architecture and its suitability for gesture recognition tasks, emphasizing its ability to handle long-range dependencies efficiently. A standard ISL dataset is utilized which comprises of diverse hand gestures, with 36 classes comprising of alphabets and digits. Thorough experiments demonstrate the effectiveness of the SWIN-based approach in achieving state-of-the-art results in gesture recognition. This study contributes to the advancement of gesture recognition research, particularly in the context of Indian scenario, by showcasing the capabilities of transformer-based architectures in handling spatial recognition tasks effectively by achieving a classification accuracy of 99.3%

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Indian Sign Language Recognition in Complex Backgrounds: A Shifted Window Attention Based Approach with Swin Transformers

  • B. V. Poornima,
  • S. Srinath,
  • S. Rashmi,
  • R. Rakshitha

摘要

Gesture recognition is a pivotal area of research, especially in the domain of sign language recognition, where precise recognition of gestures is crucial for effective communication. In this study, a novel approach for Indian sign language gesture recognition is introduced, leveraging the shifted window transformers (SWIN) architecture. SWIN Transformers, a recent advancement in computer vision, offer a scalable and efficient solution for capturing spatial dependencies in images. This research work provides a detailed overview of the SWIN architecture and its suitability for gesture recognition tasks, emphasizing its ability to handle long-range dependencies efficiently. A standard ISL dataset is utilized which comprises of diverse hand gestures, with 36 classes comprising of alphabets and digits. Thorough experiments demonstrate the effectiveness of the SWIN-based approach in achieving state-of-the-art results in gesture recognition. This study contributes to the advancement of gesture recognition research, particularly in the context of Indian scenario, by showcasing the capabilities of transformer-based architectures in handling spatial recognition tasks effectively by achieving a classification accuracy of 99.3%