Deep learning based dynamic sign language translation system
摘要
Sign language is the primary mode of communication for individuals with speech and hearing impairments, relying heavily on hand gestures, finger shapes, and movements. Recognizing dynamic sign language words remains a significant challenge due to limited datasets and complex features. This study proposes a novel approach for classifying 24 dynamic American Sign Language (ASL) words using a Leap Motion Controller (LMC), which provides skeletal hand and finger data. Two custom datasets were created: one for 13 single-hand words and another for 11 double-hand words. A custom feature set was extracted, and a stacked Long Short-Term Memory (LSTM) model was employed for classification. The proposed method demonstrated high accuracy across multiple train-test-validation splits, showcasing its effectiveness in dynamic sign language recognition.