Recognition of American sign language using modified deep residual CNN with modified canny edge segmentation
摘要
American Sign Language (ASL) recognition aims to recognize hand gestures, and it is a crucial solution to communicating between the deaf community and hearing people. However, existing sign language recognition algorithms still have some drawbacks, such as difficulty recognizing hand movements and low recognition accuracy for most sign language recognition. A Modified Convolutional Neural Network (MCNN) deep residual 101 classifier-based American Sign Language identification system has been developed to address this problem. There are three main parts presents in the method. The first part is pre-processing the images to remove the noise, enhance the contrast of the picture, adjust the contrast level and smoothen the picture using various filters. The second part is the segmentation, and it’s used to partition the image using a modified canny edge detection method by removing all weak edges present in the image. Finally, classification will be done using the Modified CNN deep residual 101 classifiers. By classifying the image, the American Sign Language is accurately identified. This process is conducted through images. The outcome shows that the suggested approach has a 0.97% accuracy and a 0.05% False Positive Rate. Other CNN architectures such as resNet 50 and resNet 18 reached 0.90% and 0.80% accuracy, respectively, which is lower than our proposed method. In addition, the resNet 101 classifier effectively recognizes the difficult hand gestures through the image data. It obtains high recognition accuracy for 36 signs is 0 to 9 numbers and a to z alphabets from American Sign Language.