Graph Neural Networks (GNNs) have emerged as powerful tools for processing graph-structured data, with applications spanning diverse domains. This study proposes and evaluates customized GNN architectures for graph classification, specifically targeting the recognition of American Sign Language (ASL). We leverage a customized ASL dataset, where gestures are represented as graph structures, nodes capture key hand landmarks, and edges model their spatial and temporal relationships. Several GNN architectures are designed and optimized with varying hyperparameters to enhance classification accuracy. These models are benchmarked against traditional deep learning approaches, such as Multi-layer Perceptrons (MLPs) and Convolutional Neural Networks (CNNs), which rely on non-graphical representations of the dataset. The study highlights the advantages of graph-based representations for ASL recognition, providing insights into the limitations of traditional grid-based approaches. These findings underscore the potential of GNN-based methods for real-world ASL translation tasks, while suggesting future directions for hyperparameter refinement and architectural optimization.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Advancing Sign Language Recognition Using Deep Learning and Graph Neural Networks

  • Safae Fouad,
  • El Houssaine Hssayni,
  • Moussa Jamor,
  • Anas Nouri,
  • Yasser El Madani El Alami

摘要

Graph Neural Networks (GNNs) have emerged as powerful tools for processing graph-structured data, with applications spanning diverse domains. This study proposes and evaluates customized GNN architectures for graph classification, specifically targeting the recognition of American Sign Language (ASL). We leverage a customized ASL dataset, where gestures are represented as graph structures, nodes capture key hand landmarks, and edges model their spatial and temporal relationships. Several GNN architectures are designed and optimized with varying hyperparameters to enhance classification accuracy. These models are benchmarked against traditional deep learning approaches, such as Multi-layer Perceptrons (MLPs) and Convolutional Neural Networks (CNNs), which rely on non-graphical representations of the dataset. The study highlights the advantages of graph-based representations for ASL recognition, providing insights into the limitations of traditional grid-based approaches. These findings underscore the potential of GNN-based methods for real-world ASL translation tasks, while suggesting future directions for hyperparameter refinement and architectural optimization.