The posture estimate technique has been widely applied in physical therapy and sports fields, but this technique is scarcely used in the yoga domain. Classifying yoga positions using neural networks is a challenge due to the inherent complexity of yoga poses compared to regular stances. This paper presents a yoga pose classification where a skeleton of posture is obtained using body joint location. Then, the obtained skeleton is imposed on the original yoga pose image. Later, the transfer learning approach of convolutional neural network using VGG19 is trained and used using skeleton-imposed images for posture classification. Model accuracy, loss, and the confusion matrix of individual yoga poses were used to evaluate the classification results. Furthermore, the confusion matrix is diversified in terms of precision, recall, and F1-score. With the most joints in the body, the proposed model succeeded with a classification accuracy of 96%.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Skeleton-Imposed Yoga Posture Generation and Classification Using Convolutional Neural Network

  • Hiren Mewada,
  • Miral Desai

摘要

The posture estimate technique has been widely applied in physical therapy and sports fields, but this technique is scarcely used in the yoga domain. Classifying yoga positions using neural networks is a challenge due to the inherent complexity of yoga poses compared to regular stances. This paper presents a yoga pose classification where a skeleton of posture is obtained using body joint location. Then, the obtained skeleton is imposed on the original yoga pose image. Later, the transfer learning approach of convolutional neural network using VGG19 is trained and used using skeleton-imposed images for posture classification. Model accuracy, loss, and the confusion matrix of individual yoga poses were used to evaluate the classification results. Furthermore, the confusion matrix is diversified in terms of precision, recall, and F1-score. With the most joints in the body, the proposed model succeeded with a classification accuracy of 96%.