Design and Validation of a Multidisciplinary Mobile App Simulator of a Real-Time Human Body Modeling and Movement Tracking
摘要
In this chapter, a development of a multidisciplinary mobile application of a three-dimensional hand simulator that tracks the movements of a human hand is reported. This project integrates the knowledge of mechatronics specialists, computer scientists, mathematicians, and programmers. The application used OpenGL ES, a simple model of hand joints made in Blender and loaded into an Android application and the MediaPipe library for tracking the user’s hand. The idea behind the project consists of creating an environment that allows the student to understand the bio-inspired physiological parameters to develop a prosthesis, the mathematics behind the model, and the computational requirements and tools to carry out the 3D model.