Artificial Intelligence and Pose Tracking to Realize Serious Games and Exergames for Healthcare Workers in the Clinic
摘要
Healthcare workers (HCWs) face stress, burnout, and musculoskeletal disorders (MSDs) due to long hours, compassion fatigue, and physically demanding tasks. Gamified apps, serious games, and exergames effectively incorporate mindfulness techniques and exercises to reduce stress and mitigate MSDs. However, no existing solutions are specifically tailored to HCWs. To address this gap, two novel tools were developed and evaluated. FrogZen, a gamified stress reduction app, combines mindfulness techniques and Distraction Therapy with ChatGPT to alleviate occupational stress by diverting the user’s attention from stressors. The app features a companion, “Sir Hopsalot,” an interactive breathing exercise, and an AI-powered drawing game in which the companion guesses the user’s sketches. In a survey of 19 HCWs, the app scored 3.94 on the User Engagement Scale (UES-SF). Participants praised its engaging activities and calming theme but criticised its ease of use. Adoption into regular use would require the support of healthcare organizations. Additionally, an exergame prototype Lumbar Lagoon was developed to prevent lower back pain (LBP) by encouraging upper body movement through in-game exercises tracked by the Azure Kinect. Feedback from a physiotherapist highlighted the game’s engaging design and its potential to improve spine mobility and emphasized the importance of proper exercise execution and the need for more studies to assess its efficacy. These tools highlight the potential and key design considerations of gamification, serious games, and exergames to support HCWs in managing occupational challenges such as stress and MSDs. Future work includes quantitative studies, adding mini-games to FrogZen, and expanding Lumbar Lagoon to target MSDs affecting other body areas.