Learning to play the piano can be a difficult and lengthy process, and many beginners lose motivation. While digital tools exist, they may not fully capture the experience of playing. This paper introduces ChordFusion, a piano training system using Mixed Reality (MR) and custom-built interactive gloves. ChordFusion aims to make learning more effective and engaging by using visualization, active learning, and game-like features in an immersive MR setting. The system includes different modes (Freestyle, Auto, Practice) to suit various learning styles. We describe the design of ChordFusion, how the custom gloves work, and our plans for future improvements, including testing with users to see how well it helps them learn, improving its responsiveness, and making the finger tracking more advanced for a realistic playing experience.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

ChordFusion: Interactive Piano Training in Mixed Reality with Custom Gloves

  • Muhammad Faiq Haikal Bin M Haikal,
  • Deb Kumar Ghosh,
  • Jordan K. Lay,
  • Nicko R. Caluya,
  • Damon M. Chandler

摘要

Learning to play the piano can be a difficult and lengthy process, and many beginners lose motivation. While digital tools exist, they may not fully capture the experience of playing. This paper introduces ChordFusion, a piano training system using Mixed Reality (MR) and custom-built interactive gloves. ChordFusion aims to make learning more effective and engaging by using visualization, active learning, and game-like features in an immersive MR setting. The system includes different modes (Freestyle, Auto, Practice) to suit various learning styles. We describe the design of ChordFusion, how the custom gloves work, and our plans for future improvements, including testing with users to see how well it helps them learn, improving its responsiveness, and making the finger tracking more advanced for a realistic playing experience.