Scholarlink

This study presents an immersive interactive installation based on the In the Heavenly Palace Musicians mural from Kizil Cave 38, integrating theories of cultural computing and embodied interaction. The system transforms the mural’s intricate musical-dance structure into a participatory, multisensory experience by combining semantic image analysis, dynamic animation, spatial audio construction, and gesture-based interaction design. Structured in five stages—right-wall instrument triggering, paired musician activation, left-wall composite ensemble, central dancer co-performance, and audiovisual improvisation—the system guides users through bodily engagement, enabling a transformation from observers to co-performers. It successfully reinterprets the In the Heavenly Palace Musicians mural into a dynamic audiovisual narrative, offering a novel model for digital reenactment of cultural heritage. While user testing revealed limitations in interaction prompting, gesture sensitivity, and audio mapping consistency, the project demonstrates the fusion potential between symbolic reconstruction in cultural computing and behavioral construction in embodied interaction. Future work will include systematic user evaluations and technical optimization to enhance both the experiential quality and cultural depth of immersive heritage interfaces.

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

The Kizil Ensemble: Designing an Audio-Interactive System to Revive the Lost Orchestra of Cave 38

  • 会议论文

  • 发表日期：

    2026年

查看全文
  • Xiaohan Dong,
  • Yishan Duan,
  • Jialu Ni,
  • Lie Zhang

摘要

This study presents an immersive interactive installation based on the In the Heavenly Palace Musicians mural from Kizil Cave 38, integrating theories of cultural computing and embodied interaction. The system transforms the mural’s intricate musical-dance structure into a participatory, multisensory experience by combining semantic image analysis, dynamic animation, spatial audio construction, and gesture-based interaction design. Structured in five stages—right-wall instrument triggering, paired musician activation, left-wall composite ensemble, central dancer co-performance, and audiovisual improvisation—the system guides users through bodily engagement, enabling a transformation from observers to co-performers. It successfully reinterprets the In the Heavenly Palace Musicians mural into a dynamic audiovisual narrative, offering a novel model for digital reenactment of cultural heritage. While user testing revealed limitations in interaction prompting, gesture sensitivity, and audio mapping consistency, the project demonstrates the fusion potential between symbolic reconstruction in cultural computing and behavioral construction in embodied interaction. Future work will include systematic user evaluations and technical optimization to enhance both the experiential quality and cultural depth of immersive heritage interfaces.