Fluid Body is an experimental, body-driven instrument with which participants can use a compact classical ballet arm-posture vocabulary to play a digital Guzheng. The system implements an interactive machine-learning mapping that combines a posture classifier to label each recognized posture, with a regression model for continuous control of granular sound synthesis parameters. Six ballet arm positions are associated with six edited Guzheng sound events, enabling participants to trigger distinct phrase regions through posture changes while continuously modulating the timbre in real time. We use intercultural co-adaptation in a dynamic, operational way. Rather than claiming literal translation between ballet and Guzheng traditions, the system creates a performable correspondence space where a codified movement vocabulary can be used to explore a traditional instrument’s playing through an adaptive mapping. Fluid Body therefore contributes a concrete hybrid mapping design for embodied sonification in an intercultural context, demonstrating how machine learning can serve as a creative translator between different cultural artistic expressions.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Fluid Body: An Adaptive Embodied Sonification System for Cross-Cultural Performance

  • Yuting Xue,
  • Yueshen Wu

摘要

Fluid Body is an experimental, body-driven instrument with which participants can use a compact classical ballet arm-posture vocabulary to play a digital Guzheng. The system implements an interactive machine-learning mapping that combines a posture classifier to label each recognized posture, with a regression model for continuous control of granular sound synthesis parameters. Six ballet arm positions are associated with six edited Guzheng sound events, enabling participants to trigger distinct phrase regions through posture changes while continuously modulating the timbre in real time. We use intercultural co-adaptation in a dynamic, operational way. Rather than claiming literal translation between ballet and Guzheng traditions, the system creates a performable correspondence space where a codified movement vocabulary can be used to explore a traditional instrument’s playing through an adaptive mapping. Fluid Body therefore contributes a concrete hybrid mapping design for embodied sonification in an intercultural context, demonstrating how machine learning can serve as a creative translator between different cultural artistic expressions.