Scholarlink

This study presents a cross-cultural implementation of an artistic Brain–Computer Interface (BCI) and generative artificial intelligence (GenAI) system designed for live performance within the Balinese gamelan tradition. The BCI-GenAI system enables real-time translation of neural synchrony between dyads of performers (musician-musician, dancer-dancer, musician-dancer) into the control of culturally-relevant generative visual projections that interact with performers and audience alike. Nine Balinese artists (six musicians and three dancers) participated in a two-part performance Janaki Dewi: Sita’s Reverie and Wiwada Manik: Tales of the Brothers. Dyads of artists wore Mobile Brain-Body Imaging (MoBI) technology to capture in real time their brain (electroencephalography, EEG) and ocular (electrooculography, EOG) activities, head motion, and video during rehearsals and a public performance over a period of 3 weeks. All signals were synchronized by hardware. A Brain-Computer Interface (BCI) preprocessed the MoBI Signals and computed the inter-brain synchrony between dyads. Synchrony indices derived from EEG bispectra modulated diffusion parameters in a StreamDiffusion-based GenAI, whereas text prompts consisting of culturally-relevant narrative and emotional descriptors reflected the story’s mythological and affective dimensions. Thus, the BCI-GenAI system linked the real-time inter-brain synchronization to dynamic imagery projected live on stage. The system thus functioned as a creative partner in-the-loop, responsive to both the emotional and rhythmic structure of performance. The multi-institutional, cross-cultural project contributes a methodological framework for BCI-GenAI in artistic settings, emphasizing cross-cultural collaboration, the symbiosis between cultural traditions and emergent technologies, and ethical data governance. It advances a model of responsible human–AI co-creation, where technology supports rather than displaces tradition thereby preserving the continuity of cultural identity through innovation, team science and transdisciplinarity.

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

An Artistic BCI–GenAI System Enabling Real-Time Co-creation in Balinese Performance

  • 会议论文

  • 发表日期：

    2026年

查看全文
  • Aime J. Aguilar-Herrera,
  • Carlos O. Hernández-Aguado,
  • Joel A. Monarres-Sokolovskaya,
  • Maxine Annel Pacheco-Ramírez,
  • Badie Khaleghian,
  • Elena Grassi,
  • Made Ayu Desiari,
  • I Gde Made Indra Sadguna,
  • Cokorda Bagus Jaya Lesmana,
  • Anthony Brandt,
  • Jose L. Contreras Vidal

摘要

This study presents a cross-cultural implementation of an artistic Brain–Computer Interface (BCI) and generative artificial intelligence (GenAI) system designed for live performance within the Balinese gamelan tradition. The BCI-GenAI system enables real-time translation of neural synchrony between dyads of performers (musician-musician, dancer-dancer, musician-dancer) into the control of culturally-relevant generative visual projections that interact with performers and audience alike. Nine Balinese artists (six musicians and three dancers) participated in a two-part performance Janaki Dewi: Sita’s Reverie and Wiwada Manik: Tales of the Brothers. Dyads of artists wore Mobile Brain-Body Imaging (MoBI) technology to capture in real time their brain (electroencephalography, EEG) and ocular (electrooculography, EOG) activities, head motion, and video during rehearsals and a public performance over a period of 3 weeks. All signals were synchronized by hardware. A Brain-Computer Interface (BCI) preprocessed the MoBI Signals and computed the inter-brain synchrony between dyads. Synchrony indices derived from EEG bispectra modulated diffusion parameters in a StreamDiffusion-based GenAI, whereas text prompts consisting of culturally-relevant narrative and emotional descriptors reflected the story’s mythological and affective dimensions. Thus, the BCI-GenAI system linked the real-time inter-brain synchronization to dynamic imagery projected live on stage. The system thus functioned as a creative partner in-the-loop, responsive to both the emotional and rhythmic structure of performance. The multi-institutional, cross-cultural project contributes a methodological framework for BCI-GenAI in artistic settings, emphasizing cross-cultural collaboration, the symbiosis between cultural traditions and emergent technologies, and ethical data governance. It advances a model of responsible human–AI co-creation, where technology supports rather than displaces tradition thereby preserving the continuity of cultural identity through innovation, team science and transdisciplinarity.