We present the use of electromyography (EMG) for sensing musical gesture and discuss interactive machine learning for designing complex muscle-music interactions. We propose a signal flow for musical interaction with body movement sensed by EMG and other sensing modalities, feature extraction, and interactive machine learning that result in the manipulation of sound synthesis parameters. We discuss ways to capture the EMG for musical use including electrode placement and the use of multiple EMG channels. Techniques for extracting meaningful data and features from electromyographic signals are discussed. We present a composite feature, a multichannel EMG vector sum. Signal processing and machine learning are demonstrated. We frame classification and regression as cases of recognising and mapping. We finish by providing a series of resources for musicians wishing to work with the techniques presented here. These tools are free and open source and can be implemented easily in new applications, projects, or products.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Interactive Machine Learning: Strategies for Live Performance Using Electromyography

  • Michael Zbyszyński,
  • Atau Tanaka,
  • Federico Visi

摘要

We present the use of electromyography (EMG) for sensing musical gesture and discuss interactive machine learning for designing complex muscle-music interactions. We propose a signal flow for musical interaction with body movement sensed by EMG and other sensing modalities, feature extraction, and interactive machine learning that result in the manipulation of sound synthesis parameters. We discuss ways to capture the EMG for musical use including electrode placement and the use of multiple EMG channels. Techniques for extracting meaningful data and features from electromyographic signals are discussed. We present a composite feature, a multichannel EMG vector sum. Signal processing and machine learning are demonstrated. We frame classification and regression as cases of recognising and mapping. We finish by providing a series of resources for musicians wishing to work with the techniques presented here. These tools are free and open source and can be implemented easily in new applications, projects, or products.