Spatially Situated Media and Spatial Sampler XR–Genealogy and Organology of a Family of Gestural and Spatial Musical Instruments in Mixed Reality
摘要
Spatial Sampler XR is a new musical instrument linking gesture capture to sound production. In the same way that a sampler is an empty keyboard filled with sounds, Spatial Sampler XR uses gesture capture to transform the surrounding physical space into an area of keys for, recording, indexing and playing back samples. Spatial Sampler XR let the musician arrange the sound around him or her through gesture, creating a spatialized and interactive soundstage. A virtual reality headset adds to the instrument the ability to visualize the layout of sounds. The 3D immersion greatly facilitates their organization and increases the precision of the interaction. Several modes of play are possible and the interaction modalities vary according to the type of performance and the number of performers. This article first introduces the Synekine project, a 10-year research project from which the concept of spatial sampling is derived. It presents the technical devices used, the instruments created, the different modes of play in performative situations. The instrument relies on movement to link time and space. Thus, the Spatial Sampler XR is particularly suitable for movement artists as well as for extra-musical applications.