Voice Localization in Cinematic Virtual Reality
摘要
Sound localization refers to the ability of the human brain to identify the direction of the sound source in three dimensions (Grothe et al. in Physiol Rev 90:983–1012, 2010). In screen-based cinema, the sound localization conventions are based on a two-dimensional screen and its fixed relationship with the audience. In Cinematic Virtual Reality (Cine-VR), the user can look around and navigate in a 360° video. Therefore, Sound Localization conventions are essential for crafting an immersive and emotionally engaging experience and should be thoroughly reviewed. Within all sound elements, voice plays a significant role in conveying information and creating emotion in cinema. Therefore, voice localization (VoLo) is even more critical for user engagement, emotional immersion, and fostering empathy with on-screen characters in Cine-VR. Even though scholars acknowledge the importance of sound design in virtual reality (VR), the research focused on voice localization in Cine-VR remains sparse. A critical review and analysis of current VoLo techniques and conventions was carried out through five Cine-VR films. The findings of the study underline the challenges and possibilities of voice localization ( VoLo) and the need for further research. The finding offers valuable insights to practitioners and scholars interested in leveraging sound localization to enhance the cinematic virtual reality experience.