This paper delves into the intersection of artificial intelligence (AI) and sound effect production, a critical yet challenging aspect of film and video creation. Sound effects, ranging from natural ambiance to synthetic and Foley-generated noises, are vital for realism and narrative immersion. Despite the potential of AI and digital signal processing (DSP) to enhance efficiency and creativity in sound design, a significant gap exists between traditional sound makers and AI experts. This survey introduces a new framework to bridge this gap, promoting mutual understanding and providing sound makers with AI tools tailored to their needs. It provides a structured review of the latest methodologies in intelligent sound production, encompassing sound effect retrieval, recovery, and generation, with a particular focus on semantic consistency. In conclusion, the survey synthesizes the current landscape of AI in sound production, presenting a clear path for future innovation and research.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Intelligent Sound Effect Production: A Review

  • Kunyan Li,
  • Chen Zuo,
  • Yiyang Teng,
  • Shuxuan Yu,
  • Jiaxin Wei,
  • Ruitao Ma,
  • Menghe Lu,
  • Lexi Xu,
  • Yue Wang,
  • Tianyi Liu,
  • Xiaojie Wang,
  • Jinwu Wei

摘要

This paper delves into the intersection of artificial intelligence (AI) and sound effect production, a critical yet challenging aspect of film and video creation. Sound effects, ranging from natural ambiance to synthetic and Foley-generated noises, are vital for realism and narrative immersion. Despite the potential of AI and digital signal processing (DSP) to enhance efficiency and creativity in sound design, a significant gap exists between traditional sound makers and AI experts. This survey introduces a new framework to bridge this gap, promoting mutual understanding and providing sound makers with AI tools tailored to their needs. It provides a structured review of the latest methodologies in intelligent sound production, encompassing sound effect retrieval, recovery, and generation, with a particular focus on semantic consistency. In conclusion, the survey synthesizes the current landscape of AI in sound production, presenting a clear path for future innovation and research.