LDMME: Latent Diffusion Model for Music Editing
摘要
Diffusion models are widely used in the fields of image, audio, and speech generation. While diffusion models for image editing have been extensively studied, their application to music-editing tasks has been relatively neglected. The current research has several shortcomings: 1) lack of support for 44.1KHz stereo music, 2) generation of non-music content during editing, and 3) an editing algorithm that does not fully consider existing information, resulting in unnatural edits. To address these limitations, we propose the LDMME model. We first create a high-quality 44.1KHz sampling rate stereo audio dataset, which excluded non-music data, to train the LDMME. In addition, we enhance the quality of the generated music by strengthening the detailed modeling capability of LDMME. Subsequently, we improve the existing editing algorithm by considering the original music information during editing to enhance the naturalness of the edited music. In both music generation and editing tasks, the LDMME model outperforms AudioLDM and MusicLDM according to various subjective and objective metrics. The samples are available on this website: https://runchuanye.github.io/LDMME-Latent-Diffusion-Model-for-Music-Editing/ .