Disentanglement-based compression and generative reconstruction of fixed-scene videos
摘要
Recently upgraded video capture devices have generated massive amounts of high-definition and ultrahigh-definition videos, leading to an escalating challenge in video storage and transmission. Correspondingly, the demand for new-generation video codecs has become increasingly urgent. This paper proposes a novel framework for the codec of fixed-scene videos. The framework decouples the background and foreground for separate processing and employs a generative adversarial network (GAN) model to reconstruct the foreground targets. The proposed method extracts features at the object level and utilize the disentangled features of these objects to achieve high-compression-ratio video encoding. The proposed decoder leverages conditional GANs to reconstruct the compressed features and integrate them with the background for video reconstruction. Experimental results show that the proposed framework and algorithm outperform other methods, particularly in terms of compression rates, while preserving high video reconstruction quality. Models and source code can be referenced at: https://github.com/icirelease/decoupled-video-compression-recon.