Digital stabilization method for old movies based on mobilesam and optical flow
摘要
Digital video stabilization is an essential component in the restoration of old movies. The jitter in old films is a complex type of mixed jitter, which includes: (1) Low-frequency motion jitter of the image content due to the immature image stabilization technology of the camera itself; (2) High-frequency inter-frame jitter caused by film aging and digitalization errors. Existing video stabilization methods primarily target the first type of jitter and are not effective in complex jitter scenes of old movies. Moreover, these methods may also result in blank spaces or offsets at frame boundaries. This paper proposes a full-frame video stabilization method for complex jitter scenes in old movies, utilizing a strategy that combines MobileSAM with contour difference detection to identify fixed areas in the background, thereby minimizing the impact of moving objects in the foreground on stabilization technology. Additionally, an adaptive motion compensation method is introduced to address the issue of frame boundary offsets. Experimental results demonstrate that this method is highly effective in dealing with complex mixed jitter in old movie scenes, significantly reducing image distortion and frame offsets, thus ensuring the integrity and artistic value of old movie videos.