Video frame interpolation is a fundamental technique for generating slow-motion effects and performing video frame rate upconversion. Accurate motion estimation is critical for flow-based interpolation methods. However, existing approaches often yield inaccurate optical flow in complex scenarios involving illumination variations or occlusions. These inaccuracies propagate to the final interpolated frames, introducing artifacts. To address this limitation, we optimize initial optical flow estimations. Specifically, a multi-scale feature extraction module first extracts motion features to estimate preliminary optical flow. Subsequently, an optical flow optimization module encodes the flow, extracts latent spatiotemporal motion features, and integrates them with contextual spatiotemporal information. A dedicated network then generates the refined optical flow, resolving inherent inaccuracies. Experimental results demonstrate that our optimization enhances flow details, producing interpolated frames with sharper object boundaries and superior quality.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Video Frame Interpolation via Iterative Optical Flow Refinement with Latent Motion Feature

  • Zhiqiang Jiang,
  • Lin Liu,
  • Tianrui Liu,
  • Junjie Huang

摘要

Video frame interpolation is a fundamental technique for generating slow-motion effects and performing video frame rate upconversion. Accurate motion estimation is critical for flow-based interpolation methods. However, existing approaches often yield inaccurate optical flow in complex scenarios involving illumination variations or occlusions. These inaccuracies propagate to the final interpolated frames, introducing artifacts. To address this limitation, we optimize initial optical flow estimations. Specifically, a multi-scale feature extraction module first extracts motion features to estimate preliminary optical flow. Subsequently, an optical flow optimization module encodes the flow, extracts latent spatiotemporal motion features, and integrates them with contextual spatiotemporal information. A dedicated network then generates the refined optical flow, resolving inherent inaccuracies. Experimental results demonstrate that our optimization enhances flow details, producing interpolated frames with sharper object boundaries and superior quality.