Towards Interactive Video Segmentation by Dynamic and Iterative Spanning Forest
摘要
Interactive video segmentation aims to segment objects from videos using user information of object location. It allows for segmenting different objects from the same scene and has many applications, such as video editing and scene understanding. While in automatic video segmentation, the major challenges are temporal coherency and occlusion, interactive segmentation models must also handle unseen objects. This work proposes an interactive video segmentation strategy based on seed competition and user-drawn scribbles. Our proposal starts with a seed oversampling strategy and iteratively computes the optimum path forest for the seed set, maintaining the most relevant trees. Our Interactive Video Segmentation by Dynamic and Iterative Spanning Forest (iVSDISF) extends the Interactive Dynamic and Iterative Spanning Forest for videos, avoiding object leakage by dynamically creating trees at critical image positions. The proposed method is highly competitive with the state-of-the-art achieving the second highest score, in terms of IoU, considering all studied methods, and the best IoU among the ones without optical flow computation for SegTrackv2.