Unsupervised video object segmentation with mask transformer: boosting accuracy and efficiency through feature fusion
摘要
This paper introduces a novel Mask Transformer framework for unsupervised video object segmentation, focusing on enhancing segmentation accuracy and efficiency. Our approach leverages the power of transformers to capture long-range dependencies and spatial context, enabling precise segmentation of objects in videos without requiring manual annotations during training. By fusing appearance and motion features through a unique combination of pixel-level feature representation and object-level query processing, our model achieves state-of-the-art performance on benchmark datasets while maintaining a substantial training speed improvement. The proposed framework offers a significant step forward in the field, demonstrating the effectiveness of mask classification for UVOS tasks. We open-source our code and datasets to facilitate reproducibility and encourage further research in this area at https://github.com/Qudk23/MaskVOS?tab=readme-ov-file.