In real-world scenarios, referring video object segmentation (RVOS) remains constrained by the scarcity of annotated data, which impedes effective model training and severely limits generalization capabilities to unseen environments. To address these persistent challenges, we propose an innovative framework that integrates meta-learning with graph neural networks (GNNs) through seamless incorporation of Laplacian regularization for robust cross-set relational reasoning, coupled with a Bayesian neural networks(BNNs) segmentation head for theoretically grounded uncertainty quantification. The graph Laplacian term in our framework effectively imposes smoothness priors on feature maps, thereby preserving the inherent manifold structure of vision-language joint representations in RVOS tasks. This regularization significantly reduces noise sensitivity while mitigating overfitting in few-shot scenarios. Meanwhile, the pixel-level uncertainty estimates generated by the Bayesian segmentation head adaptively refine object boundaries and enhance reliability in semantically ambiguous regions. Although existing studies have explored few-shot learning in RVOS, our approach pioneers the synergistic integration of GNNs-based cross-set relational reasoning with Bayesian uncertainty modeling. Experiments on the Mini-Ref-YouTube-VOS and Mini-Ref-SAIL-VOS few-shot benchmarks demonstrate that our method consistently outperforms baseline models, achieving superior segmentation accuracy and robustness. By addressing data scarcity while enhancing interpretability through uncertainty visualization and structured reasoning, this framework significantly advances the practical application value of RVOS technology in real-world video understanding scenarios.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Graph Laplacian Regularized Referring Video Object Segmentation with Bayesian Neural Network Uncertainty Quantification

  • Yifan Liao,
  • Jiaqing Fan,
  • Fanzhang Li

摘要

In real-world scenarios, referring video object segmentation (RVOS) remains constrained by the scarcity of annotated data, which impedes effective model training and severely limits generalization capabilities to unseen environments. To address these persistent challenges, we propose an innovative framework that integrates meta-learning with graph neural networks (GNNs) through seamless incorporation of Laplacian regularization for robust cross-set relational reasoning, coupled with a Bayesian neural networks(BNNs) segmentation head for theoretically grounded uncertainty quantification. The graph Laplacian term in our framework effectively imposes smoothness priors on feature maps, thereby preserving the inherent manifold structure of vision-language joint representations in RVOS tasks. This regularization significantly reduces noise sensitivity while mitigating overfitting in few-shot scenarios. Meanwhile, the pixel-level uncertainty estimates generated by the Bayesian segmentation head adaptively refine object boundaries and enhance reliability in semantically ambiguous regions. Although existing studies have explored few-shot learning in RVOS, our approach pioneers the synergistic integration of GNNs-based cross-set relational reasoning with Bayesian uncertainty modeling. Experiments on the Mini-Ref-YouTube-VOS and Mini-Ref-SAIL-VOS few-shot benchmarks demonstrate that our method consistently outperforms baseline models, achieving superior segmentation accuracy and robustness. By addressing data scarcity while enhancing interpretability through uncertainty visualization and structured reasoning, this framework significantly advances the practical application value of RVOS technology in real-world video understanding scenarios.