<p>Fine-grained visual classification aims to distinguish subcategories with subtle visual differences under high inter-class similarity. While auxiliary textual semantics provide supplementary information, existing multimodal methods still face a limitation in balancing global semantic consistency and local discriminative details. To address this limitation, we propose a Dual-Branch Collaborative Fusion Network (DCFNet), comprising two synergistic branches designed to decouple feature learning across granularities. Specifically, we design a cross-modal consistency alignment branch to calibrate the global semantic space. Complementarily, we construct a cross-modal transformer fusion branch to achieve fine-grained local feature interaction. This dual-branch collaboration maintains high-level semantic consistency while accurately capturing fine-grained discriminative cues. Extensive experiments and ablation studies on the CUB-200-2011, Con-Text, and Drink Bottle datasets demonstrate that DCFNet achieves competitive performance, providing an innovative solution for fine-grained visual classification tasks.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

DCFNet: Dual-branch collaborative fusion network for fine-grained visual classification

  • Yang Qiao,
  • Min Zuo,
  • Zhiguo Yu,
  • Xiaofeng Gu

摘要

Fine-grained visual classification aims to distinguish subcategories with subtle visual differences under high inter-class similarity. While auxiliary textual semantics provide supplementary information, existing multimodal methods still face a limitation in balancing global semantic consistency and local discriminative details. To address this limitation, we propose a Dual-Branch Collaborative Fusion Network (DCFNet), comprising two synergistic branches designed to decouple feature learning across granularities. Specifically, we design a cross-modal consistency alignment branch to calibrate the global semantic space. Complementarily, we construct a cross-modal transformer fusion branch to achieve fine-grained local feature interaction. This dual-branch collaboration maintains high-level semantic consistency while accurately capturing fine-grained discriminative cues. Extensive experiments and ablation studies on the CUB-200-2011, Con-Text, and Drink Bottle datasets demonstrate that DCFNet achieves competitive performance, providing an innovative solution for fine-grained visual classification tasks.