Existing vision-based maritime target recognition methods suffer significant performance degradation under conditions of low-resolution cameras or occlusion. The navigational data in AIS signals can provide supplementary information to alleviate this issue. However, constructing a robust maritime target recognition model using multimodal sensor data remains a challenge due to the differences between modalities. This paper proposes a dual-stream heterogeneous collaborative learning method based on DeepSeek, which guides maritime target recognition by extracting information from visual sensors. It also improves model robustness by utilizing feature distillation to reduce the impact of noise. To achieve model lightweighting, knowledge from DeepSeek is transferred to a student network, significantly reducing the model’s parameter size and computational complexity while maintaining performance. The F1 score and accuracy on a self-constructed maritime multimodal dataset demonstrate the superior performance of the DeepSeaNet method compared to existing state-of-the-art maritime target recognition methods.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

DeepSeekVision: Dual-Stream Compressed Architecture for Marine Object Identification with Visual Feature Distillation

  • Yongqi Li,
  • Zhengwei Xu,
  • Peiji Huang,
  • Jianliang He,
  • Shuman Huang

摘要

Existing vision-based maritime target recognition methods suffer significant performance degradation under conditions of low-resolution cameras or occlusion. The navigational data in AIS signals can provide supplementary information to alleviate this issue. However, constructing a robust maritime target recognition model using multimodal sensor data remains a challenge due to the differences between modalities. This paper proposes a dual-stream heterogeneous collaborative learning method based on DeepSeek, which guides maritime target recognition by extracting information from visual sensors. It also improves model robustness by utilizing feature distillation to reduce the impact of noise. To achieve model lightweighting, knowledge from DeepSeek is transferred to a student network, significantly reducing the model’s parameter size and computational complexity while maintaining performance. The F1 score and accuracy on a self-constructed maritime multimodal dataset demonstrate the superior performance of the DeepSeaNet method compared to existing state-of-the-art maritime target recognition methods.