Hyperspectral image super-resolution (HSI-SR) aims to reconstruct high-resolution (HR) images from their low-resolution (LR) counterparts while preserving spectral integrity. Existing knowledge distillation (KD) methods predominantly transfer knowledge from a single super-resolution network, which limits the student model's ability to learn multi-stage hierarchical features. To overcome this limitation, we propose an asymmetric dual-teacher KD framework where two specialized teachers guide the student network: The super-resolution teacher network provides the knowledge of feature extraction, and the reconstruction teacher network provides the knowledge of feature reconstruction. Furthermore, we designed a Dual Aggregation Transformer U-net (DATU-Net) that is applicable to this framework and to hyperspectral super-resolution. The loss function designed enables the student network to focus on the knowledge of the two teacher networks, we verified the proposed network on two datasets and proved that our knowledge distillation framework is superior to the latest methods. The effectiveness of this framework was proved through ablation experiments.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Asymmetric Dual-Teacher Guided Knowledge Distillation for HSI-SR with Reconstructed Features

  • Ziqi Zhang,
  • Jianjun Liu

摘要

Hyperspectral image super-resolution (HSI-SR) aims to reconstruct high-resolution (HR) images from their low-resolution (LR) counterparts while preserving spectral integrity. Existing knowledge distillation (KD) methods predominantly transfer knowledge from a single super-resolution network, which limits the student model's ability to learn multi-stage hierarchical features. To overcome this limitation, we propose an asymmetric dual-teacher KD framework where two specialized teachers guide the student network: The super-resolution teacher network provides the knowledge of feature extraction, and the reconstruction teacher network provides the knowledge of feature reconstruction. Furthermore, we designed a Dual Aggregation Transformer U-net (DATU-Net) that is applicable to this framework and to hyperspectral super-resolution. The loss function designed enables the student network to focus on the knowledge of the two teacher networks, we verified the proposed network on two datasets and proved that our knowledge distillation framework is superior to the latest methods. The effectiveness of this framework was proved through ablation experiments.