Conventional transfer learning approaches involve transferring knowledge from a rich source domain to improve the performance of the target classifier in a relatively scarcer target domain. However, the models developed in the target domain are relatively lightweight and struggle with overfitting and generalization issues; therefore, their usability is negatively affected in relatively scarcer and noisy environments in domains like remote sensing. In this work, we propose a novel nuclear norm-induced lightweight and robust teacher-student network to classify scenes in the remote sensing domain. Specifically, the student model of the proposed teacher-student network is regularized using a nuclear norm constraint to obtain low-ranked student model parameters that are robust to noise in the environment. The student model of the proposed teacher-student network is trained on different benchmarked remote sensing datasets to classify scenes and subsequently used for inference. With the UC Merced and EuroSAT datasets, the classifier’s performance reaches up to \(87.0 \%\) . Moreover, the proposed teacher-student network parameters are low-ranked and robust to noise in the deployed environments. Hence, the proposed lightweight and robust nuclear norm-induced teacher-student network can be deployed to classify scenes using remote-sensing images in noisy environments.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Nuclear Norm-Induced Lightweight and Robust Teacher-Student Network to Classify Hyper-Spectral Scenes

  • Upendra Pratap Singh,
  • Akshay Anand,
  • Akshat Maithani,
  • Patel Het Manojkumar

摘要

Conventional transfer learning approaches involve transferring knowledge from a rich source domain to improve the performance of the target classifier in a relatively scarcer target domain. However, the models developed in the target domain are relatively lightweight and struggle with overfitting and generalization issues; therefore, their usability is negatively affected in relatively scarcer and noisy environments in domains like remote sensing. In this work, we propose a novel nuclear norm-induced lightweight and robust teacher-student network to classify scenes in the remote sensing domain. Specifically, the student model of the proposed teacher-student network is regularized using a nuclear norm constraint to obtain low-ranked student model parameters that are robust to noise in the environment. The student model of the proposed teacher-student network is trained on different benchmarked remote sensing datasets to classify scenes and subsequently used for inference. With the UC Merced and EuroSAT datasets, the classifier’s performance reaches up to \(87.0 \%\) . Moreover, the proposed teacher-student network parameters are low-ranked and robust to noise in the deployed environments. Hence, the proposed lightweight and robust nuclear norm-induced teacher-student network can be deployed to classify scenes using remote-sensing images in noisy environments.