This work addresses the challenge of deploying computationally intensive Deep Learning (DL) models for Diabetic Retinopathy (DR) lesion detection in clinical settings, particularly on resource-constrained edge devices. DR is a significant global health issue and a leading cause of preventable blindness, making early and accessible detection crucial. We propose a proof-of-concept system utilizing Knowledge Distillation (KD) to create a tiny, efficient DL model for DR lesion detection, specifically designed for embedding into retinal scanners via the NVIDIA Jetson Nano platform. Our novel approach employs a KD framework where a pre-trained Inception-v3 model acts as the ‘teacher,’ fine-tuned on fundus image data. This teacher model distills its knowledge into a compact ‘student’ model based on the MobileNet-v2 architecture, which is trained on a small, synthetically generated dataset optimized through an iterative distillation process using a custom loss function combining Kullback-Leibler divergence and Categorical Cross-Entropy. This method significantly reduces model size and computational requirements while maintaining high diagnostic accuracy, comparable to larger, state-of-the-art models. By enabling real-time, on-device analysis, this embedded AI solution enhances data privacy, ensures consistent performance, and improves the accessibility of advanced DR screening, particularly in remote or underserved healthcare environments. This makes AI-assisted DR detection feasible for widespread clinical adoption directly within scanning devices.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Edge-Enhanced Knowledge Distillation System for Diabetic Retinopathy Lesions Computer-Aided Diagnosis

  • Alberto Lopez-Figueroa,
  • Sebastian Jacome-Herrera,
  • Ernesto Moya-Albor,
  • Diego Renza,
  • Jorge Brieva

摘要

This work addresses the challenge of deploying computationally intensive Deep Learning (DL) models for Diabetic Retinopathy (DR) lesion detection in clinical settings, particularly on resource-constrained edge devices. DR is a significant global health issue and a leading cause of preventable blindness, making early and accessible detection crucial. We propose a proof-of-concept system utilizing Knowledge Distillation (KD) to create a tiny, efficient DL model for DR lesion detection, specifically designed for embedding into retinal scanners via the NVIDIA Jetson Nano platform. Our novel approach employs a KD framework where a pre-trained Inception-v3 model acts as the ‘teacher,’ fine-tuned on fundus image data. This teacher model distills its knowledge into a compact ‘student’ model based on the MobileNet-v2 architecture, which is trained on a small, synthetically generated dataset optimized through an iterative distillation process using a custom loss function combining Kullback-Leibler divergence and Categorical Cross-Entropy. This method significantly reduces model size and computational requirements while maintaining high diagnostic accuracy, comparable to larger, state-of-the-art models. By enabling real-time, on-device analysis, this embedded AI solution enhances data privacy, ensures consistent performance, and improves the accessibility of advanced DR screening, particularly in remote or underserved healthcare environments. This makes AI-assisted DR detection feasible for widespread clinical adoption directly within scanning devices.