A Swin Transformer-Based Federated Learning Approach for Classification of Diabetic Retinopathy
摘要
Diabetic retinopathy (DR) is a diabetes complication that damages blood vessels in the retina, potentially leading to vision loss if left undiagnosed. Early detection via eye exams is crucial, but faster and automated analysis methods are essential in areas lacking expert ophthalmologists. However, limited patient data and privacy concerns prevent medical institutions from building robust models for automated DR diagnosis. Federated Learning (FL) addresses this by enabling collaborative training on decentralized datasets from multiple institutions without compromising patient privacy. This study investigates Swin Transformer-based FL frameworks for DR classification, using Federated Averaging and Federated Proximal as two aggregation strategies. To address data heterogeneity, we used three open-sourced datasets and established them as three participating clients in our framework. We have also created our private dataset of Bangladeshi patients by collecting data from Bangladesh Eye Hospital Ltd. (BEH), Bangladesh, and used it as a separate client for generalizability assessment of the trained server models. In our experiment, the FL aggregation strategies using the Transformer model are evaluated based on the performance of these frameworks in classifying the stages of DR using both the open-sourced and unseen patient data. Our Swin-FedAvg approach shows remarkable results compared to Swin-FedProx when evaluated on both the open-sourced datasets and the private BEH data. Furthermore, we present a comparison of the Swin Transformer-based frameworks with the existing frameworks based on these datasets and demonstrate the robustness of our proposed method.