FedCLF: Contrastive Learning-Driven Framework for Mitigating Data Heterogeneity in Federated Learning
摘要
In federated learning, data heterogeneity is a critical factor that constrains model performance. To overcome this challenge, we put forward a unique approach: FedCLF (Federated Contrastive Learning With Consensus Features). FedCLF integrates contrastive learning with federated learning based on consensus features, thus mitigating data heterogeneity through feature sharing and alignment mechanisms. Specifically, each client collaboratively trains a contrastive learning model and utilizes the trained encoder to extract features from local data, with a portion of these features being shared globally. During local model training, clients align the features extracted by their local models with those obtained in the previous stage to ensure model consistency and stability. Furthermore, after the model has been trained on their local datasets, clients employ the shared feature data to train the FC, thus further improving the model’s performance. It is shown by extensive experimental results that FedCLF significantly improves the accuracy and fairness of the model.