FedHetero: improving federated learning on heterogeneous data distribution through deep reinforcement learning
摘要
The proliferation of federated learning (FL), driven by the integration of data silos, enables collaborative model training without sharing confidential data. However, the Non-IID data distribution and uncertain contributions from different participants, particularly free-riders with low-quality datasets, tend to complicate federated aggregation. In this paper, we propose FedHetero, a novel FL framework guided by automated data source ranking to mitigate the impact of Non-IID settings on model accuracy and adaptively adjust the weights in the aggregation. We use deep reinforcement learning (DRL) to identify the most suitable contributions of different participants and update the weights in the federated aggregation. FedHetero is applicable in both centralized and decentralized federated learning settings. Experiments show that FedHetero achieves better efficiency and accuracy.