Federated Learning (FL) is a collaborative machine learning framework that enables model training using private client data while ensuring privacy protection. Differential Privacy (DP) further strengthens this safeguard, preventing privacy leaks during training. Most existing FL methods that incorporate DP adopt a static privacy budget strategy. However, this approach lacks flexibility and reduces model performance and efficiency. Some researchers have introduced methods for dynamically adjusting privacy budgets. However, these methods often perform poorly in non-independent and identically distributed (NON-IID) scenarios due to insufficient consideration of data imbalance and client performance differences. To address these challenges, this paper proposes a Federated Learning with Dynamic Personalized Differential Privacy algorithm, FL(DP) \(^2\) First, Rényi entropy is utilized to initialize personalized privacy budgets. Second, the privacy budgets are dynamically adjusted using a reward factor. Finally, personalized maximum and minimum privacy budget limits are set based on a chi-squared distribution to maintain consistency with the initial client measurements. Extensive experimental evaluations on real-world NON-IID datasets confirm that FL(DP) \(^2\) performs satisfactorily.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

FL(DP) \(^2\) : Federated Learning with Dynamic Personalized Differential Privacy

  • Cuiyun Shi,
  • Jingyu Wang,
  • Lixin Liu,
  • Chang Xin,
  • Yini Pu

摘要

Federated Learning (FL) is a collaborative machine learning framework that enables model training using private client data while ensuring privacy protection. Differential Privacy (DP) further strengthens this safeguard, preventing privacy leaks during training. Most existing FL methods that incorporate DP adopt a static privacy budget strategy. However, this approach lacks flexibility and reduces model performance and efficiency. Some researchers have introduced methods for dynamically adjusting privacy budgets. However, these methods often perform poorly in non-independent and identically distributed (NON-IID) scenarios due to insufficient consideration of data imbalance and client performance differences. To address these challenges, this paper proposes a Federated Learning with Dynamic Personalized Differential Privacy algorithm, FL(DP) \(^2\) First, Rényi entropy is utilized to initialize personalized privacy budgets. Second, the privacy budgets are dynamically adjusted using a reward factor. Finally, personalized maximum and minimum privacy budget limits are set based on a chi-squared distribution to maintain consistency with the initial client measurements. Extensive experimental evaluations on real-world NON-IID datasets confirm that FL(DP) \(^2\) performs satisfactorily.