<p>Clustered federated learning (CFL) addresses data heterogeneity in federated learning by grouping clients with similar data distributions into independent clusters, thus overcoming the limitations of a single global model that cannot meet the personalized needs of all devices. However, existing clustering methods face challenges due to the unknown number of clusters, which may not truly reflect the data distribution. Besides, most clustering methods focus on enabling collaboration among clients within the same cluster, without considering cooperation between similar clusters, which limits the scope of knowledge dissemination. To address these issues, we propose a fine-grained clustering framework (FGCFL) that introduces a benchmark distribution and refines cluster divisions by aggregating clients located between similar distribution clusters. Based on the refined clusters, self-attention is employed to facilitate collaboration among them, promoting inductive knowledge transfer between similar clusters. Experimental results on several datasets show that our proposed method considerably increases model performance under heterogeneity scenarios.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Fgcfl: a fine-grained clustering framework for federated learning with heterogeneity data

  • Ying Wang,
  • Jiuyun Xu,
  • Qianxi Yuan,
  • Yulong Bai,
  • Yuhang Yang,
  • Xiangrui Xu,
  • Hina Batool

摘要

Clustered federated learning (CFL) addresses data heterogeneity in federated learning by grouping clients with similar data distributions into independent clusters, thus overcoming the limitations of a single global model that cannot meet the personalized needs of all devices. However, existing clustering methods face challenges due to the unknown number of clusters, which may not truly reflect the data distribution. Besides, most clustering methods focus on enabling collaboration among clients within the same cluster, without considering cooperation between similar clusters, which limits the scope of knowledge dissemination. To address these issues, we propose a fine-grained clustering framework (FGCFL) that introduces a benchmark distribution and refines cluster divisions by aggregating clients located between similar distribution clusters. Based on the refined clusters, self-attention is employed to facilitate collaboration among them, promoting inductive knowledge transfer between similar clusters. Experimental results on several datasets show that our proposed method considerably increases model performance under heterogeneity scenarios.