With the increasing demand for data privacy and security, Federated Learning (FL) has emerged as a critical distributed machine learning paradigm, safeguarding user privacy by exchanging model parameters between clients and servers rather than raw data. However, existing FL methods face two significant challenges when handling non-independent and identically distributed (Non-IID) data: poor model aggregation across users with varying data distributions and a lack of personalization in locally trained models. To address these issues, we propose a federated meta-learning method based on client gradient clustering and aggregation (GCA-FML), which enhances both model aggregation and personalization. In GCA-FML, clients are grouped according to the similarity of their gradients, thereby reducing interference among users with different data distributions through gradient clustering. Additionally, we employ attention mechanisms to dynamically adjust users’ meta learning rates, facilitating more personalized local models. Our experiments across multiple datasets demonstrate that GCA-FML outperforms other state-of-the-art methods in terms of accuracy and personalization. Notably, in Non-IID environments, GCA-FML significantly improves model convergence speed and personalization performance.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Personalized Federated Meta-Learning Based on Gradient Clustering and Aggregation

  • Jiale Chen,
  • Xiaoli Zhao,
  • Hao Pan

摘要

With the increasing demand for data privacy and security, Federated Learning (FL) has emerged as a critical distributed machine learning paradigm, safeguarding user privacy by exchanging model parameters between clients and servers rather than raw data. However, existing FL methods face two significant challenges when handling non-independent and identically distributed (Non-IID) data: poor model aggregation across users with varying data distributions and a lack of personalization in locally trained models. To address these issues, we propose a federated meta-learning method based on client gradient clustering and aggregation (GCA-FML), which enhances both model aggregation and personalization. In GCA-FML, clients are grouped according to the similarity of their gradients, thereby reducing interference among users with different data distributions through gradient clustering. Additionally, we employ attention mechanisms to dynamically adjust users’ meta learning rates, facilitating more personalized local models. Our experiments across multiple datasets demonstrate that GCA-FML outperforms other state-of-the-art methods in terms of accuracy and personalization. Notably, in Non-IID environments, GCA-FML significantly improves model convergence speed and personalization performance.