Scholarlink

<p>Federated test-time adaptation (FTTA) aims to adapt knowledge from diverse source models to different but related unlabeled target data in an online and privacy-aware manner. However, existing FTTA methods struggle with decreased adaptation performance caused by data distribution shifts among clients. In this paper, we propose an FTTA method (ALAA-TTEA) called <b>a</b>daptive <b>l</b>ocal <b>a</b>ggregation <b>a</b>verage and <b>t</b>est-<b>t</b>ime <b>e</b>nergy <b>a</b>daptation. The method consists of two continuous stages. First, in the federated aggregation stage, clients adaptively aggregate the global model and local model through adaptive local aggregation (ALA) to initialize the client model. Then, they obtain the global model through personalized training and model averaging. Second, in the test-time adaptation stage, test-time energy adaptation (TTEA) uses an energy function to transform the global model into an energy-based model. It aligns the model distribution with the test data distribution, thereby enhancing the model’s ability to adapt to the test distribution and improving overall performance. Extensive experiments demonstrate that ALAA-TTEA effectively handles data distribution shifts, including feature shift, label shift, hybrid shift, and domain shift. Moreover, it consistently outperforms existing FTTA methods under most conditions.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Combining adaptive local aggregation average and test-time energy adaptation for federated learning

  • 期刊论文

  • 发表日期：

    2025年3月1日

查看全文
  • Juxin Liao,
  • Chang’an Yi,
  • Kai Chen,
  • Qiaoyi Peng

摘要

Federated test-time adaptation (FTTA) aims to adapt knowledge from diverse source models to different but related unlabeled target data in an online and privacy-aware manner. However, existing FTTA methods struggle with decreased adaptation performance caused by data distribution shifts among clients. In this paper, we propose an FTTA method (ALAA-TTEA) called adaptive local aggregation average and test-time energy adaptation. The method consists of two continuous stages. First, in the federated aggregation stage, clients adaptively aggregate the global model and local model through adaptive local aggregation (ALA) to initialize the client model. Then, they obtain the global model through personalized training and model averaging. Second, in the test-time adaptation stage, test-time energy adaptation (TTEA) uses an energy function to transform the global model into an energy-based model. It aligns the model distribution with the test data distribution, thereby enhancing the model’s ability to adapt to the test distribution and improving overall performance. Extensive experiments demonstrate that ALAA-TTEA effectively handles data distribution shifts, including feature shift, label shift, hybrid shift, and domain shift. Moreover, it consistently outperforms existing FTTA methods under most conditions.