Scholarlink

<p>In the realm of Natural Language Processing (NLP), sentiment analysis plays a crucial role in deriving insights from vast amounts of user-generated text. However, deploying state-of-the-art transformer-based models in real-world applications poses two key challenges: preserving user data privacy and mitigating the computational overhead associated with large-scale models. This study introduces FedEnsemble, a novel federated learning framework that addresses these challenges through three core innovations: (i) a heterogeneous ensemble of BERT, RoBERTa, and DistilBERT to enhance classification robustness; (ii) an entropy-based attention stacking mechanism that adaptively fuses model outputs according to predictive confidence; and (iii) Quantization-Aware Training (QAT) to compress models while maintaining high accuracy and communication efficiency. Extensive experiments on multiple benchmark datasets—including IMDB, Amazon Reviews, AG News, Sentiment140, and ISOT Fake News—demonstrate the effectiveness and generalizability of the proposed model. FedEnsemble consistently outperforms baseline meta-learners, achieving up to 98.10% accuracy on the IMDB dataset while delivering competitive results across diverse and noisy data distributions. Furthermore, applying 4-bit QAT reduced model size by 86.90% and inference time by 48.69%, with only a 1.80% decrease in accuracy. Experiments under non-IID conditions with skewed label distributions further confirmed the robustness of the model, maintaining accuracy above 95%. Statistical significance tests (t-test, <i>p</i> &lt; 0.05) validated the reliability of these improvements.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

FedEnsemble: federated learning model for efficient sentiment analysis

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年12月26日

查看全文
  • Hesham Ayman,
  • Shaimaa Haridy,
  • Yasmine M. Afify,
  • Walaa Gad

摘要

In the realm of Natural Language Processing (NLP), sentiment analysis plays a crucial role in deriving insights from vast amounts of user-generated text. However, deploying state-of-the-art transformer-based models in real-world applications poses two key challenges: preserving user data privacy and mitigating the computational overhead associated with large-scale models. This study introduces FedEnsemble, a novel federated learning framework that addresses these challenges through three core innovations: (i) a heterogeneous ensemble of BERT, RoBERTa, and DistilBERT to enhance classification robustness; (ii) an entropy-based attention stacking mechanism that adaptively fuses model outputs according to predictive confidence; and (iii) Quantization-Aware Training (QAT) to compress models while maintaining high accuracy and communication efficiency. Extensive experiments on multiple benchmark datasets—including IMDB, Amazon Reviews, AG News, Sentiment140, and ISOT Fake News—demonstrate the effectiveness and generalizability of the proposed model. FedEnsemble consistently outperforms baseline meta-learners, achieving up to 98.10% accuracy on the IMDB dataset while delivering competitive results across diverse and noisy data distributions. Furthermore, applying 4-bit QAT reduced model size by 86.90% and inference time by 48.69%, with only a 1.80% decrease in accuracy. Experiments under non-IID conditions with skewed label distributions further confirmed the robustness of the model, maintaining accuracy above 95%. Statistical significance tests (t-test, p < 0.05) validated the reliability of these improvements.