The digital transformation of the power industry generates vast technical documents requiring efficient text summarization. Existing methods face challenges in computational cost and hyperparameter optimization, as large language models demand substantial resources while relying on manual tuning. This paper proposes a parameter-efficient approach combining LoRA with particle swarm optimization for Chinese power-domain text summarization. Our method applies LoRA to BART’s key layers to reduce trainable parameters, while introducing PSO and QPSO algorithms for automated hyperparameter optimization. Experiments on the text summarization dataset show our approach outperforming full fine-tuning and manual tuning baselines. Furthermore, power-domain case studies validate the method’s practical applicability and domain adaptation capabilities.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

PSO-Optimized LoRA-Based BART for Text Summarization in Power Domain

  • Lei Sheng,
  • Zhiyuan An,
  • Chunying Wang,
  • Yizhan Quan,
  • Lijie Wu

摘要

The digital transformation of the power industry generates vast technical documents requiring efficient text summarization. Existing methods face challenges in computational cost and hyperparameter optimization, as large language models demand substantial resources while relying on manual tuning. This paper proposes a parameter-efficient approach combining LoRA with particle swarm optimization for Chinese power-domain text summarization. Our method applies LoRA to BART’s key layers to reduce trainable parameters, while introducing PSO and QPSO algorithms for automated hyperparameter optimization. Experiments on the text summarization dataset show our approach outperforming full fine-tuning and manual tuning baselines. Furthermore, power-domain case studies validate the method’s practical applicability and domain adaptation capabilities.