Scholarlink

<p>This paper proposes a hybrid framework that combines a Transformer-based multi-output forecasting model with a proximal policy optimization (PPO) agent for intelligent energy management in renewable-based microgrids. The Transformer forecaster captures long-range temporal dependencies in load, photovoltaic (PV), wind generation, and electricity price time series, providing 24-h-ahead predictions that serve as state inputs to the control layer. The PPO agent then learns an adaptive energy management policy that jointly optimizes three conflicting objectives: maximizing economic profit, minimizing carbon emissions associated with grid electricity, and reducing dependency on external power imports. A weighted multi-objective reward function with tunable coefficients <InlineEquation ID="IEq1"><EquationSource Format="TEX">\(\:\alpha\:,\beta\:,\gamma\:\)</EquationSource></InlineEquation> is designed to flexibly adjust the trade-offs among these goals according to different operational priorities and regulatory contexts. In addition, a quantitative sensitivity analysis is conducted on both the reward weights and the Transformer input window length to investigate their impact on forecasting accuracy, policy stability, and overall microgrid performance. Simulation results on a renewable-rich microgrid scenario show that, under a representative configuration with <InlineEquation ID="IEq2"><EquationSource Format="TEX">\(\:\alpha\:=1.0\)</EquationSource></InlineEquation>, <InlineEquation ID="IEq3"><EquationSource Format="TEX">\(\:\beta\:=0.3\)</EquationSource></InlineEquation>, and <InlineEquation ID="IEq4"><EquationSource Format="TEX">\(\:\gamma\:=0.3\)</EquationSource></InlineEquation>, the proposed framework increases operational profit, significantly reduces CO₂ emissions, and lowers grid dependence compared with baseline methods. These findings demonstrate that integrating advanced sequence modeling with reinforcement learning provides a flexible and scalable solution for sustainable, data-driven microgrid operation under uncertainty.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

A hybrid transformer-PPO framework for multi-objective energy management in renewable-based microgrids

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年5月29日

查看全文
  • Yeganeh Sadeghpour,
  • Ehsan Azad Farsani,
  • Hamid Reza Abdolmohammadi,
  • Iman Goroohi Sardou

摘要

This paper proposes a hybrid framework that combines a Transformer-based multi-output forecasting model with a proximal policy optimization (PPO) agent for intelligent energy management in renewable-based microgrids. The Transformer forecaster captures long-range temporal dependencies in load, photovoltaic (PV), wind generation, and electricity price time series, providing 24-h-ahead predictions that serve as state inputs to the control layer. The PPO agent then learns an adaptive energy management policy that jointly optimizes three conflicting objectives: maximizing economic profit, minimizing carbon emissions associated with grid electricity, and reducing dependency on external power imports. A weighted multi-objective reward function with tunable coefficients \(\:\alpha\:,\beta\:,\gamma\:\) is designed to flexibly adjust the trade-offs among these goals according to different operational priorities and regulatory contexts. In addition, a quantitative sensitivity analysis is conducted on both the reward weights and the Transformer input window length to investigate their impact on forecasting accuracy, policy stability, and overall microgrid performance. Simulation results on a renewable-rich microgrid scenario show that, under a representative configuration with \(\:\alpha\:=1.0\), \(\:\beta\:=0.3\), and \(\:\gamma\:=0.3\), the proposed framework increases operational profit, significantly reduces CO₂ emissions, and lowers grid dependence compared with baseline methods. These findings demonstrate that integrating advanced sequence modeling with reinforcement learning provides a flexible and scalable solution for sustainable, data-driven microgrid operation under uncertainty.