<p>As renewable generation progressively displaces conventional generators, power flow through geographically constrained transmission corridors increasingly approaches or violates thermal and stability limits, exposing the grid to congestion-induced renewable curtailment and cascading-failure risks. Traditional real-time dispatch practices, which rely on precomputed look-up tables and operator heuristics, prove inadequate when faced with rapidly growing uncertainties arising from high penetrations of wind and photovoltaic generation. This paper presents a safe reinforcement learning (SRL)-driven coordinated control framework that simultaneously regulates embedded HVDC links and dispatchable generators to enhance the transfer capability of AC/DC hybrid transmission corridors. A perturbation-based sensitivity approach distills the generator fleet into a compact subset whose output variations most strongly affect the transmission corridor power flow, effectively compressing the decision dimensionality. The sequential decision task is formulated as a Markov Decision Process model, where SRL agents are trained to govern HVDC flow and generator redispatch, under a maximum-entropy actor-critic framework, yielding policies that are simultaneously exploratory, reward-seeking, and constraint-respecting. Extensive simulation experiments and commissioning on the Yangtze River-crossing transmission corridor confirm that the SRL agent’s policies elevate the mean aggregate transfer by 629&#xa0;MW and raise the delivery ceiling by 807&#xa0;MW, peaking at 2761&#xa0;MW in heavily stressed scenarios.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Intelligent power flow control of AC/DC hybrid transmission corridors using safe reinforcement learning agents

  • Haifeng Li,
  • Zhiwei Wang,
  • Tao Jin,
  • Lin Liu

摘要

As renewable generation progressively displaces conventional generators, power flow through geographically constrained transmission corridors increasingly approaches or violates thermal and stability limits, exposing the grid to congestion-induced renewable curtailment and cascading-failure risks. Traditional real-time dispatch practices, which rely on precomputed look-up tables and operator heuristics, prove inadequate when faced with rapidly growing uncertainties arising from high penetrations of wind and photovoltaic generation. This paper presents a safe reinforcement learning (SRL)-driven coordinated control framework that simultaneously regulates embedded HVDC links and dispatchable generators to enhance the transfer capability of AC/DC hybrid transmission corridors. A perturbation-based sensitivity approach distills the generator fleet into a compact subset whose output variations most strongly affect the transmission corridor power flow, effectively compressing the decision dimensionality. The sequential decision task is formulated as a Markov Decision Process model, where SRL agents are trained to govern HVDC flow and generator redispatch, under a maximum-entropy actor-critic framework, yielding policies that are simultaneously exploratory, reward-seeking, and constraint-respecting. Extensive simulation experiments and commissioning on the Yangtze River-crossing transmission corridor confirm that the SRL agent’s policies elevate the mean aggregate transfer by 629 MW and raise the delivery ceiling by 807 MW, peaking at 2761 MW in heavily stressed scenarios.