A Reinforcement Learning Framework for Optimizing Predictive Maintenance of Photovoltaic Systems
摘要
Photovoltaic (PV) systems are essential to sustainable energy, but maintaining long-term efficiency requires data-efficient tools for predictive maintenance—especially when historical data is scarce. We propose a reinforcement learning (RL) framework combining digital twin simulations with a power loss regression model to estimate degradation from environmental inputs. The agent learns maintenance policies by maximizing an interpretable, economically grounded reward based on the net value of the PV system. We train our agent using three different RL algorithms (PPO, Maskable PPO, and Recurrent PPO) on observed and clear-sky irradiance data from real PV systems. All strategies outperform the no-maintenance baseline, with RPPO improving the net value by up to 37%, showing that effective, generalizable policies can be learned even under data constraints.