In the traditional power sector, offline data warehouses have problems such as insufficient real-time processing capabilities, low classification efficiency of common exception handling methods, and core issues. This study proposes a comprehensive solution based on the combination of anomaly detection algorithms and data warehouses. The specific work and contributions are as follows: The differences among various feature selection methods were discussed and regarded as a prerequisite step for the anomaly detection algorithm to improve the model training speed. Based on this, an improved isolated forest algorithm is proposed. This algorithm utilizes binary Particle Swarm Optimization (BPSO) technology to solve the high redundancy problem of the base classifier in the original isolated forest algorithm. Aiming at the problem of dynamic threshold setting for abnormal scores, a sliding window adaptive threshold determination method based on the K-Means ++ algorithm is proposed.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Research on Anomaly Data Detection Algorithm in Power Generation Field

  • Yong Xiang,
  • Hongyan Fan,
  • Jing Xiao,
  • Zhengyun Han

摘要

In the traditional power sector, offline data warehouses have problems such as insufficient real-time processing capabilities, low classification efficiency of common exception handling methods, and core issues. This study proposes a comprehensive solution based on the combination of anomaly detection algorithms and data warehouses. The specific work and contributions are as follows: The differences among various feature selection methods were discussed and regarded as a prerequisite step for the anomaly detection algorithm to improve the model training speed. Based on this, an improved isolated forest algorithm is proposed. This algorithm utilizes binary Particle Swarm Optimization (BPSO) technology to solve the high redundancy problem of the base classifier in the original isolated forest algorithm. Aiming at the problem of dynamic threshold setting for abnormal scores, a sliding window adaptive threshold determination method based on the K-Means ++ algorithm is proposed.