Operational data management and analysis system based on the IQR-isolation forest algorithm and DeepSeek model for SHINE
摘要
Shanghai HIgh repetition rate XFEL aNd Extreme light facility (SHINE) is the first hard X-ray free-electron laser facility in China. As the volume of process variables (PVs) stored in the Archiver Appliance (AA) increases, managing this data presents challenges for web-based tools. To address these issues, a data management and analysis system was developed to streamline PV management operations through user-friendly interfaces and a backend dashboard.
MethodsThe system was built using the Django framework for data processing. It incorporates several advanced features, including customized logging and integration with the DeepSeek model, which facilitates rapid fault localization, root cause analysis, and optimization recommendations. Additionally, abnormal user operations are detected through a combination of the Isolation Forest algorithm and the Interquartile Range (IQR) anomaly detection method. User interfaces and a monitoring dashboard were created using HTML and Grafana.
ResultsDuring performance tests, the system handled 328.99 transactions per second with 100 concurrent requests. The F1-scores for detecting abnormal add and delete operations reached 0.9828 and 1.0000, respectively.
ConclusionThe system enhances PV management security, simplifies user operations, and reduces complexity. This demonstrates the meaningful integration of artificial intelligence for managing beam accelerator data, resulting in greater efficiency and reliability for the control system.