Purpose With the increasing scale and data complexity of the High Energy Photon Source (HEPS) beamline domain, conventional archival solutions can no longer meet the requirements for real-time monitoring and collaborative diagnostics. Therefore, this study proposes a scalable Data Services Framework for HEPS beamline Process Variable (PV) data, enabling real-time monitoring, anomaly diagnosis, and cross-domain coordination. Methods A clustered experimental physics and industrial control system (EPICS) Archiver appliance (AA) with multi-tiered storage was deployed to perform high-throughput acquisition, preprocessing, and hierarchical storage of PV data. A reverse CA-Gateway enables secure data exchange between the beamline and accelerator systems. An alarm system built on the Kafka–Elasticsearch–Kibana pipeline performs streaming anomaly diagnosis and trend analytics, while the Channel Finder enables metadata-driven PV discovery and semantic correlation analysis. A WeChat-based mobile interface delivers real-time status notifications for distributed users. Results The system archived 6,640 PVs at <InlineEquation ID="IEq1"> <EquationSource Format="TEX">$\sim$</EquationSource> <EquationSource Format="MATHML"><math> <mo>∼</mo> </math></EquationSource> </InlineEquation> 2,874 events/s (<InlineEquation ID="IEq2"> <EquationSource Format="TEX">$\approx$</EquationSource> <EquationSource Format="MATHML"><math> <mo>≈</mo> </math></EquationSource> </InlineEquation> 4.57 GB/day). AA-assisted analytics traced beamline stage instability to vibration induced by electromagnetic interference from long cabling. Relocating motion controllers nearer the stages reduced vibration amplitude by <InlineEquation ID="IEq3"> <EquationSource Format="TEX">$>$</EquationSource> <EquationSource Format="MATHML"><math> <mo>></mo> </math></EquationSource> </InlineEquation> 90%. The reverse CA-Gateway ensured secure PV exchange, and the mobile module issued real-time alerts within 300 ms to <InlineEquation ID="IEq4"> <EquationSource Format="TEX">$>$</EquationSource> <EquationSource Format="MATHML"><math> <mo>></mo> </math></EquationSource> </InlineEquation> 160 users. Conclusion This framework transforms HEPS beamline data management from passive archiving into an integrated Data Services Framework that enables real-time operational insight and improved diagnostic efficiency, providing a practical reference for large-scale synchrotron radiation facilities.

A data services framework for real-time monitoring and cross-domain collaboration at the HEPS beamline

期刊论文
发表日期：

2025年12月2日

查看全文

Qun Zhang,
Yu Liu,
Zhuo Zhao,
Nian Xie,
Xuewei Dong,
Gang Li

摘要

Purpose

With the increasing scale and data complexity of the High Energy Photon Source (HEPS) beamline domain, conventional archival solutions can no longer meet the requirements for real-time monitoring and collaborative diagnostics. Therefore, this study proposes a scalable Data Services Framework for HEPS beamline Process Variable (PV) data, enabling real-time monitoring, anomaly diagnosis, and cross-domain coordination.

Methods

A clustered experimental physics and industrial control system (EPICS) Archiver appliance (AA) with multi-tiered storage was deployed to perform high-throughput acquisition, preprocessing, and hierarchical storage of PV data. A reverse CA-Gateway enables secure data exchange between the beamline and accelerator systems. An alarm system built on the Kafka–Elasticsearch–Kibana pipeline performs streaming anomaly diagnosis and trend analytics, while the Channel Finder enables metadata-driven PV discovery and semantic correlation analysis. A WeChat-based mobile interface delivers real-time status notifications for distributed users.

Results

The system archived 6,640 PVs at $\sim$ $\sim$ 2,874 events/s ( $\approx$ $\approx$ 4.57 GB/day). AA-assisted analytics traced beamline stage instability to vibration induced by electromagnetic interference from long cabling. Relocating motion controllers nearer the stages reduced vibration amplitude by $>$ $>$ 90%. The reverse CA-Gateway ensured secure PV exchange, and the mobile module issued real-time alerts within 300 ms to $>$ $>$ 160 users.

Conclusion

This framework transforms HEPS beamline data management from passive archiving into an integrated Data Services Framework that enables real-time operational insight and improved diagnostic efficiency, providing a practical reference for large-scale synchrotron radiation facilities.