Abstract <p>In the course of developing a software ecosystem of the BM@N experiment, a multitude of systems and services has been implemented, including data processing and information systems. An integral component of the maintenance procedure is monitoring the operation of the systems of the BM@N software infrastructure and requests to them, which are logged to the corresponding files. The paper presents the implementation of a contemporary solution for the log management of the BM@N software complex. The log management solution has been implemented based on a high-performance and cost-effective technology stack of ClickHouse and Datadog Vector. The employment of the Metabase business intelligence platform and Grafana real-time monitoring tool further facilitates the analysis of the collected logs. As a result, the integration of these solutions enhances the resilience of the BM@N software infrastructure and facilitates security auditing.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Development of Contemporary Log Management Solution for the Software Infrastructure of the BM@N Experiment

  • I. Romanov,
  • A. Chebotov,
  • K. Gertsenberger

摘要

Abstract

In the course of developing a software ecosystem of the BM@N experiment, a multitude of systems and services has been implemented, including data processing and information systems. An integral component of the maintenance procedure is monitoring the operation of the systems of the BM@N software infrastructure and requests to them, which are logged to the corresponding files. The paper presents the implementation of a contemporary solution for the log management of the BM@N software complex. The log management solution has been implemented based on a high-performance and cost-effective technology stack of ClickHouse and Datadog Vector. The employment of the Metabase business intelligence platform and Grafana real-time monitoring tool further facilitates the analysis of the collected logs. As a result, the integration of these solutions enhances the resilience of the BM@N software infrastructure and facilitates security auditing.