Modern applications increasingly demand real-time analysis of live, dynamic graphs at scale, yet community detection remains a performance bottleneck—particularly for Louvain-based methods, which are inherently batch-oriented and unsuitable for high-velocity updates. In this paper, we present a novel real-time and incremental Louvain algorithm, integrated into a unified graph database framework that leverages Storage-Compute Clustering (SCC) and High-Density Computing (HDC). Our approach enables sub-second to sub-minute runtimes on billion-scale graphs by dynamically pruning change scopes, reusing modularity deltas, and incorporating deep neighborhood expansion. We analyze trade-offs of prior incremental Louvain variants and position our system as an architecturally grounded, accuracy-preserving alternative. Extensive evaluations demonstrate that our framework not only delivers superior runtime performance but also maintains high modularity, making it suitable for real-world use cases such as financial fraud detection, social network monitoring, and infrastructure anomaly detection.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Breaking the Latency Barrier: Real-Time Incremental Community Detection with Live Graph Data on a Unified Graph Database Framework

  • Victor Wang,
  • Ricky Sun,
  • Jason Zhang

摘要

Modern applications increasingly demand real-time analysis of live, dynamic graphs at scale, yet community detection remains a performance bottleneck—particularly for Louvain-based methods, which are inherently batch-oriented and unsuitable for high-velocity updates. In this paper, we present a novel real-time and incremental Louvain algorithm, integrated into a unified graph database framework that leverages Storage-Compute Clustering (SCC) and High-Density Computing (HDC). Our approach enables sub-second to sub-minute runtimes on billion-scale graphs by dynamically pruning change scopes, reusing modularity deltas, and incorporating deep neighborhood expansion. We analyze trade-offs of prior incremental Louvain variants and position our system as an architecturally grounded, accuracy-preserving alternative. Extensive evaluations demonstrate that our framework not only delivers superior runtime performance but also maintains high modularity, making it suitable for real-world use cases such as financial fraud detection, social network monitoring, and infrastructure anomaly detection.