<p>Self-organization through noisy interactions is ubiquitous across physics, mathematics, and machine learning, yet how long-range structure emerges from local noisy dynamics remains poorly understood. Here, we investigate three paradigmatic random-organizing particle systems drawn from distinct domains: models from soft matter physics (random organization, biased random organization) and machine learning (stochastic gradient descent), each characterized by distinct sources of noise. We discover universal long-range behavior across all systems, namely the suppression of long-range density fluctuations, governed solely by the noise correlation between particles. Furthermore, we establish a connection between the emergence of long-range structure and the tendency of stochastic gradient descent to favor flat regions of energy landscape—a phenomenon widely observed in machine learning. To rationalize these findings, we develop a fluctuating hydrodynamic theory that quantitatively captures all observations. Our study resolves long-standing questions about the microscopic origin of noise-induced hyperuniformity, uncovers striking parallels between stochastic gradient descent dynamics on particle system energy landscapes and neural network loss landscapes, and should have wide-ranging applications—from the self-assembly of hyperuniform materials to ecological population dynamics and the design of generalizable learning algorithms.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Emergent universal long-range structure in random-organizing systems

  • Satyam Anand,
  • Guanming Zhang,
  • Stefano Martiniani

摘要

Self-organization through noisy interactions is ubiquitous across physics, mathematics, and machine learning, yet how long-range structure emerges from local noisy dynamics remains poorly understood. Here, we investigate three paradigmatic random-organizing particle systems drawn from distinct domains: models from soft matter physics (random organization, biased random organization) and machine learning (stochastic gradient descent), each characterized by distinct sources of noise. We discover universal long-range behavior across all systems, namely the suppression of long-range density fluctuations, governed solely by the noise correlation between particles. Furthermore, we establish a connection between the emergence of long-range structure and the tendency of stochastic gradient descent to favor flat regions of energy landscape—a phenomenon widely observed in machine learning. To rationalize these findings, we develop a fluctuating hydrodynamic theory that quantitatively captures all observations. Our study resolves long-standing questions about the microscopic origin of noise-induced hyperuniformity, uncovers striking parallels between stochastic gradient descent dynamics on particle system energy landscapes and neural network loss landscapes, and should have wide-ranging applications—from the self-assembly of hyperuniform materials to ecological population dynamics and the design of generalizable learning algorithms.