This work collects some methodological insights for numerical solution of a “minimum-dispersion” control problem for nonlinear stochastic differential equations, a particular relaxation of the covariance steering task. The main ingredient of our approach is the theoretical foundation called \(\infty \) -order variational analysis. This framework consists in establishing an exact representation of the increment ( \(\infty \) -order variation) of the objective functional using the duality, implied by the transformation of the nonlinear stochastic control problem to a linear deterministic control of the Fokker-Planck equation. The resulting formula for the cost increment analytically represents a “law-feedback” control for the diffusion process. This control mechanism enables us to learn time-dependent coefficients for a predefined Markovian control structure using Monte Carlo simulations with a modest population of samples. Numerical experiments prove the vitality of our approach.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

On Minimum-Dispersion Control of Nonlinear Diffusion Processes

  • Roman Chertovskih,
  • Nikolay Pogodaev,
  • Maxim Staritsyn,
  • A. Pedro Aguiar

摘要

This work collects some methodological insights for numerical solution of a “minimum-dispersion” control problem for nonlinear stochastic differential equations, a particular relaxation of the covariance steering task. The main ingredient of our approach is the theoretical foundation called \(\infty \) -order variational analysis. This framework consists in establishing an exact representation of the increment ( \(\infty \) -order variation) of the objective functional using the duality, implied by the transformation of the nonlinear stochastic control problem to a linear deterministic control of the Fokker-Planck equation. The resulting formula for the cost increment analytically represents a “law-feedback” control for the diffusion process. This control mechanism enables us to learn time-dependent coefficients for a predefined Markovian control structure using Monte Carlo simulations with a modest population of samples. Numerical experiments prove the vitality of our approach.