<p>The convergence of a stochastic optimal control problem with Markov switches in an averaging scheme is analyzed. A combination of the standard Wiener process and a uniformly ergodic Markov process is considered, allowing us to describe the system’s evolution under the influence of diffusion noise and random mode switches. The ergodic properties of the fast process and the conditions for the regularity of the coefficients are presented, which guarantee stable behavior of the system on average. The convergence in probability of the trajectories of the original system to the solutions of the marginal averaged system is proved (through <i>L</i><sup><i>p</i></sup>-estimates). The obtained results enable the solution of stochastic optimization and optimal control problems.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Convergence in Probability for the Stochastic Optimal Control Problem in the Averaging Scheme

  • S. A. Semenyuk

摘要

The convergence of a stochastic optimal control problem with Markov switches in an averaging scheme is analyzed. A combination of the standard Wiener process and a uniformly ergodic Markov process is considered, allowing us to describe the system’s evolution under the influence of diffusion noise and random mode switches. The ergodic properties of the fast process and the conditions for the regularity of the coefficients are presented, which guarantee stable behavior of the system on average. The convergence in probability of the trajectories of the original system to the solutions of the marginal averaged system is proved (through Lp-estimates). The obtained results enable the solution of stochastic optimization and optimal control problems.