<p>We present a theory of optimal control for McKean-Vlasov stochastic differential equations with infinite time horizon and discounted gain functional. We first establish the well-posedness of the state equation and of the associated control problem under suitable hypotheses for the coefficients. We then especially focus on the time invariance property of the value function <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(V(t,\xi )\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>V</mi> <mo stretchy="false">(</mo> <mi>t</mi> <mo>,</mo> <mi>ξ</mi> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation>, stating that <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\(V\)</EquationSource> <EquationSource Format="MATHML"><math> <mi>V</mi> </math></EquationSource> </InlineEquation> is in fact independent of the initial time of the dynamics. This property can easily be derived if the class of controls can be restricted, forgetting the past of the Brownian noise, without modifying the value. This result is not trivial in a general McKean-Vlasov case; in fact, we provide a counterexample where changing the class of controls worsens the value. We thus require appropriate continuity assumptions in order to prove the time invariance property for the value function in our infinite time horizon setting and for the value of an analogous finite time horizon optimal control problem. Furthermore, we show that the value function only depends on the initial random condition through its probability distribution. The function <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(V\)</EquationSource> <EquationSource Format="MATHML"><math> <mi>V</mi> </math></EquationSource> </InlineEquation> can thus be rewritten as a map <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(v\)</EquationSource> <EquationSource Format="MATHML"><math> <mi>v</mi> </math></EquationSource> </InlineEquation> on the Wasserstein space of order <InlineEquation ID="IEq5"> <EquationSource Format="TEX">\(2\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mn>2</mn> </mrow> </math></EquationSource> </InlineEquation>. After establishing a dynamic programming principle for <InlineEquation ID="IEq6"> <EquationSource Format="TEX">\(v\)</EquationSource> <EquationSource Format="MATHML"><math> <mi>v</mi> </math></EquationSource> </InlineEquation>, we derive an elliptic Hamilton-Jacobi-Bellman equation, solved by <InlineEquation ID="IEq7"> <EquationSource Format="TEX">\(v\)</EquationSource> <EquationSource Format="MATHML"><math> <mi>v</mi> </math></EquationSource> </InlineEquation> in the viscosity sense. Finally, using a finite horizon approximation of our optimal control problem, we prove that the aforementioned equation admits a unique viscosity solution under stronger assumptions.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Infinite Time Horizon Optimal Control of McKean-Vlasov SDEs

  • Silvia Rudà

摘要

We present a theory of optimal control for McKean-Vlasov stochastic differential equations with infinite time horizon and discounted gain functional. We first establish the well-posedness of the state equation and of the associated control problem under suitable hypotheses for the coefficients. We then especially focus on the time invariance property of the value function \(V(t,\xi )\) V ( t , ξ ) , stating that \(V\) V is in fact independent of the initial time of the dynamics. This property can easily be derived if the class of controls can be restricted, forgetting the past of the Brownian noise, without modifying the value. This result is not trivial in a general McKean-Vlasov case; in fact, we provide a counterexample where changing the class of controls worsens the value. We thus require appropriate continuity assumptions in order to prove the time invariance property for the value function in our infinite time horizon setting and for the value of an analogous finite time horizon optimal control problem. Furthermore, we show that the value function only depends on the initial random condition through its probability distribution. The function \(V\) V can thus be rewritten as a map \(v\) v on the Wasserstein space of order \(2\) 2 . After establishing a dynamic programming principle for \(v\) v , we derive an elliptic Hamilton-Jacobi-Bellman equation, solved by \(v\) v in the viscosity sense. Finally, using a finite horizon approximation of our optimal control problem, we prove that the aforementioned equation admits a unique viscosity solution under stronger assumptions.