Active inference (AIF), grounded in the free energy principle, provides a unified framework for learning and decision-making under uncertainty. However, standard computational AIF formulations are restricted to finite state spaces and discrete time, limiting their applicability in environments with continuous space and time. To address this, we parameterise continuous-time state evolutions with neural stochastic differential equations (NSDEs), whose neural-network–based drift and diffusion can flexibly capture complex, nonlinear stochastic dynamics in high-dimensional state spaces. By embedding these NSDEs in a variational inference architecture, we derive a continuous-time expected free energy objective and show how to optimise it using established stochastic differential equation (SDE) solvers and Monte Carlo sampling. In particular, we show that continuous-time AIF naturally accommodates irregular or sporadic time series data, accurately recovering observed dynamics and preferred outcomes on a synthetic benchmark while outperforming fixed-step baselines. These results demonstrate that our NSDE-based AIF preserves the stochastic nature of AIF in continuous time while remaining grounded in mathematical theory and computational methods for SDEs.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Deep Active Inference with Neural Stochastic Differential Equations

  • Marc Pritsch,
  • Georgia Koppe

摘要

Active inference (AIF), grounded in the free energy principle, provides a unified framework for learning and decision-making under uncertainty. However, standard computational AIF formulations are restricted to finite state spaces and discrete time, limiting their applicability in environments with continuous space and time. To address this, we parameterise continuous-time state evolutions with neural stochastic differential equations (NSDEs), whose neural-network–based drift and diffusion can flexibly capture complex, nonlinear stochastic dynamics in high-dimensional state spaces. By embedding these NSDEs in a variational inference architecture, we derive a continuous-time expected free energy objective and show how to optimise it using established stochastic differential equation (SDE) solvers and Monte Carlo sampling. In particular, we show that continuous-time AIF naturally accommodates irregular or sporadic time series data, accurately recovering observed dynamics and preferred outcomes on a synthetic benchmark while outperforming fixed-step baselines. These results demonstrate that our NSDE-based AIF preserves the stochastic nature of AIF in continuous time while remaining grounded in mathematical theory and computational methods for SDEs.