Pith. sign in

Time-reversal solution of BSDEs in stochastic optimal control: a linear quadratic study

1 Pith paper cite this work. Polarity classification is still indexing.

1 Pith paper citing it
abstract

This paper addresses the numerical solution of backward stochastic differential equations (BSDEs) arising in stochastic optimal control. Specifically, we investigate two BSDEs: one derived from the Hamilton-Jacobi-Bellman equation and the other from the stochastic maximum principle. For both formulations, we analyze and compare two numerical methods. The first utilizes the least-squares Monte-Carlo (LSMC) approach for approximating conditional expectations, while the second leverages a time-reversal (TR) of diffusion processes. Although both methods extend to nonlinear settings, our focus is on the linear-quadratic case, where analytical solutions provide a benchmark. Numerical results demonstrate the superior accuracy and efficiency of the TR approach across both BSDE representations, highlighting its potential for broader applications in stochastic control.

fields

math.OC 1

years

2024 1

verdicts

CONDITIONAL 1

representative citing papers

Flow matching for stochastic linear control systems

math.OC · 2024-11-30 · conditional · novelty 5.0

A flow-matching control law, defined as the conditional expectation of stochastic-bridge control inputs, steers initial to target distributions through deterministic or stochastic linear control systems.

citing papers explorer

Showing 1 of 1 citing paper.

  • Flow matching for stochastic linear control systems math.OC · 2024-11-30 · conditional · none · ref 31 · internal anchor

    A flow-matching control law, defined as the conditional expectation of stochastic-bridge control inputs, steers initial to target distributions through deterministic or stochastic linear control systems.