REVIEW 2 cited by
Fr\'{e}chet derivatives of expected functionals of solutions to stochastic differential equations
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
In the analysis of stochastic dynamical systems described by stochastic differential equations (SDEs), it is often of interest to analyse the sensitivity of the expected value of a functional of the solution of the SDE with respect to perturbations in the SDE parameters. In this paper, we consider path functionals that depend on the solution of the SDE up to a stopping time. We derive formulas for Fr\'{e}chet derivatives of the expected values of these functionals with respect to bounded perturbations of the drift, using the Cameron-Martin-Girsanov theorem for the change of measure. Using these derivatives, we construct an example to show that the map that sends the change of drift to the corresponding relative entropy is not in general convex. We then analyse the existence and uniqueness of solutions to stochastic optimal control problems defined on possibly random time intervals, as well as gradient-based numerical methods for solving such problems.
Forward citations
Cited by 2 Pith papers
-
Reinforcement Learning with Random Time Horizons
Policy gradient formulas are derived for random, policy-dependent time horizons, and the corrected state-space factor (expected runtime) materially improves convergence in experiments.
-
Mean-field optimal control with stochastic leaders
For interacting diffusions with a stochastic leader, finite-N optimal controls Γ-converge to the mean-field optimal control on compact state spaces.
Discussion (0). Continue with ORCID to comment.