The sample-based value function in discounted infinite-horizon stochastic control converges to a Gaussian process limit that solves a linear DP-type fixed-point equation.
Central Limit Theorems for Sample Average Approximations in Stochastic Optimal Control
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
We establish central limit theorems for the Sample Average Approximation (SAA) method in discrete-time, finite-horizon stochastic optimal control. Our analysis is based on an abstract limit theorem for stochastic backward recursions, which yields a recursive characterization of the limiting laws. Applied to the dynamic programming principle, this framework gives Gaussian limits for SAA value functions under unique optimal policies. The asymptotic variance at each stage decomposes into a current-stage variance and a propagated future variance, demonstrating how statistical uncertainty accumulates backward through time. We also apply the framework to the linear quadratic regulator, derive explicit limiting laws and variance formulas, and provide numerical illustrations of the resulting variance decomposition. Finally, we discuss the form of the limit laws under nonunique optimal policies.
fields
math.OC 1years
2026 1verdicts
ACCEPT 1representative citing papers
citing papers explorer
-
Asymptotic Analysis of Empirical Dynamic Programming in Infinite-Horizon Stochastic Optimal Control
The sample-based value function in discounted infinite-horizon stochastic control converges to a Gaussian process limit that solves a linear DP-type fixed-point equation.