Distributionally Robust Linear Quadratic Gaussian Regulator with Stationary Distributions
read the original abstract
We study the Linear Quadratic Gaussian regulation problem in the face of worst-case noise distributions when these are mutually independent, zero-mean, stationary, and within a radius (as measured by the Wasserstein distance) of some reference Gaussian noise distributions. Compared with nonstationary ambiguity models, our stationary modeling choice reduces conservatism when the disturbances are stationary, as is often the case in practice. We first show optimality of linear output-feedback policies via the existence of a Nash equilibrium in an equivalent zero-sum game between a control engineer and a fictitious adversary that compete to minimize and maximize the control cost. Additionally, we show that Nash equilibria may fail to exist when the distributions are not restricted to have zero mean. We then propose an iterated best-response algorithm to compute Nash equilibria and thereby the optimal feedback policies. Our computational framework unifies two seemingly different viewpoints: game-theoretic iterated best response and Frank-Wolfe approaches. Finally, we illustrate the robustness of the proposed controller to unknown noise distributions on an inverted pendulum with physical parameters, a canonical control benchmark.
This paper has not been read by Pith yet.
Forward citations
Cited by 2 Pith papers
-
Sinkhorn Ambiguity Sets for Distributionally Robust Control: Convexity, Weak Compactness, and Tractability
Sinkhorn divergence defines ambiguity sets that make distributionally robust linear quadratic control over linear policies solvable via convex programming even with safety constraints.
-
Can we stabilize an inverted pendulum with feedback from a time-of-flight camera?
An inexpensive low-resolution time-of-flight camera provides sufficient feedback to reliably balance an inverted pendulum on a cart.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.