REVIEW 1 cited by
Regret Lower Bounds for Learning Linear Quadratic Gaussian Systems
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
abstract
TWe establish regret lower bounds for adaptively controlling an unknown linear Gaussian system with quadratic costs. We combine ideas from experiment design, estimation theory and a perturbation bound of certain information matrices to derive regret lower bounds exhibiting scaling on the order of magnitude $\sqrt{T}$ in the time horizon $T$. Our bounds accurately capture the role of control-theoretic parameters and we are able to show that systems that are hard to control are also hard to learn to control; when instantiated to state feedback systems we recover the dimensional dependency of earlier work but with improved scaling with system-theoretic constants such as system costs and Gramians. Furthermore, we extend our results to a class of partially observed systems and demonstrate that systems with poor observability structure also are hard to learn to control.
Forward citations
Cited by 1 Pith paper
-
Tangential Randomization in Linear Bandits (TRAiL): Guaranteed Inference and Regret Bounds
TRAiL, a tangential forced-exploration algorithm for linear bandits, achieves Omega(sqrt(T)) inference quality and O(sqrt(T) log T) regret with high probability, and a new lower bound shows regret and inference qualit...
Discussion (0). Continue with ORCID to comment.