Distributionally Robust Regret Optimal LQR with Common Stage-Law Ambiguity

Jose Blanchet; Lukas-Benedikt Fiechtner

Distributionally Robust Regret Optimal LQR with Common Stage-Law Ambiguity

T0 review · 2 major / 3 minor · reviewed 2026-05-10 · grok-4.3

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Multistage distributionally robust regret-optimal LQR under common stage-law ambiguity admits an exact SDP reformulation over linear disturbance-feedback policies.

desk verdict The paper delivers a tractable SDP reformulation for multistage DRRO-LQR under linear disturbance-feedback policies and common stage-law ambiguity, with the solution being nominal CE-LQR plus a causal correction. read the letter →

arxiv 2604.06158 v2 pith:DVUUGUOY submitted 2026-04-07 math.OC cs.SYeess.SY

Lukas-Benedikt Fiechtner , Jose Blanchet This is my paper · ORCID

classification math.OCcs.SYeess.SY

keywords distributionallyrobustoptimizationregretlinearquadraticregulatorsemidefiniteprogrammingstochasticcontrolambiguitysetsGelbrichdistance

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper establishes that distributionally robust regret optimization for finite-horizon linear quadratic regulators becomes tractable when disturbances are independent but share an unknown stage law whose mean and covariance lie inside a Gelbrich ball. A sympathetic reader would care because this setup captures realistic uncertainty where past realizations inform future decisions, yet standard robust methods often produce overly cautious controllers. By restricting attention to linear disturbance-feedback policies, the multistage problem converts into a semidefinite program whose solution is the nominal certainty-equivalent LQR law plus a strictly causal correction term driven by empirical means. If correct, the resulting policy preserves a regret guarantee while being substantially less conservative than the corresponding distributionally robust optimal controller under identical ambiguity.

What carries the argument

Linear disturbance-feedback policies together with the Gelbrich-ball ambiguity set, which together convert the multistage regret objective into an exact SDP.

What would settle it

A concrete instance in which a nonlinear disturbance-feedback policy achieves strictly lower worst-case regret than the SDP-derived linear policy under the same Gelbrich ambiguity set.

Watch

Extended reading notes

Core claim

Over linear disturbance-feedback policies the multistage DRRO-LQR problem with common stage-law ambiguity (Gelbrich ball) admits an exact semidefinite programming reformulation; the optimal controller equals the nominal certainty-equivalent LQR law plus a strictly causal empirical-mean correction. Worst-case distributions realizing the optimal value are nonunique.

Load-bearing premise

That linear disturbance-feedback policies are sufficient to achieve both tractability and optimality under the common stage-law Gelbrich-ball model.

Editorial extensions

If this is right

The optimal policy reuses the nominal LQR gain and adds a correction that depends only on past realized disturbances.
Relative to DRO under the identical ambiguity set, the DRRO controller is often substantially less conservative while retaining the regret guarantee.
Worst-case distributions for the DRRO-optimal policy are nonunique.
The correction coefficients in the optimal policy empirically approach the certainty-equivalent feedforward term as horizon length grows.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

The same SDP route may apply to infinite-horizon or time-varying versions of the problem if the stage-law ambiguity remains common across periods.
Regret criteria could reduce conservatism in other multistage control settings where past observations inform future decisions under shared distributional uncertainty.
Numerical verification on real plants would test whether the empirical-mean correction measurably improves closed-loop performance over pure certainty-equivalent control.

Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Desk Editor's Note

read the letter

The paper's key result is an exact SDP for multistage DRRO-LQR over linear disturbance-feedback policies, where the controller is the nominal CE-LQR law plus a strictly causal empirical-mean correction. They make progress on a setting that was hard before by using the common stage-law ambiguity with Gelbrich balls, which lets them reformulate the problem without losing the regret focus. The work shows why multistage matters here unlike single-stage, and backs it with numerics that DRRO is less conservative than DRO. The non-unique worst-case distributions add some insight. The soft spots are minor but worth noting. The linear policy restriction is necessary for the SDP but might miss better nonlinear options, though they don't overclaim. The ambiguity set is tailored to enable independence with shared parameters, which works but narrows the scope. If the full paper has the derivations, they should hold up given the stress-test, but verification would be key. Readers in robust stochastic control will find this useful for designing less conservative controllers with regret properties. It deserves a serious referee as the tractability is a concrete advance in the area. I recommend putting it through peer review.

Referee Report

2 major / 3 minor

Summary. The manuscript presents a distributionally robust regret optimization (DRRO) formulation for finite-horizon LQR under common stage-law ambiguity, where disturbances are independent but share an unknown distribution whose mean and covariance lie in a Gelbrich ball around nominal values. The central result is that, when the decision maker is restricted to linear disturbance-feedback policies, the multistage DRRO-LQR problem admits an exact semidefinite programming reformulation. The optimal controller takes the form of the nominal certainty-equivalent LQR law plus a strictly causal correction term driven by the empirical mean. The paper further characterizes the worst-case distributions (showing non-uniqueness for the DRRO-optimal policy) and reports numerical experiments indicating that DRRO is substantially less conservative than the corresponding DRO controller under the same ambiguity set while preserving the regret guarantee.

Significance. If the derivations hold, the result is significant because it delivers the first tractable multistage ex-ante DRRO formulation for stochastic control, converting a generally NP-hard problem into an exact SDP whose solution has an explicit, interpretable structure (nominal CE-LQR plus strictly causal correction). The explicit controller form and the non-uniqueness result for worst-case distributions provide both computational and theoretical value. Numerical evidence of reduced conservatism relative to DRO, while retaining the regret guarantee, suggests practical utility in robust control design under distributional uncertainty.

major comments (2)

[SDP reformulation theorem and proof] The section deriving the SDP reformulation (the main theorem establishing exactness): the multistage extension under common stage-law ambiguity requires explicit verification that the inner supremum over the Gelbrich ball, combined with the regret objective, dualizes to an SDP with no duality gap. The abstract asserts exactness, but the multistage information structure (reuse of the stage law making past disturbances informative) could introduce complications not present in single-stage quadratic cases; the key dualization steps or strong-duality lemma should be highlighted.
[Worst-case distribution analysis] The characterization of worst-case distributions: the claim that they are non-unique for the DRRO-optimal policy is load-bearing for the theoretical contribution. The paper should state whether the non-uniqueness is constructive (explicit families of distributions attaining the supremum) or only existential, and confirm that this does not affect the exactness of the SDP solution.

minor comments (3)

[Introduction] The motivation that the nominal CE controller is generally not regret-optimal should be illustrated with a low-dimensional numerical example or a short analytic counter-example early in the paper, rather than only asserted via the information-structure argument.
[Controller structure] Notation consistency: the abstract uses 'strictly causal empirical-mean correction'; the main text should define this term with an explicit equation (e.g., the form of the correction gain) at first use.
[Numerical experiments] Numerical results: the reported approach of the correction coefficients to the certainty-equivalent feedforward coefficient is interesting, but the paper should report the number of Monte-Carlo trials, seed variability, and quantitative regret or cost differences (not only qualitative 'substantially less conservative') to support the comparison with DRO.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the positive assessment and constructive comments on our manuscript. We address each major comment below and will make the indicated revisions to improve clarity.

read point-by-point responses

Referee: [SDP reformulation theorem and proof] The section deriving the SDP reformulation (the main theorem establishing exactness): the multistage extension under common stage-law ambiguity requires explicit verification that the inner supremum over the Gelbrich ball, combined with the regret objective, dualizes to an SDP with no duality gap. The abstract asserts exactness, but the multistage information structure (reuse of the stage law making past disturbances informative) could introduce complications not present in single-stage quadratic cases; the key dualization steps or strong-duality lemma should be highlighted.

Authors: We appreciate the referee's suggestion to enhance the presentation of the proof. The existing derivation already verifies strong duality for the multistage setting by exploiting the convexity and compactness of the Gelbrich ball together with the quadratic regret objective under linear disturbance-feedback policies; the common stage-law ambiguity is handled via a reformulation that accounts for the information structure without introducing a duality gap. To address the comment, we will add a dedicated remark immediately following the main theorem that explicitly outlines the key dualization steps and references the strong-duality result used, thereby highlighting the multistage extension relative to the single-stage case. revision: yes
Referee: [Worst-case distribution analysis] The characterization of worst-case distributions: the claim that they are non-unique for the DRRO-optimal policy is load-bearing for the theoretical contribution. The paper should state whether the non-uniqueness is constructive (explicit families of distributions attaining the supremum) or only existential, and confirm that this does not affect the exactness of the SDP solution.

Authors: We thank the referee for this observation. Our characterization is constructive: the manuscript exhibits explicit families of distributions (specific mean and covariance perturbations within the Gelbrich ball) that attain the supremum for the DRRO-optimal policy. This construction is used to establish non-uniqueness while confirming that the attained value matches the SDP optimum. We will revise the relevant section to state explicitly that the non-uniqueness is constructive and to add a sentence confirming that it is compatible with (and does not affect) the exactness of the SDP reformulation. revision: yes

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity; derivation is self-contained

full rationale

The paper presents a direct derivation of an exact SDP reformulation for the multistage DRRO-LQR problem restricted to linear disturbance-feedback policies, starting from the DRRO objective and common stage-law Gelbrich ambiguity set. The optimal controller is characterized as the nominal CE-LQR law plus a strictly causal correction term, obtained via the optimization rather than by fitting parameters or renaming inputs. No load-bearing self-citations, self-definitional steps, or reductions of predictions to fitted quantities are indicated in the abstract or claimed results. The characterization of non-unique worst-case distributions and numerical comparisons to DRO are presented as consequences of the reformulation, not as circular inputs. The derivation remains independent of pre-fitted values or prior author-specific uniqueness theorems.

Assumptions & free parameters 0 free parameters · 2 assumptions · 0 invented entities

The formulation rests on standard LQR quadratic costs and SDP duality, plus domain assumptions on the ambiguity set and policy class; no free parameters or invented entities are introduced beyond the Gelbrich ball radius (treated as given).

assumptions (2)

domain assumption Disturbances are independent across time but share a common unknown stage law whose mean and covariance lie in a Gelbrich ball around nominal parameters.
This defines the common stage-law ambiguity central to the DRRO model.
domain assumption Linear disturbance-feedback policies suffice for the exact SDP reformulation and optimality.
The paper restricts the policy class to obtain tractability.

how reviews work

0 comments

Cite this review

Pith. "Pith review of Distributionally Robust Regret Optimal LQR with Common Stage-Law Ambiguity." pith.science (2026). https://pith.science/paper/DVUUGUOY

@misc{pith2026260406158,
  author       = {Pith},
  title        = {Pith review of: Distributionally Robust Regret Optimal LQR with Common Stage-Law Ambiguity},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/DVUUGUOY}},
  note         = {Machine review of arXiv:2604.06158}
}

read the original abstract

We study, to our knowledge, the first tractable multistage ex-ante distributionally robust regret optimization (DRRO) formulation for stochastic control. We consider finite-horizon LQR under common stage-law ambiguity: disturbances are independent across time but share an unknown stage law whose mean and covariance lie in a Gelbrich ball around nominal parameters. Unlike the single-stage quadratic case, the nominal certainty-equivalent (CE) controller is generally not regret-optimal, because reuse of the stage law makes past disturbances informative for future decisions. Despite the general NP-hardness of DRRO, we show that over linear disturbance-feedback policies the resulting multistage DRRO-LQR problem admits an exact semidefinite programming reformulation. The optimal controller is the nominal certainty-equivalent LQR law plus a strictly causal empirical-mean correction. We also characterize worst-case distributions and show that those for the DRRO-optimal policy are nonunique. Numerical results show that, relative to the corresponding DRO controller under the same ambiguity set, DRRO is often substantially less conservative while preserving the intended regret guarantee, and that its correction coefficients empirically approach the certainty-equivalent feedforward coefficient.

Figures

Figures reproduced from arXiv: 2604.06158 by the authors.

**Figure 3.** Comparison of Λt and H¯ t for T = 1000. The DRRO row sums lie close to H¯ t , whereas the DRO row sums remain visibly separated. 6.1 Worst-Case Regret and Ambiguity-Ball Comparison For each δ ∈ [0, 1], we solve the CE, DRO, and DRRO synthesis problems on the same ambiguity ball and evaluate each controller under its worst-case regret law [PITH_FULL_IMAGE:figures/full_fig_p017_3.png] view at source ↗

Discussion (0). Continue with ORCID to comment.

Pith tools

Reviewed May 10, 2026 · model on record in the stance chip above.