A Common Lyapunov Matrix Approach to the Exponential Stability of Augmented Primal-Dual Gradient Flow as LPV Systems
Pith reviewed 2026-05-10 09:09 UTC · model grok-4.3
The pith
A common Lyapunov matrix exists for two Hurwitz matrices exactly when strict and non-strict Lyapunov matrix sets intersect, and this certifies exponential stability for augmented primal-dual gradient flows under relaxed strong convexity.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
We show that a common Lyapunov matrix exists for the convex combination of two Hurwitz matrices if and only if the intersection of the set of strict Lyapunov matrices for one matrix and the set of non-strict Lyapunov matrices for the other is nonempty. This simple relaxation is useful for the convergence analysis of the augmented primal-dual gradient flow for constrained optimization problems with affine inequality constraints, which can be viewed as a polytopic linear parameter-varying (LPV) system driven by the active-constraint selector. Under a relaxed strong convexity condition, exponential convergence is proved for the LPV system. The analysis can further be extended to the integral-ic
What carries the argument
The intersection condition between the set of strict Lyapunov matrices for one Hurwitz matrix and the set of non-strict Lyapunov matrices for the other, which is necessary and sufficient for the existence of a common Lyapunov matrix certifying stability of their convex combination.
If this is right
- Exponential convergence holds for the augmented primal-dual gradient flow solving constrained optimization problems with affine inequality constraints.
- The convergence rate of the LPV system can be bounded numerically via the integral quadratic constraints framework.
- Stability certificates for any system that switches between two Hurwitz modes become checkable by testing the intersection condition on Lyapunov matrix sets.
- The approach applies directly to polytopic LPV representations where the parameter is a selector among active sets.
Where Pith is reading between the lines
- The intersection condition may simplify stability proofs for other primal-dual or switching optimization algorithms that activate different constraint sets.
- Weakening the usual strong convexity assumption could extend convergence guarantees to a larger family of convex but not strongly convex objectives.
- Software implementations of the IQC search could produce explicit rate estimates for concrete problem instances without deriving closed-form expressions.
Load-bearing premise
The augmented primal-dual gradient flow can be represented exactly as a polytopic LPV system parameterized by the active-constraint selector, and the relaxed strong convexity condition is sufficient for the common Lyapunov matrix to certify exponential decay.
What would settle it
A pair of Hurwitz matrices for which the intersection of strict and non-strict Lyapunov matrix sets is nonempty yet no common Lyapunov matrix exists, or a numerical simulation of the augmented primal-dual gradient flow under the relaxed strong convexity condition that fails to converge exponentially.
Figures
read the original abstract
We show that a common Lyapunov matrix exists for the convex combination of two Hurwitz matrices if and only if the intersection of the set of strict Lyapunov matrices for one matrix and the set of non-strict Lyapunov matrices for the other is nonempty. This simple relaxation is useful for the convergence analysis of the augmented primal-dual gradient flow for constrained optimization problems with affine inequality constraints, which can be viewed as a polytopic linear parameter-varying (LPV) system driven by the active-constraint selector. Under a relaxed strong convexity condition, exponential convergence is proved for the LPV system. The analysis can further be extended to the integral quadratic constraints (IQCs) framework for LPV systems to facilitate numerical search of the convergence rate.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript proves that a common Lyapunov matrix exists for the convex combination of two Hurwitz matrices if and only if the intersection of the set of strict Lyapunov matrices for one matrix and the set of non-strict Lyapunov matrices for the other is nonempty. It applies this result to establish exponential convergence of the augmented primal-dual gradient flow for constrained optimization problems with affine inequalities, by modeling the dynamics as a polytopic LPV system whose parameter is the active-constraint selector. Under a relaxed strong-convexity condition, the common Lyapunov matrix certifies stability; the approach is further extended to the IQC framework to enable numerical search for convergence rates.
Significance. If the central claims hold, the relaxed common-Lyapunov condition offers a practical tool for stability analysis of two-vertex polytopic LPV systems that arise in primal-dual optimization flows. The explicit connection to IQCs supplies a computational pathway for rate estimation, which is valuable for systems-and-control applications in optimization. The iff characterization itself is a clean contribution to Lyapunov theory for switched systems.
major comments (1)
- [LPV modeling and exponential-stability proof] The proof that the common Lyapunov matrix certifies uniform exponential decay of the LPV system (abstract and the LPV stability section): the non-strict inequality BᵀP + PB ≤ 0 only guarantees a semi-definite derivative when the active-constraint selector θ(t) is constantly at the corresponding vertex. The relaxed strong-convexity assumption is invoked to obtain this non-strict case, yet no argument is given showing that a uniform α > 0 exists such that xᵀ(A(θ)ᵀP + PA(θ))x ≤ −α xᵀPx for all admissible θ(·) and all x. Constant trajectories at the non-strict vertex are admissible in the polytopic LPV model, so individual Hurwitzness of the vertices does not automatically yield a common exponential rate. This point is load-bearing for the exponential-convergence claim.
minor comments (2)
- [Modeling section] The precise definition of the active-constraint selector and the resulting two-vertex polytopic representation of the augmented primal-dual flow should be stated explicitly with the state-space matrices A and B.
- [IQC extension] Notation for the relaxed strong-convexity parameter and its relation to the non-strict Lyapunov inequality could be clarified to avoid ambiguity when extending to the IQC framework.
Simulated Author's Rebuttal
Dear Editor, We thank the referee for the positive evaluation of our contribution and for the constructive comment regarding the exponential stability proof for the LPV system. We address the major comment point by point below and will revise the manuscript accordingly to strengthen the relevant section.
read point-by-point responses
-
Referee: The proof that the common Lyapunov matrix certifies uniform exponential decay of the LPV system (abstract and the LPV stability section): the non-strict inequality BᵀP + PB ≤ 0 only guarantees a semi-definite derivative when the active-constraint selector θ(t) is constantly at the corresponding vertex. The relaxed strong-convexity assumption is invoked to obtain this non-strict case, yet no argument is given showing that a uniform α > 0 exists such that xᵀ(A(θ)ᵀP + PA(θ))x ≤ −α xᵀPx for all admissible θ(·) and all x. Constant trajectories at the non-strict vertex are admissible in the polytopic LPV model, so individual Hurwitzness of the vertices does not automatically yield a common exponential rate. This point is load-bearing for the exponential-convergence claim.
Authors: We thank the referee for highlighting this subtlety. The manuscript shows existence of a common P>0 such that the quadratic form satisfies A(θ)ᵀP + PA(θ) ≤ 0 for all θ in the polytope (strict at one vertex) under the relaxed strong-convexity condition, and claims this certifies exponential stability of the LPV system. However, the current text does not explicitly construct or verify a uniform α>0 in the differential inequality that holds for every admissible θ(·), including constant trajectories at the non-strict vertex. We agree that individual Hurwitzness of the vertices together with a common P yielding a non-positive derivative does not automatically deliver a uniform exponential rate for arbitrary switching. In the revised manuscript we will expand the LPV stability section with a complete argument establishing uniform exponential stability. The added proof will combine (i) the strict negative-definiteness of the form for all θ>0, (ii) the exponential stability of the LTI system at the non-strict vertex, and (iii) a comparison argument that produces a positive lower bound on the decay rate independent of the particular measurable θ(·). We will also clarify the relation to the state-dependent active-set selector arising in the optimization dynamics. revision: yes
Circularity Check
No circularity: claims rest on direct Lyapunov and LPV arguments without self-definition or fitted-input reductions.
full rationale
The paper's core result is an iff statement on existence of a common Lyapunov matrix for convex combinations of two Hurwitz matrices, derived from standard matrix inequalities (strict for one vertex, non-strict for the other). This is then applied to represent the augmented primal-dual flow as a polytopic LPV system whose parameter is the active-constraint selector. The relaxed strong-convexity assumption is used to certify the non-strict case, after which exponential convergence is asserted for the LPV trajectories. No step renames a fitted parameter as a prediction, defines a quantity in terms of its own output, or relies on a load-bearing self-citation whose content is unverified. The derivation chain remains self-contained against external Lyapunov theory and LPV stability criteria.
Axiom & Free-Parameter Ledger
axioms (2)
- standard math Every Hurwitz matrix admits a positive-definite solution to the Lyapunov equation for any positive-definite right-hand side.
- domain assumption The active-constraint selector produces a polytopic LPV system whose vertices are the dynamics corresponding to each possible active-set combination.
Reference graph
Works this paper leans on
-
[1]
(2014).Constrained optimization and Lagrange multiplier methods
Bertsekas, D.P. (2014).Constrained optimization and Lagrange multiplier methods. Academic press
work page 2014
-
[2]
Chesi, G., Garulli, A., Tesi, A., and Vicino, A. (2007). Robust stability of time-varying polytopic systems via parameter-dependent homogeneous Lyapunov func- tions.Automatica, 43(2), 309–316
work page 2007
-
[3]
(1990).Optimization and nonsmooth analy- sis
Clarke, F.H. (1990).Optimization and nonsmooth analy- sis. SIAM. Cort´ es, J. and Niederl¨ ander, S.K. (2019). Distributed coordination for nonsmooth convex optimization via saddle-point dynamics.Journal of Nonlinear Science, 29(4), 1247–1272
work page 1990
-
[4]
Dhingra, N.K., Khong, S.Z., and Jovanovi´ c, M.R. (2018). The proximal augmented Lagrangian method for nons- mooth composite optimization.IEEE Transactions on Automatic Control, 64(7), 2861–2868
work page 2018
-
[5]
Hu, B. and Seiler, P. (2016). Exponential decay rate conditions for uncertain linear systems using integral quadratic constraints.IEEE Transactions on Automatic Control, 61(11), 3631–3637
work page 2016
-
[6]
Jakob, F. and Iannelli, A. (2025). A linear parameter- varying framework for the analysis of time-varying opti- mization algorithms.arXiv preprint arXiv:2501.07461
-
[7]
Lessard, L., Recht, B., and Packard, A. (2016). Analy- sis and design of optimization algorithms via integral quadratic constraints.SIAM Journal on Optimization, 26(1), 57–95
work page 2016
-
[8]
Li, M. (2018). Generalized Lagrange multiplier method and KKT conditions with an application to distributed optimization.IEEE Transactions on Circuits and Sys- tems II: Express Briefs, 66(2), 252–256
work page 2018
- [9]
-
[10]
Li, M. and Nagahara, M. (2025). Exponential conver- gence of augmented primal-dual gradient algorithms for partially strongly convex functions. In2025 American Control Conference (ACC), 2280–2285. IEEE
work page 2025
-
[11]
Li, M., Watson, J., and Lestas, I. (2023). Distributed optimal secondary frequency control in power networks with delay independent stability.IEEE Transactions on Automatic Control, 69(6), 3748–3763
work page 2023
-
[12]
Li, W., Zeng, X., Liang, S., and Hong, Y. (2021). Exponen- tially convergent algorithm design for constrained dis- tributed optimization via nonsmooth approach.IEEE Transactions on Automatic Control, 67(2), 934–940
work page 2021
-
[13]
Low, S.H. and Lapsley, D.E. (1999). Optimization flow control. I. basic algorithm and convergence.IEEE/ACM Transactions on networking, 7(6), 861–874
work page 1999
-
[14]
Megretski, A. and Rantzer, A. (1997). System analysis via integral quadratic constraints.IEEE Transactions on Automatic Control, 42(6), 819–830
work page 1997
-
[15]
Nocedal, J. and Wright, S.J. (1999).Numerical optimiza- tion. Springer
work page 1999
-
[16]
Ozaslan, I.K. and Jovanovi´ c, M.R. (2023). Tight lower bounds on the convergence rate of primal-dual dynamics for equality constrained convex problems. In2023 62nd IEEE Conference on Decision and Control (CDC), 7318–7323. IEEE. P´ olik, I. and Terlaky, T. (2007). A survey of the S-lemma. SIAM review, 49(3), 371–418
work page 2023
- [17]
-
[18]
Scherer, C. and Ebenbauer, C. (2021). Convex synthesis of accelerated gradient algorithms.SIAM Journal on Control and Optimization, 59(6), 4615–4645
work page 2021
-
[19]
Tang, Y., Qu, G., and Li, N. (2020). Semi-global ex- ponential stability of augmented primal–dual gradient dynamics for constrained convex optimization.Systems & Control Letters, 144, 104754
work page 2020
-
[20]
Taylor, A., Van Scoy, B., and Lessard, L. (2018). Lyapunov functions for first-order methods: Tight automated con- vergence guarantees. InInternational Conference on Machine Learning, 4897–4906. PMLR. Van Scoy, B., Simpson-Porco, J.W., and Lessard, L. (2023). Automated Lyapunov analysis of primal-dual optimization algorithms: An interpolation approach. In...
work page 2018
-
[21]
Wang, Z., Wei, W., Zhao, C., Ma, Z., Zheng, Z., Zhang, Y., and Liu, F. (2021). Exponential stability of partial primal–dual gradient dynamics with nonsmooth objec- tive functions.Automatica, 129, 109585
work page 2021
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.