REVIEW 2 major objections 5 minor 37 references
Lanczos with compression for symmetric matrix Lyapunov equations
T0 review · 2 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read This paper shows that Lanczos solvers for symmetric Lyapunov equations can compress the Krylov basis on the fly, matching full-Lanczos accuracy while storing only a small window of vectors.
desk verdict Solid, well-analyzed extension of low-memory Lanczos to Lyapunov equations, with a real but addressable reliability gap in the eigenvalue heuristic that the authors themselves document. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The machinery is a rational Krylov subspace $Q(T_M, e_1, \xi_k)$ built for the projected tridiagonal matrix $T_M$, with poles $\xi_k$ chosen as Zolotarev poles that minimize the rational error function in (2.3). A recursive construction involving two basis sequences, $W_i$ and $U_i$, builds this subspace cycle by cycle: the block tridiagonal extension $T_{i+1}$ is coupled to $T_i$ by a rank-2 update, and Theorem 3.1 — a low-rank update formula for rational matrix functions — lets the next rational Krylov basis be computed from a small auxiliary matrix $S_{i+1}$. The product $Q_s U_s$ is updated incrementally, so only the current compressed basis, the $m$ new Lanczos vectors, and the next Lanczos vector reside in memory. The stopping criterion (3.8) estimates the residual from these small projected quantities without access to the full basis.
What would settle it
Run the method with a prescribed tolerance on a matrix whose true smallest eigenvalue is far smaller than $0.1$ times the smallest eigenvalue of the first projected tridiagonal matrix; if the stopping criterion fires while the true residual is above tolerance — as happened in the paper's own $N = 79{,}841$ experiment — the practical claim of delivering a prescribed accuracy fails.
Extended reading notes
Core claim
The central claim is that solving the projected $M \times M$ Lyapunov equation exactly is unnecessary; replacing the exact solve by projection onto the rational Krylov subspace $Q(T_M, e_1, \xi_k)$ with Zolotarev poles adds only the term $(\text{raterr}/\lambda_{\min})\|c\|^2$ to the Lanczos error (Corollary 2.3), and this term decays like the Zolotarev number. The algorithmic contribution is to perform this replacement without ever storing the full basis $Q_M$: the Lanczos iterations are divided into cycles, and low-rank update formulas for rational functions of tridiagonal matrices let the compressed product $Q_M U_{M,k}$ be formed on the fly from at most $m+2k+1$ Lanczos vectors. Algorithm 3 is therefore mathematically equivalent to the reference method that explicitly forms $Q_M U_{M,k}$, but uses a bounded window of memory. Theorem 4.2 extends the statement to finite-precision arithmetic, showing that loss of orthogonality in the Lanczos process only delays convergence to the roundoff level and affects the compression term only through a slightly enlarged eigenvalue interval.
Load-bearing premise
The practical procedure stands or falls on the ad hoc estimate of the smallest and largest eigenvalues of $A$ from the first projected tridiagonal matrix; the error bounds and the stopping test both assume that estimate is reliable.
Editorial extensions
If this is right
- At most $m+2k+1$ vectors of length $N$ are stored, independent of the total number $M$ of Lanczos iterations, so memory no longer grows with the convergence of the method.
- The number of poles $k$ grows only logarithmically in the tolerance and the condition number $\lambda_{\max}/\lambda_{\min}$, so a modest $k$ makes the compression error negligible relative to the Lanczos error.
- The method needs about half the matrix-vector products of the two-pass Lanczos method, since it does not recompute the Lanczos basis.
- Finite-precision roundoff does not change the qualitative picture: the residual bound matches full Lanczos up to a Zolotarev term evaluated on a slightly enlarged eigenvalue interval.
- The same cycle-based compression extends to symmetric Sylvester equations $A_1X + XA_2 = c_1c_2^T$, with two Lanczos processes and Zolotarev poles mapped onto symmetric intervals.
Reading between the lines
- Editorial extension: the low-rank update structure is not specific to Lyapunov equations, so the same on-the-fly compression should apply to other matrix equations with low-rank right-hand sides, such as Stein or algebraic Riccati equations.
- Editorial extension: replacing the ad hoc eigenvalue estimate from the first projected tridiagonal matrix with a certified estimate, for example by using more vectors in the first cycle, would remove the observed premature stopping without changing the error analysis.
- Editorial extension: because the compression error decays exponentially in $k$ and the memory budget is fixed in advance, the algorithm behaves as an anytime low-rank solver: one fixes the memory, uses it all for poles and cycle length, and lets a single Lanczos run continue until the residual tolerance is met.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper considers the symmetric Lyapunov equation AX + XA = cc^T with A symmetric positive definite, and proposes a low-memory variant of the Lanczos method, Algorithm 3 (called compress), that compresses the Lanczos basis on the fly using rational Krylov subspaces with Zolotarev poles. The authors derive error bounds (Corollary 2.3, Lemma 2.4, Theorems 4.1 and 4.2) that quantify the effect of compression and of finite-precision arithmetic on the residual norm, and they report numerical experiments on a 4D Laplacian problem and two model-order-reduction examples. The experiments show that compress uses roughly half the matrix-vector products of two-pass Lanczos and far fewer than a compress-and-restart method, at comparable or lower runtime. A central practical caveat is that the number of Zolotarev poles and the stopping criterion depend on an ad hoc estimate of the extreme eigenvalues of A; Table 2 contains a case (N = 79,841) where the returned approximation has a scaled residual 2.4e-3, which exceeds the prescribed tolerance of 1e-3.
Significance. If the advertised guarantees are made robust, the paper makes a valuable contribution: it provides a memory-efficient Lanczos-type solver for large-scale Lyapunov equations with a rigorous convergence analysis that takes round-off into account. The Zolotarev-based compression idea is elegant, and the error bounds are explicit and well matched to the algorithmic construction. The availability of the MATLAB code is a strength, and the finite-precision analysis in Section 4 is a useful addition. However, the practical reliability of the algorithm is currently limited by the unvalidated eigenvalue-estimation heuristic in Section 3.3; the paper itself documents a failure to meet the requested tolerance in one of the test cases. This does not invalidate the compression argument, but it is a load-bearing point that needs to be fixed before the headline claim of delivering a prescribed accuracy with bounded memory can be accepted.
major comments (2)
- [§3.3 and Table 2 (N = 79,841 row)] The stopping criterion (3.8) and the choice of k and of the Zolotarev poles both depend on the ad hoc estimates λmin ≈ 0.1·λmin(T1) and λmax ≈ 1.1·λmax(T1). The residual bound (2.9) consists of two terms; equation (3.8) only monitors the first term. The second term is controlled only through the choice of k and poles, and if the estimated interval is too narrow (in particular if 0.1·λmin(T1) overestimates λmin(A)), the unmonitored term can exceed tol/2. This is precisely the situation observed in the N = 79,841 row of Table 2, where the scaled residual is 2.4e-3 > tol = 1e-3, an outcome attributed in Section 5.2 to a poor estimate of the smallest eigenvalue of A during the first cycle. Since the headline claim is that compress delivers a prescribed accuracy with bounded memory, this gap is load-bearing. The authors should either use certified eigenvalue bounds, update the interval adaptively during the iteration, or check the full residual bound (2.9) before terminating the algorithm.
- [§5.2 (model order reduction, Example 1)] The N = 79,841 experiment is not merely a single outlier; it demonstrates a systematic risk. For that run, the algorithm stops based on the first term of (2.9) being below tol/2, but the actual residual is 2.4·tol. The paper does not provide a remedy or a warning to users beyond the brief note at the end of Section 5.2. Because the practical method is intended for users who do not know the extreme eigenvalues of A, the manuscript should either provide a modified stopping rule that accounts for the possible error in the eigenvalue estimates or state clearly that the method requires reliable estimates of λmin and λmax and give guidance on how to obtain them.
minor comments (5)
- [Definition 2.1] In the definition of a rational Krylov subspace, the block vector B should be in R^{M×ℓ} rather than R^{N×ℓ}, since S is an M×M matrix; as written, the notation is inconsistent with the rest of the paper.
- [Introduction, Section 1] The sentence 'Second, Theorem 4.1 derives an error bound for Lanczos with compression Theorem 4.2' has a typo: it should read '... with compression; see Theorem 4.2'.
- [§5.2] The text says the scaled residual in the N = 79,841 case is 'slightly larger than tol'; 2.4e-3 versus 1e-3 is a factor of 2.4, which is more than 'slight'. Please adjust the wording to reflect the magnitude of the deviation.
- [Table 3] For N = 4813, the time ratio compress/two-pass is 1.3, meaning compress is slower than two-pass in that instance. The text mentions that two-pass is competitive but does not explain this specific case; a short explanation would help the reader interpret the comparison.
- [Theorem 4.1] The constant C2 is defined as sqrt(1+2ϵ0) M λmax / (λmin − M^{5/2}ϵ2||A||_2); this expression relies on the assumption λmin > M^{5/2}ϵ2||A||_2, which is stated earlier. It would be helpful to also define the exact range of M for which the bound is valid.
Circularity Check
No significant circularity. Lyapunov-specific error/residual bounds rest on external [16], [15], [2], [4]; recursive-basis correctness imports general rational-Krylov lemmas from same-author preprint [12] (load-bearing but independent support). The Section 3.3 eigenvalue heuristic's documented failure in Table 2 (N = 79,841) is a robustness gap, not circularity.
-
self citation load bearing
[Section 3.2, Proposition 3.3 (proof) and Theorem 3.1 (proof)]
"the claim for U1 = W1 eU1 follows from [12, Proposition 2.3], noting that Q(T1, e1, ξk) ⊆ span(W1) ... Then, by the second inclusion in (3.9), [12, Proposition 2.3] ensures that the matrix Wi+1 defined in (3.2) forms an orthonormal basis for Q(Ti+1, [e1, e(i+1)m+2k], ξk). Similarly, applying [12, Proposition 2.3] to the first inclusion in (3.9) guarantees that an orthonormal basis for Q(Ti+1, e1, ξk) is given by Wi+1 eUi+1, which equals Ui+1."
Proposition 3.3, which makes Algorithm 3 equivalent to Algorithm 2, is not proven here: its base case and induction step reduce verbatim to [12, Proposition 2.3], and Theorem 3.1 reduces to [12, Corollary 2.6], a preprint sharing first author Casulli. The algorithmic-correctness claim is thus inherited from self-citation. Yet the imported lemmas are general rational-Krylov restriction and low-rank-update statements whose stated assumptions (nested tridiagonal Ti, poles outside spectra) exclude the Lyapunov target; the paper points to published [3] for the same general theory, and the Lyapunov-specific error and residual bounds rest on external [16], [15], [2] and self-contained Lemma 2.4.
full rationale
Walking the derivation chain: (1) Reference-method accuracy. Corollary 2.3 bounds ||X−X_ref||_F by ||X−X_lan||_F plus raterr(ξ_k, λ_min, λ_max)/λ_min · ||c||². Lemma 2.2 supplies the additive term, explicitly cited to external Theorem 4.2 of [16] (Druskin–Knizhnerman–Simoncini), with the needed assumption (spectrum of T_M ⊆ [λ_min, λ_max]) stated; the rest of Corollary 2.3 is a triangle inequality with the isometry Q_M. (2) Compression recursion. The proof that the recursively constructed U_i is an orthonormal basis of Q(T_i, e_1, ξ_k) (Proposition 3.3) and the low-rank update formula for r(T_{i+1}) (Theorem 3.1) import [12, Prop. 2.3] and [12, Cor. 2.6] from a same-first-author arXiv preprint; this is the only flagged item. It is load-bearing for Algorithm 3 ≡ Algorithm 2, but the imported statements are parameter-free rational-Krylov restriction and low-rank-update lemmas whose stated assumptions (nested tridiagonal T_i, poles outside the spectra) exclude the Lyapunov target, and the paper cites published [3] for the same general theory, so per the rubric they are real evidence and the circularity score is not raised. (3) Residual estimation and pole selection. Lemma 2.4 derives the two-term bound (2.9) in a self-contained way from the Lanczos decomposition (2.2) and (2.5); the Zolotarev decay (2.8) is cited to external [4]; the stopping rule balances the two terms rather than renaming an estimate as a prediction. (4) Finite precision. Theorems 4.1 and 4.2 follow external [15], [2], [30], [31], adapting them with the paper's own enlarged-interval argument. Flagged limitation, Section 5.2 and Table 2: for N = 79,841 the computed scaled residual 2.4e-3 exceeds tol = 1e-3, which the paper attributes to 'a poor estimate of the smallest eigenvalue of A during the first cycle'; the Section 3.3 heuristic (0.1·λ_min(T1), 1.1·λ_max(T1)) is thus an unvalidated robustness gap in the practical accuracy guarantee, but the reported residuals are actually computed rather than fitted, so this is a correctness risk, not a circular step. The paper benchmarks against external two-pass [27] and restart [28] implementations and reports its own failure candidly. No fitted parameter is renamed as a prediction and no definition equates an input with the target. Verdict: no significant circularity; score 2 reflects the load-bearing but evidence-backed self-citation to [12].
Assumptions & free parameters
free parameters (2)
- eigenvalue inflation factors =
0.1 (lower), 1.1 (upper)
- cycle length m =
m = maxmem - 2k - 1 (with maxmem=120 in experiments)
assumptions (7)
- standard math Low-rank update formulas for rational matrix functions ([12, Cor 2.6])
- standard math Rational Krylov subspace basis inclusion ([12, Prop 2.3])
- standard math Error bound for rational Krylov method for Lyapunov equations ([16, Thm 4.2])
- standard math Convergence bound for rational Galerkin projection for Sylvester equations ([2, Cor 2.5 and Eq (2.11)])
- standard math Finite-precision Lanczos error bounds ([15, Eq (21),(22)], [30,31])
- standard math Zolotarev poles are optimal and decay bound (2.8) ([4, Thm 3.3])
- domain assumption A is symmetric positive definite and no breakdown occurs in the Lanczos process (M<N)
Cite this review
Pith. "Pith review of Lanczos with compression for symmetric matrix Lyapunov equations." pith.science (2026). https://pith.science/paper/Y6FP4NL6
@misc{pith2026250522498,
author = {Pith},
title = {Pith review of: Lanczos with compression for symmetric matrix Lyapunov equations},
year = {2026},
howpublished = {\url{https://pith.science/paper/Y6FP4NL6}},
note = {Machine review of arXiv:2505.22498}
}
abstract
This work considers large-scale Lyapunov matrix equations of the form $AX + XA = \boldsymbol{c}\boldsymbol{c}^T$, where $A$ is a symmetric positive definite matrix and $\boldsymbol{c}$ is a vector. Motivated by the need to solve such equations in a wide range of applications, various numerical methods have been developed to compute low-rank approximations of the solution matrix $X$. In this work, we focus on the Lanczos method, which has the distinct advantage of requiring only matrix-vector products with $A$, making it broadly applicable. However, the Lanczos method may suffer from slow convergence when $A$ is ill-conditioned, leading to excessive memory requirements for storing the Krylov subspace basis generated by the algorithm. To address this issue, we propose a novel compression strategy for the Krylov subspace basis that significantly reduces memory usage without hindering convergence. This is supported by both numerical experiments and a convergence analysis. Our analysis also accounts for the loss of orthogonality due to round-off errors in the Lanczos process.
Figures
Reference graph
Works this paper leans on
-
[12]
A. A. Casulli and I. Simunec , A low-memory Lanczos method with rational Krylov com- pression for matrix functions, arXiv:2403.04390, 2024
work page Pith review arXiv 2024
-
[1]
A. C. Antoulas , Approximation of large-scale dynamical systems, vol. 6 of Advances in Design and Control, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 2005
work page 2005
-
[2]
B. Beckermann, An error analysis for rational Galerkin projection applied to the Sylvester equation, SIAM J. Numer. Anal., 49 (2011), pp. 2430–2450
work page 2011
-
[3]
B. Beckermann, A. Cortinovis, D. Kressner, and M. Schweitzer , Low-rank updates of matrix functions II: rational Krylov methods, SIAM J. Numer. Anal., 59 (2021), pp. 1325– 1347
work page 2021
-
[4]
B. Beckermann and A. Townsend , Bounds on the singular values of matrices with dis- placement structure, SIAM Rev., 61 (2019), pp. 319–344. 21
work page 2019
- [5]
-
[6]
P. Benner, R.-C. Li, and N. Truhar , On the ADI method for Sylvester equations, J. Comput. Appl. Math., 233 (2009), pp. 1035–1045
work page 2009
- [7]
Show all 37 references
-
[8]
Benner, D
P. Benner, D. Palitta, and J. Saak , On an integrated Krylov-ADI solver for large-scale Lyapunov equations, Numer. Algorithms, 92 (2023), pp. 35–63
2023
-
[9]
D. S. Bernstein and C. F. V an Loan , Rational matrix functions and rank-1 updates, SIAM J. Matrix Anal. Appl., 22 (2000), pp. 145–154
2000
-
[10]
A. A. Casulli , Block rational Krylov methods for matrix equations and matrix functions, PhD thesis, Scuola Normale Superiore, Pisa, Italy, 2024
2024
-
[11]
A. A. Casulli and L. Robol , An efficient block rational Krylov solver for Sylvester equa- tions with adaptive pole selection, SIAM J. Sci. Comput., 46 (2024), pp. A798–A824
2024
-
[13]
T. Chen, A. Greenbaum, C. Musco, and C. Musco , Error bounds for Lanczos-based matrix function approximation, SIAM J. Matrix Anal. Appl., 43 (2022), pp. 787–811
2022
-
[14]
B. N. Datta, Linear and numerical linear algebra in control theory: some research problems, Linear Algebra Appl., 197/198 (1994), pp. 755–790
1994
-
[15]
Druskin, A
V. Druskin, A. Greenbaum, and L. Knizhnerman , Using nonorthogonal Lanczos vectors in the computation of matrix functions, SIAM J. Sci. Comput., 19 (1998), pp. 38–54
1998
-
[16]
Druskin, L
V. Druskin, L. Knizhnerman, and V. Simoncini , Analysis of the rational Krylov subspace and ADI methods for solving the Lyapunov equation, SIAM J. Numer. Anal., 49 (2011), pp. 1875–1898
2011
-
[17]
N. S. Ellner and E. L. W achspress , Alternating direction implicit iteration for systems with complex spectra, SIAM J. Numer. Anal., 28 (1991), pp. 859–870
1991
-
[18]
Elsworth and S
S. Elsworth and S. Güttel , The block rational Arnoldi method, SIAM J. Matrix Anal. Appl., 41 (2020), pp. 365–388
2020
-
[19]
Gajic and M
Z. Gajic and M. T. J. Qureshi , Lyapunov matrix equation in system stability and control, vol. 195 of Mathematics in Science and Engineering, Academic Press, Inc., San Diego, CA, 1995
1995
-
[20]
G. H. Golub and C. F. V an Loan , Matrix computations, Johns Hopkins Studies in the Mathematical Sciences, Johns Hopkins University Press, Baltimore, MD, fourth ed., 2013
2013
-
[21]
Grubišić and D
L. Grubišić and D. Kressner , On the eigenvalue decay of solutions to operator Lyapunov equations, Systems Control Lett., 73 (2014), pp. 42–47
2014
-
[22]
Güttel, Rational Krylov Methods for Operator Functions, PhD thesis, Technische Uni- versität Bergakademie Freiberg, Germany, 2010
S. Güttel, Rational Krylov Methods for Operator Functions, PhD thesis, Technische Uni- versität Bergakademie Freiberg, Germany, 2010
2010
-
[23]
Güttel, D
S. Güttel, D. Kressner, and K. Lund , Limited-memory polynomial methods for large- scale matrix functions, GAMM-Mitt., 43 (2020), pp. e202000019, 19
2020
-
[24]
Güttel and M
S. Güttel and M. Schweitzer , A comparison of limited-memory Krylov methods for Stieltjes functions of Hermitian matrices, SIAM J. Matrix Anal. Appl., 42 (2021), pp. 83– 107
2021
-
[25]
I. M. Jaimoukha and E. M. Kasenally , Krylov subspace methods for solving large Lya- punov equations, SIAM J. Numer. Anal., 31 (1994), pp. 227–251
1994
-
[26]
Jbilou and A
K. Jbilou and A. J. Riquet , Projection methods for large Lyapunov matrix equations, Linear Algebra Appl., 415 (2006), pp. 344–358
2006
-
[27]
Kressner, Memory-efficient Krylov subspace techniques for solving large-scale Lyapunov equations, in 2008 IEEE International Conference on Computer-Aided Control Systems, 2008
D. Kressner, Memory-efficient Krylov subspace techniques for solving large-scale Lyapunov equations, in 2008 IEEE International Conference on Computer-Aided Control Systems, 2008
2008
-
[28]
Kressner, K
D. Kressner, K. Lund, S. Massei, and D. Palitta , Compress-and-restart block Krylov subspace methods for Sylvester matrix equations, Numer. Linear Algebra Appl., 28 (2021), pp. Paper No. e2339, 17
2021
-
[29]
Li and J
J.-R. Li and J. White , Low rank solution of Lyapunov equations, SIAM J. Matrix Anal. Appl., 24 (2002), pp. 260–280
2002
-
[30]
C. C. Paige , Error analysis of the Lanczos algorithm for tridiagonalizing a symmetric matrix, J. Inst. Math. Appl., 18 (1976), pp. 341–349. 22
1976
-
[31]
, Accuracy and effectiveness of the Lanczos algorithm for the symmetric eigenproblem, Linear Algebra Appl., 34 (1980), pp. 235–258
1980
-
[32]
Matrix Anal
, An augmented stability result for the Lanczos Hermitian matrix tridiagonalization process, SIAM J. Matrix Anal. Appl., 31 (2010), pp. 2347–2359
2010
-
[33]
Palitta and V
D. Palitta and V. Simoncini , Matrix-equation-based strategies for convection-diffusion equations, BIT, 56 (2016), pp. 751–776
2016
-
[34]
Penzl , A cyclic low-rank Smith method for large sparse Lyapunov equations, SIAM J
T. Penzl , A cyclic low-rank Smith method for large sparse Lyapunov equations, SIAM J. Sci. Comput., 21 (1999/00), pp. 1401–1418
1999
-
[35]
Saad , Numerical solution of large Lyapunov equations, in Signal processing, scattering and operator theory, and numerical methods (Amsterdam, 1989), vol
Y. Saad , Numerical solution of large Lyapunov equations, in Signal processing, scattering and operator theory, and numerical methods (Amsterdam, 1989), vol. 5 of Progr. Systems Control Theory, Birkhäuser Boston, Boston, MA, 1990, pp. 503–511
1989
-
[36]
Simoncini , Computational methods for linear matrix equations, SIAM Rev., 58 (2016), pp
V. Simoncini , Computational methods for linear matrix equations, SIAM Rev., 58 (2016), pp. 377–441
2016
-
[37]
Simoncini and V
V. Simoncini and V. Druskin , Convergence analysis of projection methods for the numer- ical solution of large Lyapunov equations, SIAM J. Numer. Anal., 47 (2009), pp. 828–843. 23
2009
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.