REVIEW 4 major objections 5 minor 46 references
A Bi-Orthogonal Structure-Preserving eigensolver for large-scale linear response eigenvalue problem
T0 review · 4 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read The paper proposes a parameter-free, matrix-free biorthogonal subspace iteration that computes the smallest positive excitation eigenpairs of the linear response eigenvalue problem, including problems with zero eigenvalues.
desk verdict A practical, well-tested LREP solver with a genuinely useful deflation/batching design; the stability story is partly conjectural, but the paper deserves refereeing. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the direct sum decomposition $\mathbb{R}^{2n} = V_0 \oplus V_1 \oplus \cdots \oplus V_{n-r}$ of the space into biorthogonal invariant subspaces, where $V_0$ is the generalized nullspace spanned by vectors with $K x_i^0 = 0$ and $M y_i^0 = x_i^0$, together with the minimization principle that the $k$ smallest positive eigenvalues in the biorthogonal complement of $V_0 \oplus \cdots \oplus V_\ell$ equal the minimum of $\tfrac12 \operatorname{tr}(U^\top K U + V^\top M V)$ subject to $U^\top V = I_k$. The numerical engine that makes the decomposition usable is MGS-Biorth, a modified Gram-Schmidt biorthogonalization that maintains $X^\top Y = I_m$; the paper conjectures in (3.3) that its biorthogonality residual is $O(\epsilon)\sqrt{\kappa(X^\top Y)}$. The algorithm projects $H$ onto the search subspace with an oblique projector, producing a small $2d \times 2d$ problem whose diagonal blocks $U^\top K U$ and $V^\top M V$ are positive definite, so zero eigenvalues cannot enter the projected problem.
What would settle it
On a problem with a known generalized nullspace and a nearly linearly dependent search subspace, record $\|U^\top V - I_d\|_2$ while Algorithm 2 runs: if this biorthogonality residual grows well above roundoff while the discarding rule of Remark 3.1 is active, then the biorthogonal-complement deflation that stops the iteration is no longer guaranteed, and the claim that BOSP reliably delivers the smallest positive eigenpairs is not established.
Extended reading notes
Core claim
Algorithm 2 (BOSP) is claimed to compute the first $n_e$ smallest positive eigenpairs of the linear response eigenvalue problem with SPSD $K$ and SPD $M$, excluding the zero-eigenvalue generalized nullspace $V_0$ and any converged eigenpairs without artificial parameters. The solver maintains numerically biorthogonal bases $X,Y$ with $X^\top Y = I$ via MGS-Biorth, forms a small structure-preserving projected problem, and solves it with an existing structure-preserving method; residuals are then used to enrich the search subspace with a Newton-type correction. The paper reports that this scheme converges superlinearly in practice, reaches near machine precision for a 1000-dimensional SPD example, beats the comparison eigensolver in iteration count, and shows near-linear parallel speedup on a 1.7-million-dimensional finite-element problem and a dense Bogoliubov-de Gennes problem of up to 16.7 million unknowns.
Load-bearing premise
Everything rests on the biorthogonalization step actually keeping the paired search vectors numerically biorthogonal as the iteration proceeds, a property the paper states as a conjecture rather than a theorem.
Editorial extensions
If this is right
- Problems with singular $K$ are handled by computing the generalized nullspace $V_0$ once, so the iteration proceeds entirely in the biorthogonal complement and never contends with zero eigenvalues.
- Converged eigenpairs drop out of the search automatically, so no user needs to supply a spectral shift, a damping parameter, or any a priori information about the spectrum.
- The moving mechanism makes the cost of the small projected eigenvalue problem $O(n\,n_b^2 + n_b^3)$ instead of $O(n\,n_e^2 + n_e^3)$, so requesting thousands of eigenpairs does not inflate the projection size.
- A matrix-free interface suffices, which is what allows dense problems such as the Bogoliubov-de Gennes system to be solved up to $n = 16{,}777{,}216$ with a roughly $O(n \log n)$ cost per iteration.
- The reported residual behavior indicates superlinear convergence for the molecular test problems, so high-precision solutions can be obtained in a handful of iterations.
Reading between the lines
- A direct extension of the paper's argument, not pursued numerically, would test whether the same biorthogonal-complement deflation remains parameter-free for the generalized LREP with a general SPD $B$; Remark 3.4 sketches the idea but offers no experiments.
- Because only matrix-vector products are required and the projected problem size stays bounded by the batch size, the solver should apply to operator-defined response problems in which $K$ and $M$ are never assembled, a direction the dense Bogoliubov-de Gennes example already gestures toward.
- The conjecture (3.3) on the biorthogonality residual could become a practical safeguard: monitor $\|U^\top V - I_d\|_2$ and reject the iteration when it exceeds a tolerance, rather than silently discarding columns as Remark 3.1 does.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes BOSP, a subspace-iteration eigensolver for the linear response eigenvalue problem (1.2) with K symmetric positive semidefinite and M symmetric positive definite. It first computes a biorthogonal basis of the generalized nullspace V0, then iterates on a 2d-dimensional search space spanned by [V O; O U] with U^T V = I_d, projects H as in (3.5), solves the small LREP (3.6), enriches the search space with Newton/Gauss-Seidel directions from (3.11)-(3.12), and deflates converged pairs by working in their biorthogonal complement. A batching and moving mechanism in Section 3.3 keeps the projected problem size independent of the requested number of eigenpairs. Numerical experiments report near-machine-precision accuracy (Table 2), comparison with an Advanpix quadruple-precision benchmark (Table 3), iteration counts against LOBP4dCG (Table 4), performance for ne = 5000 (Example 4.5), and parallel scaling up to 576 processes (Table 7).
Significance. If the claims are fully established, the paper's main contributions are a parameter-free deflation mechanism based on biorthogonality and a moving-batch strategy that keeps the small projected problem independent of ne, together with a matrix-free interface. The numerical evidence is a strength: eigenvalues are checked against analytical formulas, quadruple-precision benchmarks, and an external solver, and no fitted constants enter the reported accuracies. The parallel timings in Table 7 show near-linear scaling, and Table 8 indicates mesh-independent convergence for a dense three-dimensional BdG problem. However, the central stability and convergence claims are not rigorously supported: the biorthogonality bound is conjectural, column discarding is unquantified, and no convergence theorem is supplied for the subspace iteration. The contribution is therefore promising but conditional.
major comments (4)
- [Section 3.1, Eq. (3.3)] The correctness of Algorithm 2 depends on U^T V = I_d being maintained after every call to MGS-Biorth. The only quantitative statement offered is Eq. (3.3), which the authors explicitly label a conjecture. The identities used later, such as positivity of U^T K U and V^T M V, biorthogonality of the reconstructed eigenvectors, and residual biorthogonality, all presuppose this equality. Please provide a theorem with explicit assumptions or add a numerical safeguard such as reorthogonalization with a monitored loss-of-biorthogonality test; without one, the central stability claim is not established.
- [Remark 3.1] The exception handling in Remark 3.1 silently discards columns whenever X^T Y is ill-conditioned. This means the working dimension can fall below d = 3ne, and in extreme cases below ne, so the projected problem (3.6) cannot represent all requested eigenpairs. The moving mechanism in Section 3.3 also assumes the subspace dimension is fixed, but discarding breaks that bookkeeping. The paper does not report how often columns are discarded, does not monitor the condition of X^T Y, and does not provide a restart mechanism. Please quantify this behavior in the numerical experiments or add a safeguard that detects and recovers from excessive column loss.
- [Section 2.2, Theorem 2.9] Theorem 2.9 is stated in full generality, but its proof explicitly treats only simple eigenvalues and says the multiple-eigenvalue case 'can be derived analogously'. Repeated or tightly clustered eigenvalues are central to the target applications, as Table 5 itself shows near-degenerate SiH4 eigenvalues. Since the minimization principle in the biorthogonal complement is the theoretical foundation for the deflation and for the algorithm's targeting of the smallest positive eigenpairs, a complete proof for repeated eigenvalues, or a clearly stated additional hypothesis, is needed.
- [Section 3.2 and Section 3.3] Algorithm 2 has no convergence theorem. Theorem 2.9 is a minimization principle over invariant subspaces, but it does not imply that the random initial subspace refined by the Gauss-Seidel and Newton updates in Steps 5-6 converges to the smallest positive eigenpairs, nor that the moving mechanism preserves convergence after converged pairs are removed from the search space. The residual plots in Figures 2 and 5 are empirical evidence but not a proof. If the authors intend the convergence behavior to be an empirical contribution, the text should state this limitation explicitly; otherwise a convergence analysis under stated assumptions is required.
minor comments (5)
- [Definitions 2.2 and 2.4] Definition 2.2 says 'Two vectors ... is said to be biorthogonal', which should be 'are said', and Definition 2.4 uses 'Matrice' instead of 'Matrices'.
- [Section 3.2, Eq. (3.9)] The displayed block matrix in the definitions of P and Q appears dimensionally inconsistent: X and Y are d x ne while the bracket is written as a 2 x 2 block matrix. The intended factor is likely a 2ne x ne block column such as [I_ne; O].
- [Section 3.2, after Eq. (3.16)] There is a typo, 'the numbe of ne', which should read 'the number of ne'.
- [Section 3.2, complexity paragraph] The phrase 'Roughly specking' should be 'Roughly speaking'.
- [Table 3] The column header 'our algorithm εk' is ambiguous; the table would be clearer if the two accuracy columns were labeled 'εk (Matlab eigs)' and 'εk (BOSP)'.
Circularity Check
No significant circularity: the LREP-specific theory is proved in the paper and numerical outputs are checked against external or analytical benchmarks.
full rationale
The central derivation is self-contained: Theorem 2.8 and Theorem 2.9 are proved in the paper from Lemmas 2.1, 2.6, and 2.7, rather than imported from the authors' earlier symmetric-eigenvalue papers. Refs. [18,19,46] are used only as analogies and for the moving mechanism, whose subspace-dimension reduction is explicit by construction in Section 3.3. Numerical eigenvalues are validated against independent targets: exact formulas in Example 4.1, Advanpix quadruple-precision eigs in Example 4.2, the external LOBP4dCG solver in Example 4.3, and analytical BdG eigenpairs in Example 4.7. No fitted constant is later reported as a prediction; the residual regression in Table 5 is descriptive, not load-bearing. The genuine weaknesses are correctness risks rather than circularity: Eq. (3.3), the only quantitative biorthogonality bound, is introduced with 'we conjecture the following estimation holds for MGS-Biorth', and Remark 3.1 discards ill-conditioned columns ('such vectors x_l and y_l are simply discarded and the iteration continues') without a detection or restart mechanism, while Algorithm 2 has no convergence theorem for the subspace iteration. These are unsupported-stability concerns, not reductions of the output to the input by construction.
Assumptions & free parameters
free parameters (4)
- batch size nb =
min{ne/5, 150} (default)
- moving mechanism factor s =
3 (default)
- Gauss-Seidel inner sweeps ngs =
not specified in the paper
- inner CG tolerance and maximum iterations =
1e-2 and 20
assumptions (5)
- domain assumption K is symmetric positive semi-definite (SPSD) and M is symmetric positive definite (SPD)
- domain assumption The generalized nullspace V0 can be computed accurately enough from Kx=0 and My=x using standard symmetric eigensolvers and CG
- ad hoc to paper MGS-Biorth maintains biorthogonality with error O(epsilon) sqrt(kappa(X^T Y))
- domain assumption The subspace iteration starting from random U and V converges to the requested smallest positive eigenpairs
- standard math Standard spectral facts: eigenvalues of KM are nonnegative and the Jordan or direct-sum decomposition of H holds
Cite this review
Pith. "Pith review of A Bi-Orthogonal Structure-Preserving eigensolver for large-scale linear response eigenvalue problem." pith.science (2026). https://pith.science/paper/MCUTNKFE
@misc{pith2026250608355,
author = {Pith},
title = {Pith review of: A Bi-Orthogonal Structure-Preserving eigensolver for large-scale linear response eigenvalue problem},
year = {2026},
howpublished = {\url{https://pith.science/paper/MCUTNKFE}},
note = {Machine review of arXiv:2506.08355}
}
read the original abstract
The linear response eigenvalue problem, which arises from many scientific and engineering fields, is quite challenging numerically for large-scale sparse/dense system, especially when it has zero eigenvalues. Based on a direct sum decomposition of biorthogonal invariant subspaces and the minimization principles in the biorthogonal complement, using the structure of generalized nullspace, we propose a Bi-Orthogonal Structure-Preserving subspace iterative solver, which is stable, efficient, and of excellent parallel scalability. The biorthogonality is of essential importance and created by a modified Gram-Schmidt biorthogonalization (MGS-Biorth) algorithm. We naturally deflate out converged eigenvectors by computing the rest eigenpairs in the biorthogonal complementary subspace without introducing any artificial parameters. When the number of requested eigenpairs is large, we propose a moving mechanism to compute them batch by batch such that the projection matrix size is small and independent of the requested eigenpair number. For large-scale problems, one only needs to provide the matrix-vector product, thus waiving explicit matrix storage. The numerical performance is further improved when the matrix-vector product is implemented using parallel computing. Ample numerical examples are provided to demonstrate the stability, efficiency, and parallel scalability.
Figures
Figures from the paper (2 more)
Reference graph
Works this paper leans on
-
[1]
Z. Bai and R.C. Li. Minimization principles for the linear response eigenvalue problem I: Theory, SIAM J. Matrix Anal. Appl., 33(2012), pp. 1075–1100
work page 2012
-
[2]
Z. Bai and R.C. Li , Minimization principles for linear response eigenvalue problem II: Com- putation, SIAM J. Matrix Anal. Appl., 34(2013), pp. 392–416
work page 2013
-
[3]
Z. Bai and R.C. Li , Minimization principles and computation for the generalized linear re- sponse eigenvalue problem, BIT Numer. Math., 54(2014), pp. 31–54
work page 2014
- [4]
- [5]
-
[6]
P. Benner and C. Penke , Efficient and accurate algorithms for solving the Bethe-Salpeter eigenvalue problem for crystalline systems, J. Comput. Appl. Math., 400(2022), pp. 0377– 0427
work page 2022
- [7]
- [8]
Show all 46 references
-
[9]
M. E. Casida , Time-dependent density functional response theory for molecules in: Recent Advances In Density Functional Methods: (Part I), World Scientific, 1995, pp. 155–192
1995
-
[10]
Gao and Y
Y. Gao and Y. Cai , Numerical methods for Bogoliubov-de Gennes excitations of Bose-Einstein condensates, J. Comput. Phys., 403(2020), article 109058
2020
-
[11]
Giannozzi, S
P. Giannozzi, S. Baroni, N. Bonini, M. Calandra, R. Car, C. Cavazzoni, D. Ceresoli, G. L. Chiarotti, M. Cococcioni, I. Dabo et al , QUANTUM ESPRESSO: a modular and open-source software project for quantum simulations of materials, J. Phys. Condens. Matter., 21(2009), article 395502
2009
-
[12]
Hernandez, J
V. Hernandez, J. E. Roman, and V. Vidal , SLEPc: A scalable and flexible toolkit for the solution of eigenvalue problems, ACM Trans. Math. Softw., 31(2005), pp. 351–362
2005
-
[13]
M. R. Hestenes, Multiplier and gradient methods, J. Optimiz. Theory App., 5(1969), pp. 303– 320
1969
-
[14]
N. J. Higham , The test matrix toolbox for matlab (version 3.0), Technical report, University of Manchester, 1995
1995
-
[15]
Kohaupt, Introduction to a Gram-Schmidt-type biorthogonalization method, Rocky Mt
L. Kohaupt, Introduction to a Gram-Schmidt-type biorthogonalization method, Rocky Mt. J. Math., 44(2014), pp. 1265–1279
2014
-
[16]
Kress, Numerical Analysis, Springer Science & Business Media, 2012
R. Kress, Numerical Analysis, Springer Science & Business Media, 2012
2012
-
[17]
Lanczos,An iteration method for the solution of the eigenvalue problem of linear differential and integral operators, J
C. Lanczos,An iteration method for the solution of the eigenvalue problem of linear differential and integral operators, J. Res. Nat. Bur. Stand., 45(1950), pp. 255–282
1950
-
[18]
Y. Li, Z. W ang and H. Xie , GCGE: a package for solving large scale eigenvalue problems by parallel block damping inverse power method, CCF Trans. High Perform. Comput., 5(2023), pp. 171–190
2023
-
[19]
Y. Li, H. Xie, R. Xu, C. You and N. Zhang , A parallel generalized conjugate gradient method for large scale eigenvalue problems, CCF Trans. High Perform. Comput., 2(2020), pp. 111– 122
2020
-
[20]
M. J. Lucero, A. M. N. Niklasson, S. Tretiak and M. Challacombe , Molecular-orbital- free algorithm for excited states in time-dependent perturbation theory, J. Chem. Phys., 129(2008), article 064114
2008
-
[21]
A. D. Martin and P.B. Blakie , Stability and structure of an anisotropically trapped dipolar Bose-Einstein condensate: Angular and linear rotons, Phys. Rev. A, 86(2012), article 053623
2012
-
[22]
Onida, L
G. Onida, L. Reining and A. Rubio , Electronic excitations: density-functional versus many- body Green’s-function approaches, Rev. Mod. Phys., 74(2002), pp. 601–659
2002
-
[23]
Papakonstantinou, Reduction of the RPA eigenvalue problem and a generalized Cholesky decomposition for real-symmetric matrices, Europhys
P. Papakonstantinou, Reduction of the RPA eigenvalue problem and a generalized Cholesky decomposition for real-symmetric matrices, Europhys. Lett., 78(2007), article 12001
2007
-
[24]
B. N. Parlett, D. R. Taylor and Z. A. Liu ,A look-ahead Lanczos algorithm for unsymmetric matrices, Math. Comput., 44(1985), pp. 105–124
1985
-
[25]
M. J. Powell , A method for nonlinear constraints in minimization problems, Optimization, 26 Y. Li, Z. Wang and Y. Zhang Academic Press, 1969, pp. 283–298
1969
-
[26]
Ring and P
P. Ring and P. Schuck , The Nuclear Many-body Problem, Springer Science & Business Media, 2004
2004
-
[27]
Rocca, Z
D. Rocca, Z. Bai, R. C. Li and G. Galli , A block variational procedure for the iterative diagonalization of non-Hermitian random-phase approximation matrices, J. Chem. Phys., 136(2012), article 034111
2012
-
[28]
Ruhe , Numerical aspects of Gram-Schmidt orthogonalization of vectors, Linear Algebra Appl., 52(1983), pp
A. Ruhe , Numerical aspects of Gram-Schmidt orthogonalization of vectors, Linear Algebra Appl., 52(1983), pp. 591–601
1983
-
[29]
Saad, The Lanczos biorthogonalization algorithm and other oblique projection methods for solving large unsymmetric systems, SIAM J
Y. Saad, The Lanczos biorthogonalization algorithm and other oblique projection methods for solving large unsymmetric systems, SIAM J. Numer. Anal., 19(1982), pp. 485–506
1982
-
[30]
Saad, Iterative Methods for Sparse Linear Systems, SIAM, 2003
Y. Saad, Iterative Methods for Sparse Linear Systems, SIAM, 2003
2003
-
[31]
Saad, Numerical Methods for Large Eigenvalue Problems, J
Y. Saad, Numerical Methods for Large Eigenvalue Problems, J. Soc. Ind. Appl. Math., 2011
2011
-
[32]
E. E. Salpeter and H. A. Bethe , A relativistic equation for bound-state problems, Phys. Rev., 84(1951), pp. 1232-1242
1951
-
[33]
M. Shao, F. H. da Jornada, L. Lin, C. Yang, J. Deslippe and S. G. Louie , A structure preserving Lanczos algorithm for computing the optical absorption spectrum, SIAM J. Matrix Anal. Appl., 39(2018), pp. 683–711
2018
-
[34]
M. Shao, F. H. da Jornada, C. Yang, J. Deslippe and S. G. Louie , Structure preserv- ing parallel algorithms for solving the Bethe-Salpeter eigenvalue problem, Linear Algebra Appl., 488(2016), pp. 148–167
2016
-
[35]
G. W. Stewart , Block Gram-Schmidt orthogonalization, SIAM J. Sci. Comput., 31(2008), pp. 761–775
2008
-
[36]
Strinati, Application of the Green’s functions method to the study of the optical properties of semiconductors, Riv
G. Strinati, Application of the Green’s functions method to the study of the optical properties of semiconductors, Riv. del Nuovo Cim., 11(1988), pp. 1–86
1988
-
[37]
Q. Tang, M. Xie, Y. Zhang and Y. Zhang , A spectrally accurate numerical method for computing the Bogoliubov-de Gennes excitations of dipolar Bose-Einstein condensates, SIAM J. Sci. Comput., 44(2022), pp. B100–B121
2022
-
[38]
Teng and R.C
Z. Teng and R.C. Li , Convergence analysis of Lanczos-type methods for the linear response eigenvalue problem, J. Comput. Appl. Math., 247(2013), pp. 17–33
2013
-
[39]
Teng and L
Z. Teng and L. Lu , A FEAST algorithm for the linear response eigenvalue problem, Algo- rithms, 12(2019), pp. 181
2019
-
[40]
Teng and L.H
Z. Teng and L.H. Zhang , A block Lanczos method for the linear response eigenvalue problem, Electron. Trans. Numer. Anal., 46(2017), pp. 505–523
2017
-
[41]
Z. Teng, Y. Zhou and R.C. Li , A block Chebyshev-Davidson method for linear response eigenvalue problems, Adv. Comput. Math., 42(2016), pp. 1103–1128
2016
-
[42]
Thouless, Vibrational states of nuclei in the random phase approximation, Nucl
D.J. Thouless, Vibrational states of nuclei in the random phase approximation, Nucl. Phys., 22(1961), pp. 78–95
1961
-
[43]
Thouless, The Quantum Mechanics of Many-Body Systems, Academic, 1972
D.J. Thouless, The Quantum Mechanics of Many-Body Systems, Academic, 1972
1972
-
[44]
R.S V arga, Matrix Iterative Analysis, Springer Science & Business Media, 2000
2000
-
[45]
Vecharynski, J
E. Vecharynski, J. Brabec, M. Shao, N. Govind and C. Yang ,Efficient block preconditioned eigensolvers for linear response time-dependent density functional theory, Comput. Phys. Commun., 221(2017), pp. 42–52
2017
-
[46]
Zhang, Y
N. Zhang, Y. Li, H. Xie, R. Xu and C. You , A generalized conjugate gradient method for eigenvalue problems, Sci. Sin. Math., 51(2021), pp. 1297–1320
2021
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.