Pith. sign in

REVIEW 2 major objections 2 minor 28 references

Extending the Davis-Kahan theorem for comparing eigenvectors of two symmetric matrices I: Theory

T0 review · 2 major / 2 minor · reviewed 2026-08-14 · deepseek-v4-flash

Pith's one-line read Polynomial transform extends Davis–Kahan eigenvector bound to any block

desk verdict The polynomial-transform extension of Davis-Kahan is a genuinely new conditional bound, but the advertised universality for arbitrary spectra is not proven; Theorem 3's between-eigengap formula is a nice standalone contribution. read the letter →

arxiv 1908.03462 v1 pith:PYUEPTYX submitted 2019-08-09 math.ST stat.TH

classification math.STstat.TH MSC 15A42
keywords Davis-Kahantheorempolynomialmatrixtransformaffineeigenspacedistancegraphshiftoperatorcanonicalangleseigenvectorperturbation
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper extends the Davis–Kahan theorem, the standard tool for bounding how far the eigenspaces of two symmetric matrices can be, so that it applies to any corresponding consecutive block of eigenvectors rather than only the leading r. The device is a polynomial matrix transform: applying p to one matrix leaves its eigenvectors unchanged but moves its eigenvalues, so the separation required by Davis–Kahan is shifted from the fixed spectra to transformation parameters the user controls. The paper proves that if the transform satisfies two explicit constraints on where the transformed eigenvalues lie, the usual subspace-distance bound holds with denominator δ_i and numerator ||p(Φ)-Ψ||, and the standard theorem is a special case. Because the transform can be chosen to shrink the matrix difference and enlarge the eigengap, the new bounds are guaranteed to be no worse than classical Davis–Kahan bounds. A proof-of-concept on d-regular graphs shows the method automatically recovers the exact eigenvector agreement between unnormalised and normalised graph Laplacians.

What carries the argument

The central object is the polynomial matrix transform p(Φ): by the spectral mapping property for symmetric matrices, if (φ, w) is an eigenpair of Φ then (p(φ), w) is an eigenpair of p(Φ), so eigenvectors are untouched while eigenvalues are relocated. The paper's Constraints 1 and 2A/2B are the load-bearing conditions: they ensure that after transformation, the r eigenvalues of p(Φ) in the block of interest and the corresponding block of Ψ can be enclosed in Davis–Kahan intervals S1, S2 separated by δ_i > 0. With these constraints, the paper obtains the bound ||W_j W_j^T (I - V_j V_j^T)|| ≤ ||p(Φ) - Ψ|| / δ_i for every unitarily invariant norm, and the Frobenius variant with constant c_{n,r} = $\sqrt$(2 min(r, n - r)) from Lemma 2, which relates the two subspace distance metrics via canonical angles.

What would settle it

A concrete negative test is to enumerate all possible orderings of n transformed eigenvalues achievable by polynomials of degree at most d for a given spectrum, and check whether any ordering places the r middle eigenvalues between the outside ones as Constraints 1 require; a spectrum where no admissible ordering exists, despite nonzero boundary eigengaps, would falsify the claim that the extension applies universally to any two symmetric matrices.

Watch

Extended reading notes

Core claim

The paper's central claim is Theorem 5 and Corollary 1: for symmetric matrices Φ and Ψ with nonzero jth and (j+r)th eigengaps, any polynomial p satisfying Constraints 1 and 2A (or 2B) yields the bound ||W_j W_j^T (I - V_j V_j^T)|| ≤ ||p(Φ) - Ψ|| / δ_i for every unitarily invariant norm, and ||W_j - V_j Q||_F ≤ c_{n,r} ||p(Φ) - Ψ||_2 / δ_i for some orthogonal Q. The paper asserts that this extension applies to any two symmetric matrices, excluding degenerate cases, and to any r consecutive corresponding eigenvectors, with the original Davis–Kahan theorem recovered as the special case j = 0, p(x) = x; consequently the extended bounds are at least as tight as classical ones. The transform is the mechanism: since eigenvectors of p(Φ) are eigenvectors of Φ, the subspace distance is unchanged while the spectral positioning is adjustable. The proof-of-concept example with d-regular graphs is central: for these graphs L_sym = $d^{{-1}}$L, so the affine transform with c1 = $d^{{-1}}$, c0 = 0 maps L exactly to L_sym and the extended bound is identically zero, whereas the standard Davis–Kahan bound is generally nonzero.

Load-bearing premise

The theorem's breadth rests on the assumption that for any two symmetric spectra with nonzero jth and (j+r)th eigengaps, some polynomial (at least an affine one) exists whose transformed eigenvalues satisfy Constraints 1 and 2; this existence is stated and demonstrated in examples but not proven here.

Editorial extensions

If this is right

  • For any two symmetric matrices whose spectra have nonzero boundary eigengaps around the compared block, the extended bound applies even when the compared eigenvalues occupy opposite ends of the spectrum, a case the classical theorem cannot handle.
  • Because the standard Davis–Kahan theorem is the special case j = 0 with p(x) = x, the new bound is at least as tight as the classical bound in every setting where both apply.
  • Users can choose the polynomial to minimize ||p(Φ) - Ψ||_2 and maximize the interval separation δ_i, making the bound an optimization target rather than a fixed quantity.
  • In the d-regular graph example, the bound is identically zero when the transform maps the unnormalised Laplacian to the normalised one, so the method automatically identifies the equality of the corresponding eigenspaces.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The authors leave implicit that the zero-bound phenomenon provides a practical certificate: if a user can find an admissible transform mapping Φ exactly to Ψ, the bound certifies exact eigenspace agreement; applying this to empirically estimated graph spectra would give a testable equivalence test between graph shift operators.
  • An extension not pursued here is to apply the same transform device to normal matrices or to non-symmetric spectra via a Jordan-form version of the spectral mapping, though the interval geometry would need substantial reworking.
  • The dependence of the bound on δ_i suggests a data-driven heuristic the paper does not develop: among candidate ranks r and offsets j, choose the block that maximizes the between-matrix separation, since a larger denominator directly shrinks the bound before any optimization of p.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 2 minor

Summary. The paper extends the Davis-Kahan (DK) theorem to compare the subspaces spanned by any r consecutive eigenvectors of two symmetric matrices. The main idea is to apply a polynomial matrix transform p(·) to one of the matrices, which preserves eigenvectors but moves eigenvalues so that a DK-type bound becomes applicable. The central result, Theorem 5 and Corollary 1, states that if a polynomial p satisfies Constraints 1 and 2A or 2B, then the projector distance and the Frobenius distance (up to an orthogonal rotation) are bounded by ||p(Φ)-Ψ|| divided by an eigenvalue-separation factor δ. Theorem 3 treats the special case of the first r eigenvectors and proves that, under nonzero r-th eigengaps, a DK interval always exists, yielding a bound in terms of a between-matrix eigengap. A proof-of-concept example for d-regular graph Laplacians is given, where the affine transform c1 = d^{-1}, c0 = 0 exactly maps L to Lsym, and the algorithm from a companion paper is said to identify this transform automatically.

Significance. The paper offers a genuinely useful idea: using polynomial matrix transforms to relax the restrictive eigenvalue-interval structure of the DK theorem and to tighten the resulting bound. The conditional Theorems 5 and Corollary 1 are carefully proved in Appendix D, and Lemma 2 provides a sharp constant c_{n,r} = sqrt(2 min(r,n-r)) for the relation between the two distance metrics. Theorem 3 is a clean and valid extension of the DK theorem to first-r eigenvector comparisons. If the existence of admissible transforms for arbitrary spectra is established, this work would have broad applicability in graph signal processing, spectral clustering, and spiked covariance models. However, the advertised universality for 'any two symmetric matrices' is not proved in the manuscript, and the proof of concept depends on a special spectral relation and on an algorithm deferred to a companion paper.

major comments (2)
  1. [Section II (last paragraph), Section V-C/V-D, Section VII]
  2. [Section V-D (Remark 4 and the paragraph after Corollary 1)]
minor comments (2)
  1. [Appendix D (proof of Theorem 5, interval choice (8))]
  2. [Throughout]

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the main theorem is a conditional upper bound whose proof invokes only the classical Davis–Kahan theorem, and the proof-of-concept uses the independent identity L_sym = d^{-1}L for d-regular graphs.

full rationale

The derivation chain is self-contained and does not reduce to its inputs. Theorem 5 and Corollary 1 state an upper bound under explicit sufficient conditions on a polynomial p (Constraints 1 and 2A or 2B), and the proof checks that these conditions make the classical Davis–Kahan theorem applicable to the pair (p(Phi), Psi); this is a legitimate conditional proof, not a fitting procedure. The polynomial transform is not defined in terms of the target distance; it is chosen to manipulate eigenvalues while preserving eigenvectors, so the bound remains a genuine upper bound for every admissible p. Optimizing p over that bound is an optimization of an upper bound, not a claim that the bound is attained or a renamed fit. Theorem 3 is also proved directly from the Davis–Kahan theorem with an explicit interval construction. The proof-of-concept example compares eigenvectors of L and Lsym for d-regular graphs using the independently known exact relation Lsym = d^{-1}L; this is a sanity check, not a prediction fitted to the data, and it does not smuggle in the conclusion. The paper does claim, in the Introduction, that for any two symmetric matrices with nonzero boundary eigengaps a valid DK interval setup can always be found, but the existence of a polynomial satisfying the constraints is asserted rather than proved in this manuscript; that is a missing proof or an overstatement of universality, but not circularity. References to the companion paper (Paper II) provide the computational algorithm used in the example, but the theorem itself does not depend on that algorithm, so the self-citation is not load-bearing. No step in the derivation is equivalent by construction to its own conclusion, and no fitted parameter is renamed as a prediction.

Assumptions & free parameters 1 free parameters · 4 assumptions · 0 invented entities

The derivation builds on the classical Davis-Kahan theorem and standard spectral facts. The only genuinely extra burden is the asserted but unproven existence of a transformation satisfying the interval constraints, which the universal applicability claim depends on. No new physical or mathematical entities are postulated.

free parameters (1)
  • affine transform parameters c1, c0 (general polynomial coefficients in the extended method) = c1 = 1/d, c0 = 0 in the d-regular graph example
    These are user-chosen transformation parameters that must satisfy Constraints 1 and 2 and are then optimized to minimize the bound. They are not fitted to data and do not enter the theorem as unknowns, but the proof-of-concept example fixes them to the known scaling between Lsym and L.
assumptions (4)
  • standard math Davis-Kahan theorem as stated in Theorem 2
    The entire extension builds on this external theorem; it is taken as given.
  • domain assumption Symmetric matrices over R with ordered eigenvalues and orthonormal eigenbases
    The paper restricts to symmetric matrices Phi, Psi in R^{n x n} throughout.
  • domain assumption Assumption 2: nonzero jth and (j+r)th eigengaps in both spectra
    Required for unambiguous contiguous eigenvector blocks and valid DK intervals; stated as Assumption 2.
  • ad hoc to paper Existence of a polynomial p satisfying Constraints 1 and 2 for arbitrary spectra
    Theorem 5 is conditional on this existence; the paper asserts it is always achievable but defers the constructive algorithm to Paper II, so it functions as an unproved premise underlying the universal applicability claim.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Extending the Davis-Kahan theorem for comparing eigenvectors of two symmetric matrices I: Theory." pith.science (2026). https://pith.science/paper/PYUEPTYX

@misc{pith2026190803462,
  author       = {Pith},
  title        = {Pith review of: Extending the Davis-Kahan theorem for comparing eigenvectors of two symmetric matrices I: Theory},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/PYUEPTYX}},
  note         = {Machine review of arXiv:1908.03462}
}
abstract

The Davis-Kahan theorem can be used to bound the distance of the spaces spanned by the first $r$ eigenvectors of any two symmetric matrices. We extend the Davis-Kahan theorem to apply to the comparison of the union of eigenspaces of any two symmetric matrices by making use of polynomial matrix transforms and in so doing, tighten the bound. The transform allows us to move requirements present in the original Davis-Kahan theorem, from the eigenvalues of the compared matrices on to the transformation parameters, with the latter being under our control. We provide a proof of concept example, comparing the spaces spanned by the unnormalised and normalised graph Laplacian eigenvectors for $d$-regular graphs, in which the correct transform is automatically identified.

Figures

Figures reproduced from arXiv: 1908.03462 by the authors.

Figure 1
Figure 1. A possible eigenvalue configuration used to illustr [PITH_FULL_IMAGE:figures/full_fig_p006_1.png] view at source ↗
Figure 2
Figure 2. A possible eigenvalue configuration used to illustr [PITH_FULL_IMAGE:figures/full_fig_p006_2.png] view at source ↗
Figure 3
Figure 3. Dots represent attained distances, ρ1(W0, V0), diamonds represent bound values calculated from Corollary 1, using an affine matrix transform￾ation, and ‘x’ symbols represent bound values calculated from Theorem 3. In the above example both the standard DK theorem and our extended applicability version were able to be applied in comparing L and Lsym. In other cases, such as when comparing A and L, the standard DK the… view at source ↗

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

28 extracted references · 28 canonical work pages

  1. [1]

    D. S. Bernstein, Matrix Mathematics: Theory, Facts, and F ormulas (2nd. Edition), Princeton, NJ: Princeton University Press, 2009

  2. [2]

    Bhatia, Matrix Analysis , Berlin, Germany: Springer Science & Business Media, 2013

    R. Bhatia, Matrix Analysis , Berlin, Germany: Springer Science & Business Media, 2013

  3. [3]

    Signal-plus-noise matri x models: eigenvector deviations and fluctuations,

    J. Cape, M. Tang & C. E. Priebe, “Signal-plus-noise matri x models: eigenvector deviations and fluctuations,” Biometrika, vol. 106, pp. 243 – 250, 2019

  4. [4]

    The Rotation of Eigenvectors by a P er- turbation. III,

    C. Davis & W. M. Kahan, “The Rotation of Eigenvectors by a P er- turbation. III,” SIAM Journal on Numerical Analysis , vol. 7, pp. 1–46, 1970

  5. [5]

    Spectral Projector-Based Gra ph Fourier Transforms,

    J. A. Deri & J. M. F. Moura, “Spectral Projector-Based Gra ph Fourier Transforms,” IEEE Journal of Selected Topics in Signal Processing , vol. 11, pp. 785–795, 2017

  6. [6]

    Learning Gra phs from Data: A signal representation perspective,

    X. Dong, D. Thanou, M. Rabbat & P . Frossard, “Learning Gra phs from Data: A signal representation perspective,” IEEE Signal Processing Magazine, vol. 36, pp. 44–63, 2019

  7. [7]

    The geometry of algo rithms with orthogonality constraints,

    A. Edelman, T. A. Arias & S. T. Smith, “The geometry of algo rithms with orthogonality constraints,” SIAM Journal on Matrix Analysis and Applications, vol. 20, pp. 303–353, 1998

  8. [8]

    Unperturbed: spectral analysis beyond Davis–Kahan,

    J. Eldridge, M. Belkin & Y . Wang, “Unperturbed: spectral analysis beyond Davis–Kahan,” Proceedings of Algorithmic Learning Theory , vol. 83, pp. 321–358, 2018

Show all 28 references
  1. [9]

    Large covariance estimati on by thresholding principal orthogonal complements,

    J. Fan, Y . Liao & M. Mincheva, “Large covariance estimati on by thresholding principal orthogonal complements,” Journal of the Royal Statistical Society B , vol. 75, pp. 603–680, 2013

  2. [10]

    R. A. Horn & C. R. Johnson, Matrix Analysis , Cambridge, U.K.: Cambridge University Press, 1985

  3. [11]

    On the distribution of the largest eig envalue in prin- cipal components analysis,

    I. M. Johnstone, “On the distribution of the largest eig envalue in prin- cipal components analysis,” The Annals of Statistics , vol. 29, pp. 295– 327, 2001

  4. [12]

    PCA consistency in High Dimensio n Low Sample Size Context,

    S. Jung & J. S. Marron, “PCA consistency in High Dimensio n Low Sample Size Context,” The Annals of Statistics , vol. 37, pp. 4104–4130, 2009

  5. [13]

    Graph Similarity based on Graph Fourier Distances,

    E. Lagunas, A. G. Marques, S. Chatzinotas & B. Ottersten , “Graph Similarity based on Graph Fourier Distances,” EUSIPCO 2018, pp. 877– 881, 2018

  6. [14]

    Consistency of spectral clusterin g in stochastic block models,

    J. Lei & A. Rinaldo, “Consistency of spectral clusterin g in stochastic block models,” The Annals of Statistics , vol. 43, pp. 215–237, 2015

  7. [15]

    C. D. Meyer, Matrix analysis and applied linear algebra , Philadelphia, PA : SIAM, 2000

  8. [16]

    Graph Signal Processing: Overview, Challenges, and Appli cations,

    A. Ortega, P . Frossard, J. Kovacevic, J. M. F. Moura & P . V andergheynst, “Graph Signal Processing: Overview, Challenges, and Appli cations,” Proceedings of the IEEE , vol. 106, pp. 808–828, 2018

  9. [17]

    Spectral clustering and the high- dimensional stochastic blockmodel,

    K. Rohe, S. Chatterjee & B. Y u, “Spectral clustering and the high- dimensional stochastic blockmodel,” The Annals of Statistics , vol. 39, pp. 1878–1915, 2011

  10. [18]

    Random perturbation of low rank matrices: Improving classical bounds,

    S. O’Rourke, V . Vu & K. Wang, “Random perturbation of low rank matrices: Improving classical bounds,” Linear Algebra and its Applica- tions, vol. 540, pp. 26–59, 2018

  11. [19]

    First-principles multiwa y spectral partitioning of graphs,

    M. A. Riolo & M. E. J. Newman, “First-principles multiwa y spectral partitioning of graphs,” J. Complex Netw. , vol. 2, pp. 121–140, 2014

  12. [20]

    The emerging field of signal processing on graphs: Extendin g high- dimensional data analysis to networks and other irregular d omains,

    D. Shuman, S. K. Narang, P . Frossard, A. Ortega, & P . V and ergheynst, “The emerging field of signal processing on graphs: Extendin g high- dimensional data analysis to networks and other irregular d omains,” IEEE Signal Processing Magazine , vol. 30, pp. 83–98, 2013

  13. [21]

    On Spectral Anal ysis of Node Centrality,

    R. Singh, A. Chakraborty & B. S. Manoj, “On Spectral Anal ysis of Node Centrality,” ANTS 2016 , pp. 1–5, 2016

  14. [22]

    G. W. Stewart & J. Sun, Matrix Perturbation Theory , San Diego, CA: Academic Press Inc., 1990

  15. [23]

    Limit Theorems for eigenvectors of the normalized Laplacian for random graphs,

    M. Tang & C. E. Priebe, “Limit Theorems for eigenvectors of the normalized Laplacian for random graphs,” The Annals of Statistics , vol. 46, pp. 2360–2415, 2018

  16. [24]

    A tutorial on spectral clustering,

    U. von Luxburg, “A tutorial on spectral clustering,” Statistics and Computing, vol. 17, pp. 395–416, 2007

  17. [25]

    Minimax sparse principal subspace est imation in high dimensions,

    V . Q. Vu & J. Lei, “Minimax sparse principal subspace est imation in high dimensions,” The Annals of Statistics, vol. 41, pp. 2905–2947, 2013

  18. [26]

    Asymptotics of empirical eigenstruct ure for high dimensional spiked covariance,

    W. Wang & J. Fan, “Asymptotics of empirical eigenstruct ure for high dimensional spiked covariance,” The Annals of Statistics , vol. 45, pp. 1342–1374, 2017

  19. [27]

    Integration of network topological features and graph Fou rier transform for fMRI data analysis,

    J. Wang, V . D. Calhoun, J. M. Stephen, T. W. Wilson & Y . Wan g, “Integration of network topological features and graph Fou rier transform for fMRI data analysis,” ISBI 2018 , pp. 92–96, 2018

  20. [28]

    A useful variant of the Da vis–Kahan theorem for statisticians,

    Y . Y u, T. Wang & R. J. Samworth, “A useful variant of the Da vis–Kahan theorem for statisticians,” Biometrika, vol. 102, pp. 315–323, 2015

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.