REVIEW 2 major objections 2 minor 1 cited by
Reviewed by Pith at T0; open to challenge.
T0 means a machine referee read the full paper against a public rubric. The mark states how deep the mechanical check went, never who wrote it. the ladder, T0–T4 →
T0 review · grok-4.3
LAMG+ achieves full robustness and linear scaling for graph-Laplacian solves by adding two local refinements to Lean Algebraic Multigrid.
2026-06-25 22:44 UTC pith:5UQCBZ7E
load-bearing objection LAMG+ is LAMG plus two local heuristics that fix anisotropy failures on the tested SuiteSparse graphs, with good empirical scaling but no general proof. the 2 major comments →
LAMG+: A Robust Lean Algebraic Multigrid Solver for Graph Laplacians
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
LAMG+ is a lean, parameter-free algebraic multigrid solver for graph-Laplacian systems Lφ = b that converges on all tested graphs with O(m) complexity, where the two refinements of strength-of-connection aggregation veto and selective caliber-2 interpolation resolve the anisotropy failure of the original LAMG.
What carries the argument
strength-of-connection aggregation veto and selective caliber-2 interpolation, which together enforce sufficient interpolation order on anisotropic grids without added parameters or global tuning.
Load-bearing premise
The two local refinements suffice to eliminate the anisotropy failure on all graph families without introducing new failure modes.
What would settle it
A graph Laplacian matrix from a new family where LAMG+ either fails to converge within a reasonable number of cycles or exhibits superlinear scaling with matrix size.
If this is right
- LAMG+ and approximate Cholesky become complementary solvers, with LAMG+ preferred on finite-element matrices.
- Algebraic multigrid can be made robust to all graph families without hidden parameters.
- Linear scaling holds up to matrices with hundreds of millions of nonzeros.
- Only two local changes suffice to restore convergence factors from 0.99 to 0.11 on problematic cases.
Where Pith is reading between the lines
- If the refinements generalize, similar local fixes may improve other AMG variants on anisotropic problems.
- Applications in spectral clustering and network flows could adopt LAMG+ directly for larger instances.
- Future work could test whether the method extends to non-symmetric or indefinite systems.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript presents LAMG+, a Julia re-derivation of Lean Algebraic Multigrid (LAMG) augmented by two local refinements (strength-of-connection aggregation veto and selective caliber-2 interpolation) for solving graph-Laplacian systems Lφ=b. It claims that LAMG+ is parameter-free, achieves 100% convergence with median 4 cycles on the full 1,711-graph SuiteSparse collection (verified to 2.4×10^8 nonzeros), exhibits empirical O(m) scaling (log-log slope 1.01), and is the fastest robust solver and most memory-frugal on finite-element/structural matrices while being complementary to approximate-Cholesky (AC) on social/citation graphs; only LAMG+ and AC converge across all 13 test classes. A Local Fourier Analysis is used to diagnose and correct an interpolation-order deficit on grid-aligned anisotropy.
Significance. If the empirical performance and robustness claims hold under independent verification, LAMG+ would constitute a practical advance for large-scale graph-Laplacian problems in spectral clustering, semi-supervised learning, and finite-element analysis by supplying a lean, memory-efficient alternative that complements AC and demonstrates linear complexity on an unusually large public benchmark.
major comments (2)
- [Abstract / robustness section] Abstract and robustness discussion: the central claim that the two local refinements suffice to eliminate all anisotropy-induced failures (and yield 100% convergence) for arbitrary graph Laplacians rests on LFA restricted to grid-aligned anisotropy (factor ≈0.99→0.11) plus empirical success on 13 classes and the SuiteSparse collection; no general argument or proof is supplied that these heuristics cover non-grid, multi-directional, or irregular-connectivity anisotropy without introducing new failure modes.
- [Abstract] Linear-scaling claim (Abstract): the reported log-log slope of 1.01 and O(m) behavior on the full 1,711-graph set are presented without accompanying details on timing methodology, error-bar computation, data-exclusion rules, or post-processing steps, which are required to confirm that the scaling result is free of selection bias.
minor comments (2)
- [Abstract] The manuscript states that unmodified LAMG 2.2.1 converges under the authors' conditions, overturning prior non-convergence reports, but does not supply the precise parameter settings or stopping criteria used in that re-run for direct comparison.
- [Methods / refinements description] Notation for the two refinements (strength-of-connection veto and selective caliber-2 interpolation) is introduced without an explicit algorithmic listing or pseudocode block, making reproduction from the text alone difficult.
Simulated Author's Rebuttal
We thank the referee for the constructive feedback on our manuscript. We address each major comment point by point below, providing clarifications and indicating where revisions will be made to strengthen the presentation without altering the core claims.
read point-by-point responses
-
Referee: [Abstract / robustness section] Abstract and robustness discussion: the central claim that the two local refinements suffice to eliminate all anisotropy-induced failures (and yield 100% convergence) for arbitrary graph Laplacians rests on LFA restricted to grid-aligned anisotropy (factor ≈0.99→0.11) plus empirical success on 13 classes and the SuiteSparse collection; no general argument or proof is supplied that these heuristics cover non-grid, multi-directional, or irregular-connectivity anisotropy without introducing new failure modes.
Authors: The manuscript's robustness claims are grounded in two elements: (i) Local Fourier Analysis that diagnoses and quantifies the interpolation-order deficit specifically for grid-aligned anisotropy, and (ii) exhaustive empirical verification showing 100% convergence across the full 1,711-graph SuiteSparse collection (covering 13 classes with diverse connectivity patterns, including irregular and multi-directional cases). We do not claim or supply a general theoretical proof that the two local refinements eliminate every conceivable anisotropy failure mode for arbitrary graphs; such a proof is beyond the scope of the work and remains an open question in algebraic multigrid theory. The refinements are presented as targeted, parameter-free heuristics that resolve the identified failure while adding negligible cost. We will revise the abstract and robustness discussion to explicitly qualify the evidence as LFA-supported plus empirical, removing any phrasing that could be read as implying a universal guarantee. revision: partial
-
Referee: [Abstract] Linear-scaling claim (Abstract): the reported log-log slope of 1.01 and O(m) behavior on the full 1,711-graph set are presented without accompanying details on timing methodology, error-bar computation, data-exclusion rules, or post-processing steps, which are required to confirm that the scaling result is free of selection bias.
Authors: The full manuscript contains a dedicated experimental methodology section that specifies the timing protocol (wall-clock on a fixed platform, median of three runs per graph to reduce noise), the regression procedure for the log-log slope, the fact that no graphs were excluded (all 1,711 converged), and the absence of post-processing filters. To make this transparent at the abstract level, we will add a concise parenthetical note or footnote referencing the methodology section and confirming that the reported slope uses the complete dataset with no selection bias. This addresses the request for explicit details without lengthening the abstract substantially. revision: yes
Circularity Check
No circularity; claims rest on external benchmarks and standard LFA
full rationale
The paper's central claims (linear scaling, 100% convergence on SuiteSparse, robustness via two local refinements) are established by direct empirical timing on the external 1,711-graph SuiteSparse collection and by Local Fourier Analysis on grid anisotropy. No parameter is fitted to a subset and then relabeled as a prediction; no derivation reduces to a self-citation chain or self-definition; the refinements are presented as explicit, lean changes whose effect is measured on the benchmark set. The derivation chain is therefore self-contained against external data and does not exhibit any of the enumerated circular patterns.
Axiom & Free-Parameter Ledger
axioms (2)
- domain assumption Graph Laplacians are symmetric positive semi-definite with known null-space structure
- standard math Local Fourier Analysis on model anisotropic grids predicts the interpolation-order deficit
read the original abstract
Graph-Laplacian systems $L\phi=b$ underlie spectral clustering, semi-supervised learning, finite-element analysis, and network-flow solvers. We present LAMG+, a lean, parameter-free, empirically linear-time algebraic multigrid solver: a Julia re-derivation of Lean Algebraic Multigrid (LAMG) with two targeted refinements. We establish three facts. (1) Benchmarking against approximate-Cholesky (AC) and four other solvers (BoomerAMG, PETSc GAMG, pyAMG, CMG): LAMG+ and AC are complementary peers -- AC is faster on social/citation graphs; LAMG+ is faster on finite-element/structural matrices (fastest robust solver, most memory-frugal, $2.2\times$ faster than the robust AC variant on large graphs). Only LAMG+ and AC converge across all 13 test classes; the others fail or slow by an order of magnitude off their home turf. (2) Linear scaling: LAMG+ is empirically $O(m)$ with $m$ nonzeros over the full 1,711-graph SuiteSparse set (100% converged, median 4 cycles, log-log slope 1.01), verified up to $2.4\times 10^8$ nonzeros. (3) Robustness: prior benchmarking reported LAMG non-convergent on certain families; running the unmodified LAMG 2.2.1 under identical conditions establishes full convergence, indicating an evaluation artifact. A Local Fourier Analysis proves a strict interpolation-order deficit on grid-aligned anisotropy. Two lean local refinements -- a strength-of-connection aggregation veto and selective caliber-2 interpolation -- resolve LAMG's anisotropy failure (convergence factor $\approx 0.99 \to 0.11$) with negligible overhead.
Figures
Forward citations
Cited by 1 Pith paper
-
NLF: A Resistor-Network Framework and Linear-Time Solver for Convex Network-Flow Equilibria
NLF unifies convex network-flow problems under a nonlinear graph Laplacian model and solves them empirically in linear time using a few calls to near-linear Laplacian solvers.
Reference graph
Works this paper leans on
-
[1]
O. E. Livne and A. Brandt,Lean Algebraic Multigrid (LAMG): Fast Graph Laplacian Linear Solver, SIAM J. Sci. Comput.34(4), B499–B522, 2012
2012
-
[2]
D. A. Spielman,Algorithms, Graph Theory, and Linear Equations in Laplacian Matri- ces, Proc. ICM, 2010
2010
-
[3]
E. G. Boman, B. Hendrickson, and S. Vavasis,Solving elliptic finite element systems in near-linear time with support preconditioners, SIAM J. Numer. Anal.46(6), 2008
2008
-
[4]
S. I. Daitch and D. A. Spielman,Faster approximate lossy generalized flow via interior point algorithms, STOC, 2008
2008
-
[5]
A. Y. Ng, M. I. Jordan, and Y. Weiss,On spectral clustering: analysis and an algorithm, NeurIPS, 2002
2002
-
[6]
Fiedler,Algebraic connectivity of graphs, Czechoslovak Math
M. Fiedler,Algebraic connectivity of graphs, Czechoslovak Math. J.23, 1973
1973
-
[7]
T. A. Davis,Direct Methods for Sparse Linear Systems, SIAM, 2006 (CHOLMOD)
2006
-
[8]
George,Nested dissection of a regular finite element mesh, SIAM J
A. George,Nested dissection of a regular finite element mesh, SIAM J. Numer. Anal. 10(2), 1973
1973
-
[9]
R. J. Lipton, D. J. Rose, and R. E. Tarjan,Generalized nested dissection, SIAM J. Numer. Anal.16(2), 1979
1979
-
[10]
D. A. Spielman and S.-H. Teng,Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems, SIAM J. Comput.40(4), 2011
2011
-
[11]
J. A. Kelner, L. Orecchia, A. Sidford, and Z. A. Zhu,A simple, combinatorial algorithm for solving SDD systems in nearly-linear time, STOC, 2013
2013
-
[12]
D. A. Spielman et al.,Laplacians.jl(approxChol); R. Kyng and S. Sachdeva,Approxi- mate Gaussian elimination for Laplacians, FOCS, 2016
2016
- [13]
-
[14]
C. Chen, T. Liang, and G. Biros,RCHOL: randomized Cholesky factorization for solving SDD linear systems, SIAM J. Sci. Comput.43(6), 2021
2021
-
[15]
Brandt, S
A. Brandt, S. F. McCormick, and J. Ruge,Algebraic multigrid (AMG) for sparse matrix equations, inSparsity and its Applications, Cambridge, 1984
1984
-
[16]
J. W. Ruge and K. St¨ uben,Algebraic multigrid, inMultigrid Methods, SIAM Frontiers in Appl. Math. 3, 1987
1987
-
[17]
Vanˇ ek, J
P. Vanˇ ek, J. Mandel, and M. Brezina,Algebraic multigrid by smoothed aggregation for second and fourth order elliptic problems, Computing56, 1996
1996
-
[18]
Notay,An aggregation-based algebraic multigrid method, ETNA37, 2010
Y. Notay,An aggregation-based algebraic multigrid method, ETNA37, 2010
2010
-
[19]
Napov and Y
A. Napov and Y. Notay,An efficient multigrid method for graph Laplacian systems, ETNA45, 2016; and. . . II: Robust aggregation, SIAM J. Sci. Comput.39(5), 2017
2016
-
[20]
Brannick, Y
J. Brannick, Y. Chen, J. Kraus, and L. Zikatanov,Algebraic multilevel preconditioners for the graph Laplacian based on matching in graphs, SIAM J. Numer. Anal.51(3), 2013
2013
-
[21]
B. Lee,Bringing physics into the coarse-grid selection: approximate diffusion- distance/effective-resistance measures for network analysis and algebraic multigrid for graph Laplacians, Numer. Linear Algebra Appl.31(2), 2024
2024
-
[22]
J. Chen, Y. Saad, and Z. Zhang,Graph coarsening: from scientific computing to ma- chine learning, SeMA J.79(1), 187–223, 2022
2022
- [23]
-
[24]
He,An algebraic multigrid method for solving the Laplacian equations used in image analysis, project report, Dept
X. He,An algebraic multigrid method for solving the Laplacian equations used in image analysis, project report, Dept. of Information Technology, Uppsala University
-
[25]
Brandt, J
A. Brandt, J. Brannick, K. Kahl, and I. Livshits,Bootstrap AMG, SIAM J. Sci. Comput. 33(2), 2011
2011
-
[26]
D. Ron, I. Safro, and A. Brandt,Relaxation-based coarsening and multiscale graph organization, Multiscale Model. Simul.9(1), 2011
2011
-
[27]
I. Luz, M. Galun, H. Maron, R. Basri, and I. Yavneh,Learning algebraic multigrid using graph neural networks, ICML, 2020
2020
-
[28]
Koutis, G
I. Koutis, G. L. Miller, and D. Tolliver,Combinatorial preconditioners and multilevel solvers for problems in computer vision and image processing, Comput. Vis. Image Underst.115(12), 2011
2011
-
[29]
N. Bell, L. N. Olson, J. Schroder, and B. Southworth,PyAMG: algebraic multigrid solvers in Python, J. Open Source Softw.8(87), 2023
2023
-
[30]
V. E. Henson and U. M. Yang,BoomerAMG: a parallel algebraic multigrid solver and preconditioner, Appl. Numer. Math.41(1), 2002
2002
-
[31]
Brandt,Multigrid Techniques: 1984 Guide with Applications to Fluid Dynamics, GMD-Studie 85, 1984; reissued SIAM, 2011
A. Brandt,Multigrid Techniques: 1984 Guide with Applications to Fluid Dynamics, GMD-Studie 85, 1984; reissued SIAM, 2011
1984
-
[32]
O. E. Livne,LAMG+: open-source Julia implementation with all benchmark scripts, https://github.com/orenlivne/lamgplus, 2025
2025
-
[33]
M. A. Christie and M. J. Blunt,Tenth SPE comparative solution project: a comparison of upscaling techniques, SPE Reservoir Eval. & Eng.4(4), 308–317, 2001 (the SPE10 benchmark; public permeability field)
2001
-
[34]
N. Bell, S. Dalton, and L. N. Olson,Exposing fine-grained parallelism in algebraic multigrid methods, SIAM J. Sci. Comput.34(4), C123–C152, 2012
2012
-
[35]
A. H. Baker, R. D. Falgout, T. V. Kolev, and U. M. Yang,Scaling hypre’s multigrid solvers to 100,000 cores, inHigh-Performance Scientific Computing, Springer, 2012
2012
-
[36]
Naumov et al.,AmgX: a library for GPU accelerated algebraic multigrid and pre- conditioned iterative methods, SIAM J
M. Naumov et al.,AmgX: a library for GPU accelerated algebraic multigrid and pre- conditioned iterative methods, SIAM J. Sci. Comput.37(5), S602–S626, 2015. 20O. E. LIVNE
2015
-
[37]
Adams, M
M. Adams, M. Brezina, J. Hu, and R. Tuminaro,Parallel multigrid smoothing: polyno- mial versus Gauss–Seidel, J. Comput. Phys.188(2), 593–610, 2003
2003
-
[38]
Cuthill and J
E. Cuthill and J. McKee,Reducing the bandwidth of sparse symmetric matrices, in Proc. 24th National Conference of the ACM, 1969, pp. 157–172
1969
-
[39]
Karypis and V
G. Karypis and V. Kumar,A fast and high quality multilevel scheme for partitioning irregular graphs, SIAM J. Sci. Comput.20(1), 359–392, 1998
1998
-
[40]
G. Ke, Q. Meng, T. Finley, T. Wang, W. Chen, W. Ma, Q. Ye, and T.-Y. Liu,Light- GBM: a highly efficient gradient boosting decision tree, inAdvances in Neural In- formation Processing Systems (NeurIPS)30, 2017
2017
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.