REVIEW 3 major objections 5 minor 25 references
Transient Error Analysis of the LMS and RLS Algorithm for Graph Signal Estimation
T0 review · 3 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read This paper derives closed-form time-dependent mean-square deviation formulas for the GSP LMS and GSP RLS adaptive graph-signal estimators under Gaussian noise, fixed spectral parameter, and fixed sampling set.
desk verdict The new transient MSD formulas for GSP LMS/RLS rest on an invalid collapse of the noise history into a single w(t), so the main result does not follow. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The carrying object is the graph-frequency error recursion. For GSP LMS, $\Delta\hat{\mathbf{s}}_F(t+1) = \mathbf{A}\Delta\hat{\mathbf{s}}_F(t) + \mu\mathbf{U}_F^T\mathbf{D}_S\mathbf{w}(t)$ with $\mathbf{A}=\mathbf{I}-\mu\mathbf{U}_F^T\mathbf{D}_S\mathbf{U}_F$; for GSP RLS, $\Delta\hat{\mathbf{s}}_F(t+1) = \lambda\Delta\hat{\mathbf{s}}_F(t) + (1-\lambda)\mathbf{M}\mathbf{U}_F^T\mathbf{D}_S\mathbf{C}_w^{-1}\mathbf{w}(t)$. Mathematical induction expands the recursion into a sum of matrix powers applied to past noise terms, and the paper evaluates the sum with the geometric-series identity involving $(\mathbf{I}-\mathbf{A})^{-1}$. The independence assumptions A1–A5 let the expectation of the squared error factor into terms involving the noise covariance $\mathbf{C}_w$, producing the closed-form $\mathrm{GMSD}(t)$ expressions.
What would settle it
Recompute the transient expectation without collapsing the sum $\sum_{j=0}^{t-1}\mathbf{A}^{t-1-j}\mathbf{U}_F^T\mathbf{D}_S\mathbf{w}(j)$ into a single $\mathbf{w}(t)$ term, and compare the resulting $\mathrm{GMSD}(t)$ with equation (17); any difference at early times settles the matter. Concretely, simulate GSP LMS with white Gaussian noise ($\mathbf{C}_w=\sigma^2\mathbf{I}$), average 50 or more runs, and check whether the empirical MSD matches equation (17) at $t=2,3,4$ or instead follows the unreduced sum.
Extended reading notes
Core claim
The paper's central claim is that the transient estimation error of the GSP LMS and GSP RLS algorithms can be expressed in closed form at every time instant $t$. Working in the graph-frequency domain, the paper represents the error $\Delta \hat{\mathbf{s}}_F(t)$ as a sum of powers of the update matrix $\mathbf{A} = \mathbf{I} - \mu \mathbf{U}_F^T \mathbf{D}_S \mathbf{U}_F$ acting on the initial error plus an accumulated noise term, and similarly for RLS with $\lambda$ and $\mathbf{M}$. Using the matrix geometric-series identity $(\mathbf{I} - \mathbf{A})^{-1}$, it converts that sum into formulas (17) and (22) for $\mathrm{GMSD}(t)$ that depend only on the noise covariance $\mathbf{C}_w$, the graph structure $\mathbf{U}_F$, the sampling matrix $\mathbf{D}_S$, the step size $\mu$ (or forgetting factor $\lambda$), and $t$. Simulations on the Brazilian temperature dataset with three Gaussian noise settings are presented as verification.
Load-bearing premise
The formulas hinge on treating the whole history of noise samples as a single current noise vector when summing powers of the update matrix; if that step is not valid for the independent noise used in the experiments, the closed-form transient error is not the true expectation.
Editorial extensions
If this is right
- GSP LMS and GSP RLS convergence can now be predicted quantitatively at every iteration, not just in steady state, for the fixed-graph, known-covariance setting.
- The formulas expose how step size $\mu$ and forgetting factor $\lambda$ shape the transient trajectory, so parameter choices can be tuned to a target convergence time or overshoot.
- Because the expressions depend only on second-order noise statistics, the analysis covers the Gaussian scenarios tested and gives a benchmark for comparing graph adaptive filters.
- Simulated MSD curves can be checked against equations (17) and (22) for other graphs, sampling sets, and noise covariance matrices without rerunning the derivation.
Reading between the lines
- Editorial inference: the same induction-plus-geometric-sum argument should extend to any noise process with finite covariance matrix, since the final formulas rely on $\mathbf{C}_w$ rather than on Gaussianity itself; the paper's Gaussian assumption may be stronger than its algebra requires.
- Editorial inference: differentiating $\mathrm{GMSD}(t)$ with respect to $t$ or to $\mu$ could yield closed-form convergence-rate and optimal-step-size conditions that the paper does not state.
- Editorial inference: the paper's own closing remark that time-varying $F$ and sampling set remain future work is a real limit: if $\mathbf{U}_F$ changes between iterations, the geometric-series collapse at the heart of equations (17) and (22) no longer applies.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper aims to derive closed-form transient mean-square-deviation (GMSD) expressions for the graph-signal LMS and RLS algorithms under Gaussian noise, and to validate these expressions with simulations on the Brazilian temperature dataset. The derivation proceeds by writing the frequency-domain estimation error recursion, applying mathematical induction, and then taking expectations under the stated Gaussian noise covariance. The central claim is that Eqs. (17) and (22) give the time-dependent GMSD for the two algorithms, and that Figs. 3 and 4 demonstrate agreement with 50-run ensemble simulations.
Significance. If correct, the paper would supply a genuinely useful quantitative tool for predicting the transient behavior of graph adaptive filters, complementing existing steady-state analyses. The paper has some praiseworthy features: the theoretical curves are not fitted to the simulations, the noise covariance and algorithm parameters are set independently, and the problem of transient analysis for GSP algorithms is well motivated. However, the central derivation contains a load-bearing error: the convolution over the past noise samples is collapsed into a single noise vector, which is not valid under the stated i.i.d. Gaussian model. Because both claimed GMSD formulas rest on this collapse, the main contribution is not established, and the simulation agreement cannot be interpreted as validation of the proposed theory.
major comments (3)
- [Section III-A, Eqs. (11)-(16)] The transient LMS derivation replaces the weighted sum of distinct past noise samples by a single vector w(t). Starting from the recursion (7), the exact solution is Δs_F(t)=A^{t-1}Δs_F(1)+μ Σ_{j=1}^{t-1} A^{t-1-j} U_F^T D_S w(j). In Eqs. (12)-(13), however, every term of K uses the same w(t), which would be correct only if w(1)=...=w(t). This contradicts assumption A3 and the i.i.d. Gaussian noise used in the simulations. Consequently, the subtraction in (14), the inversion in (15), and the resulting expression (16) solve for a surrogate quantity rather than for the actual weighted noise sum. Under A3, the correct noise covariance is μ^2 Σ_{j=1}^{t-1} A^{t-1-j} U_F^T D_S C_w D_S U_F (A^{t-1-j})^T, a sum of t-1 distinct covariance contributions, not the single C_w block appearing in (17). Therefore Eq. (17) is not the expected GMSD under the stated model.
- [Section III-B, Eqs. (18)-(22)] The RLS derivation contains the same error. The induction from (18)-(20) to (21) keeps only the latest noise term w(t) and drops the λ^{t-1-j}-weighted history of past noise samples. The exact solution of (18) is Δs_F(t)=λ^{t-1}Δs_F(1)+(1-λ)Σ_{j=1}^{t-1} λ^{t-1-j} M U_F^T D_S C_w^{-1} w(j), and the covariance of this term is not the single covariance expression used in (22). As a result, Eq. (22) does not give the expected GMSD for the i.i.d. Gaussian noise process described in Section II and used in the experiments.
- [Section IV, Figs. 3 and 4] Because Eqs. (17) and (22) are derived under a different, effectively constant-noise process, the visual agreement reported in Figs. 3 and 4 cannot validate the proposed theoretical analysis. The manuscript reports no quantitative discrepancy measure, such as relative error, mean absolute error, or confidence intervals for the 50-run averages, so the claim of a 'better match' is not supported by any statistic. The simulations would need to be compared against the corrected transient expressions to test the theory.
minor comments (5)
- [Section II, Eq. (5)] The notation for the performance metric is inconsistent: the text defines GMSD(t) in (5), but Eq. (6) and later equations use Δs_F(t) without a clear definition, and Eq. (23) plots a version scaled by 10 log10. Please define all symbols precisely and state whether the figures plot dB values.
- [Section IV, Eq. (24)] The definition of C_w in (24) is ambiguous: a is described as a vector whose components satisfy a Gaussian distribution, while diag(aN_a+bN_b) suggests a deterministic diagonal matrix. Please clarify whether a is a random vector realization or a parameter, and ensure that the resulting covariance matrix is positive definite in all three scenarios.
- [Section III, Eqs. (12)-(17)] The equations in Section III contain numerous typographical and formatting problems (missing subscripts, misplaced matrix products, garbled diag and sqrt terms). These need a careful rewrite, independent of the technical issue above, because they make the derivation difficult to follow.
- [Section IV, Cases I and II] The experimental setup specifies K, F, and |S|, but not which nodes are sampled or how the graph shift/adjacency matrix is constructed from the temperature stations. This information is needed for reproducibility and for checking that the constants in the theory match the simulations.
- [Section V, Conclusion] The conclusion lists only time-varying F and sampling set as future work, but the manuscript also relies on the Gaussian noise assumption and on the independence assumption A2, whose role in the derivation should be discussed more carefully.
Circularity Check
No significant circularity: the transient GMSD derivations follow (or attempt to follow) from the algorithm recursions and the stated noise covariance, with no fitted parameters or load-bearing self-citations.
full rationale
The paper's central product is a closed-form transient GMSD expression for GSP LMS and GSP RLS. The derivation starts from the published update recursions in Eqs. (3)-(4), defines the frequency-domain error Δs_F(t), and under stated assumptions A1-A5 (including Gaussian noise with covariance C_w) derives E[||Δs_F(t)||^2]. The theoretical curves are evaluated using the same user-set step sizes/forgetting factors and the same noise covariance used to generate the simulated noise; this is standard model evaluation, not fitting the predicted curve to the measured curve. No parameter is calibrated to make the theory match the simulations. The paper's citations to [11], [19], [21], [22] provide background or prior algorithm definitions; the transient-error induction in Section III does not reduce to any of those cited results, and no uniqueness or existence claim is imported from the authors' own prior work to force the chosen formulas. The obvious weakness in the manuscript is a derivation error, not circularity: in Eq. (12) the authors collapse the history of i.i.d. noise samples w(1),...,w(t) into a single w(t), so the geometric-series step (14) does not follow under A3 and the resulting GMSD(t) in Eqs. (17) and (22) is not the expectation of the true transient error. That is a correctness or derivability defect, not a self-referential reduction: the intended derivation is genuinely attempting to compute a new quantity from independent inputs. The conclusion also honestly records that the analysis is limited to fixed F and S. Accordingly, the circularity score is 0.
Assumptions & free parameters
assumptions (6)
- domain assumption A1: The graph signal is bandlimited or sparse in the graph structure.
- domain assumption A2: U_F, Delta(s_F)(t), and s_F are independent of each other.
- domain assumption A3: w(t) is zero-mean Gaussian noise with covariance E[w(t) w(t)^T] = C_w.
- domain assumption A4: F is fixed, so U_F is a constant matrix.
- domain assumption A5: S is fixed, so the sampling matrix D_S is constant.
- ad hoc to paper Implicit assumption: noise samples at different time instants are interchangeable, so w(2)=...=w(t) when summing the transient terms.
Cite this review
Pith. "Pith review of Transient Error Analysis of the LMS and RLS Algorithm for Graph Signal Estimation." pith.science (2026). https://pith.science/paper/TCEBQDIZ
@misc{pith2026250600403,
author = {Pith},
title = {Pith review of: Transient Error Analysis of the LMS and RLS Algorithm for Graph Signal Estimation},
year = {2026},
howpublished = {\url{https://pith.science/paper/TCEBQDIZ}},
note = {Machine review of arXiv:2506.00403}
}
read the original abstract
Recently, the proposal of the least mean square (LMS) and recursive least squares (RLS) algorithm for graph signal processing (GSP) provides excellent solutions for processing signals defined on irregular structures such as sensor networks. The existing work has completed the steady state error analysis of the GSP LMS algorithm and GSP RLS algorithm in Gaussian noise scenarios, and a range of values for the step size of the GSP LMS algorithm has also been given. Meanwhile, the transient error analysis of the GSP LMS algorithm and GSP RLS algorithm is also important and challenging. Completing the above work will help to quantitatively analyze the performance of the graph signal adaptive estimation algorithm at transient moments, which is what this paper is working on. By using formula derivation and mathematical induction, the transient errors expressions of the GSP LMS and GSP RLS algorithm are given in this paper. Based on the Brazilian temperature datasets, the related simulation experiments are executed, which strongly demonstrate the correctness of our proposed theoretical analysis
Figures
Reference graph
Works this paper leans on
-
[1]
D. Y. Wu, T. -H. Lin, X. -R. Zhang, C. -P. Chen, J. -H. Chen and H. -H. Chen, "Detecting Inaccurate Sensors on a Large -Scale Sensor Network Using Centralized and Localized Graph Neural Networks," IEEE S en- sors Journal, vol. 23, no. 15, pp. 16446-16455, 1 Aug.1, 2023
work page 2023
-
[2]
G. Jiang, W. Li, W. Fan, Q. He and P. Xie, "TempGNN: A Tempera- ture-Based Graph Neural Network Model for System -Level Monitoring of Wind Turbines With SCADA Data," IEEE Sensors Journal, vol. 2 2, no. 23, pp. 22894-22907, 1 Dec.1, 2022
work page 2022
-
[3]
K. Wang, J. An, M. Zhou, Z. Shi, X. Shi and Q. Kang, "Minority - Weighted Graph Neural Network for Imbalanced Node Classification in Social Networks of Internet of People," IEEE Internet of Things Journal, vol. 10, no. 1, pp. 330-340, 1 Jan.1, 2023
work page 2023
-
[4]
A. Sandryhaila, J.M.F. Moura, Big data analysis with signal processing on graphs: representation and processing of massive data sets with irreg- ular structure, IEEE Signal Process. Mag. 31 (5) (2014) 80–90
work page 2014
- [5]
-
[6]
D.I. Shuman, S.K. Narang, P. Frossard, A. Ortega, P. Vandergheynst, The emerging field of signal processing on graphs: extending high - dimensional data analysis to networks and other irregular domains, IEEE Signal Process. Mag. 30 (3) (2013) 83–98
work page 2013
-
[7]
A. Sandryhaila, J.M.F. Moura, Discrete signal processing on graphs: frequency analysis, IEEE Trans. Sign al Process. 62 (12) (2014) 3042 – 3054
work page 2014
-
[8]
P. Lorenzo, S. Barbarossa, P. Banelli, Chapter 9 - sampling and recovery of graph signals, in: P.M. Djuric, ´ C. Richard (Eds.), Cooperative and Graph Signal Processing, Academic Press, 2018, pp. 261–282
work page 2018
Show all 25 references
-
[9]
S. Chen, R. Varma, A. Sandryhaila, J. Kovacevi ˇ c, ´ Discrete signal processing on graphs: sampling theory, IEEE Trans. Signal Process. 63 (24) (2015) 6510–6523
2015
-
[10]
Normalized LMS algorithm and data-selective strategies fo r adaptive graph signal estimation,
M. J. M. Spelta and W. A. Martins, “Normalized LMS algorithm and data-selective strategies fo r adaptive graph signal estimation,” Signal Process., vol. 167, Feb. 2020, Art. no. 107326
2020
-
[11]
Adaptive Least Mean Squares Estimation of Graph Signals,
P. Di Lorenzo, S. Barbarossa, P. Banelli and S. Sardellitti, "Adaptive Least Mean Squares Estimation of Graph Signals," IEEE Transactions on Signal and Information Processing over Networks, vol. 2, no. 4, pp. 555-568, Dec. 2016
2016
-
[12]
Distrib- uted recursive least squares strategies for adaptive reconstruction of graph signals,
P. Di Lorenzo, E. Isufi, P. Banelli, S. Barbarossa and G. Leus, "Distrib- uted recursive least squares strategies for adaptive reconstruction of graph signals," 2017 25th European Signal Proces sing Conference (EU- SIPCO), Kos, Greece, 2017, pp. 2289-2293
2017
-
[13]
Adaptive Graph Signal Processing: Algorithms and Optimal Sampling Strategies,
P. Di Lorenzo, P. Banelli, E. Isufi, S. Barbarossa and G. Leus, "Adaptive Graph Signal Processing: Algorithms and Optimal Sampling Strategies," IEEE Transactions on Signal Processing, vol. 66, no. 13, pp. 3584-3598, 1 July1, 2018
2018
-
[14]
Transient Analysis of the Set-Membership LMS Algorithm,
N. N. Siqueira, T. P. Ferreira, L. C. Resende, R. M. S. Pimenta, D. B. Haddad and M. R. Petraglia, "Transient Analysis of the Set-Membership LMS Algorithm," IEEE Communications Letters, vol. 25, no. 4, pp. 1298-1302, April 2021
2021
-
[15]
Transient Performance Anal- ysis of Zero -Attracting LMS,
J. Chen, C. Richard, Y. Song and D. Brie, "Transient Performance Anal- ysis of Zero -Attracting LMS," IEEE Signal Processing Letters, vol. 23, no. 12, pp. 1786-1790, Dec. 2016
2016
-
[16]
Transient behavior of the LMS algorithm: a determinis- tic approach,
P. F. Titchener, "Transient behavior of the LMS algorithm: a determinis- tic approach," International Conference on Acoustics, Speech, and Sig- nal Processing, Albuquerque, NM, USA, 1990, pp. 1491-1494 vol.3
1990
-
[17]
Theoretical Analysis of the Perfor- mance of the Data -Reuse RLS Algorithm,
W. Gao, J. Chen and C. Richard, "Theoretical Analysis of the Perfor- mance of the Data -Reuse RLS Algorithm," IEEE Transactio ns on Cir- cuits and Systems II: Express Briefs, vol. 71, no. 1, pp. 490 -494, Jan. 2024
2024
-
[18]
Transient Perfor- mance Analysis of the ℓ1-RLS,
W. Gao, J. Chen, C. Richard, W. Shi and Q. Zhang, "Transient Perfor- mance Analysis of the ℓ1-RLS," IEEE Signal Processing Letters, vol. 29, pp. 90-94, 2022
2022
-
[19]
A Variable Parameter LMS Algorithm Based on Generalized Maximum Correntropy Criterion for Graph Signal Processing,
H. Zhao, W. X iang and S. Lv, "A Variable Parameter LMS Algorithm Based on Generalized Maximum Correntropy Criterion for Graph Signal Processing," IEEE Transactions on Signal and Information Processing over Networks, vol. 9, pp. 140-151, 2023
2023
-
[20]
Graph signal processing: Overview, challenges, and applications,
A. Ortega, P. Frossard, J. Kovacevic, J. M. F. Moura, and P. Vandergh- eynst, “Graph signal processing: Overview, challenges, and applications,” Proc. IEEE, vol. 106, no. 5, pp. 808–826, May 2018
2018
-
[21]
Graph Diffusion Kernel Maximum Correntropy Criterion Over Sensor Network and Its Performance Analy- sis,
X. Hou, H. Zhao and X. Long, "Graph Diffusion Kernel Maximum Correntropy Criterion Over Sensor Network and Its Performance Analy- sis," IEEE Sensors Journal, vol. 23, no. 13, pp. 14583 -14591, 1 July .1, 2023
2023
-
[22]
Robust Linear -in-the-Parameters Non- linear Graph Diffusion Adaptive Filter Over Sensor Network,
X. Hou, H. Zhao and X. Long, "Robust Linear -in-the-Parameters Non- linear Graph Diffusion Adaptive Filter Over Sensor Network," IEEE Sensors Journal, vol. 24, no. 10, pp. 16710-16720, 15 May.15, 2024
2024
-
[23]
Adaptive sign algorithm for graph signal processing,
Y. Yan, E. E. Kuruoglu, and M. A. Altinkaya, “Adaptive sign algorithm for graph signal processing,” Signal Processing, vol. 200, pp. 108662, 2022
2022
-
[24]
Spelta, W.A
M.J.M. Spelta, W.A. Martins, Online temperature estimation using graph signals, in: XXXVI Simpó sio Brasileiro de Telecomunicaç õ es e Processamento de Sinais - SBrT2018, 2018, pp. 154–158
2018
-
[25]
Spelta, Brazilian Weather Stations, 2018, (http://github.com/ms- pelta/brazilin-weather-stations)
M.J.M. Spelta, Brazilian Weather Stations, 2018, (http://github.com/ms- pelta/brazilin-weather-stations)
2018
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.