REVIEW 1 major objections 4 minor 35 references
Learning Linearized Models from Nonlinear Systems under Initialization Constraints with Finite Data
T0 review · 1 major / 4 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read This paper proves that restart experiments with deterministic initial perturbations can consistently recover the linear part of a nonlinear system, at a worst-case rate of $O(N^{-1/4})$ when the feasible region contains the origin.
desk verdict Useful and well-scoped paper on learning linearized models under initialization constraints, but Theorem 1's printed noise bound has a 1/q scaling slip that makes the advertised O(N^{-1/4}) consistency false as written; the fix is straightforward and the underlying idea is sound. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the Taylor decomposition of the nonlinear map around the origin, $x_{k+1} = \Theta z_k + w_k + r_k$ with $\Theta = [A\;B]$ and remainder $r_k = h(z_k)$ whose components are bounded by $\beta\|z_k\|_1^2$ (Assumption 1). Algorithm 1's sign-alternating deterministic perturbations $\pm q e_i$ around $m$ are the second piece: they make the design covariance $ZZ'$ well conditioned, with $\lambda_{\min}(ZZ') \ge Nq^2/[2(n+p)]$ (Lemma 1), while the sign changes cancel the center $m$ in cross terms; this is what lets small $q$ keep the nonlinearity bias low without losing persistent excitation. Algorithm 2's regularized least squares with ridge parameter $\lambda$ produces the closed-form estimator, and the proof decomposes the error via the triangle inequality into a bias term from $\lambda$, a nonlinearity term from $RZ'(ZZ'+\lambda I)^{-1}$, and a noise term bounded through a sub-Gaussian self-normalized martingale inequality. The regularization parameter is not merely numerical: it damps the noise and nonlinearity terms at the cost of an irreducible $\|\Theta\|$ bias.
What would settle it
Run the scalar system $x_{k+1} = x_k + x_k^2 + w_k$ with $\Theta = 1$, small sub-Gaussian noise variance, $m=0$, $\lambda=0$, and $q = c_0 N^{-1/4}$. If the empirical $\|\hat{\Theta} - 1\|$ across many independent trials fails to shrink at the predicted $O(N^{-1/4})$ rate as $N$ grows, or fails to shrink to zero in the noiseless case, then the claimed consistency rate and bound are disproved.
Extended reading notes
Core claim
The paper's central claim is Theorem 1: under Assumption 2, meaning that the deterministic points $m \pm q e_i$ lie in the feasible region $S$, and under Assumption 1, meaning that the Taylor remainder $r_k$ satisfies $|r_{i,k}| \le \beta \|z_k\|_1^2$ near the origin, the regularized least-squares estimate $\hat{\Theta} = XZ'(ZZ' + \lambda I)^{-1}$ produced by Algorithms 1 and 2 satisfies, with probability at least $1-\delta$, a three-term error bound. The noise term scales roughly like $\sigma_w/(q\sqrt{N})$, the nonlinearity term like $\beta q$, and the regularization term like $\lambda\|\Theta\|$ divided by the covariance size. The author's conclusion is that consistent learning of the linearized dynamics is possible with finitely many short trajectories even when the nonlinearity is not globally Lipschitz: when $S$ is open and contains $0$, taking $m=0$, $\lambda=0$, and $q = c_0 N^{-1/4}$ yields $\|\hat{\Theta} - \Theta\| = O(N^{-1/4})$. The same framework yields small error for convex feasible regions that do not contain the origin, provided the center $m$ is close enough to $0$ and $N$ is large, and for perfectly linear systems the bound reduces to an $O(1/\sqrt{N})$ rate comparable with existing random-input results.
Load-bearing premise
The guarantee rests on resetting each experiment's initial state and input exactly to the deterministic points $m \pm q e_i$; if initializations are only approximate, the proof's covariance lower bound and nonlinearity remainder bound no longer follow.
Editorial extensions
If this is right
- Engineers can obtain a certified linear model for controller design using many one-step restart experiments, and the guarantee holds regardless of the spectral radius of $A$, so even unstable nonlinear systems are in scope.
- When initialization can reach a neighborhood of the reference point, the perturbation size $q$ should be chosen to balance noise and nonlinearity; a default of $q \propto N^{-1/4}$ gives guaranteed worst-case consistency at rate $O(N^{-1/4})$.
- In the special case of perfectly linear dynamics, the bound reproduces the $O(1/\sqrt{N})$ sample complexity of established multiple- and single-trajectory linear identification methods, so the approach does not sacrifice the linear benchmark.
- If the feasible region excludes the origin, the center $m$ should be as close to the origin as constraints allow, and a larger regularization $\lambda$ becomes useful when noise, nonlinearity, or distance from the origin is large.
- State predictions from the learned model are close to the true nonlinear map near the origin, with prediction error dominated by the identification error $\|\hat{\Theta} - \Theta\|$ rather than by the nonlinear terms when $\|z\|$ is small (Proposition 1).
Reading between the lines
- Beyond the paper: the same alternating-perturbation design should extend to estimating the quadratic term of the Taylor expansion, since finite-difference combinations of the one-step outputs isolate second-order coefficients; this would give a direct data-driven check of Assumption 1's constant $\beta$.
- Beyond the paper: a fully adaptive experiment could choose $q$ per batch by estimating the noise variance and nonlinearity curvature from earlier batches, potentially achieving faster than worst-case convergence; Theorem 1's trade-off suggests this is feasible but does not analyze it.
- Beyond the paper: with inexact initialization modeled as an extra bounded disturbance, the two proofs that fail (Lemma 1 and Lemma 3) could be patched by adding an initialization-error term to the bound; the numerical robustness shown in Section 5.1 is evidence this patch would work, but the paper leaves the proof open.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper studies finite-sample identification of the linearized dynamics Theta = [A B] of a discrete-time nonlinear system x_{k+1} = f(x_k,u_k) + w_k around the origin, under the constraint that experiments can only be initialized inside a feasible set S. It proposes a deterministic multi-trajectory data acquisition scheme (Algorithm 1) that cyclically initializes the state-input vector at m +/- q e_i within S, followed by a regularized least-squares estimator (Algorithm 2). The main result (Theorem 1) bounds ||hat Theta - Theta|| by three terms: a noise term, a nonlinearity term, and a regularization term. The paper claims that when S is an open set containing the origin, choosing q proportional to N^{-1/4} gives consistency at rate O(N^{-1/4}), and that when S does not contain the origin a small error is still possible if S is close enough to the origin. Numerical experiments on a pendulum-like system and on a strongly nonlinear system illustrate the trade-offs and show better behavior than single-trajectory Gaussian-input identification. The paper explicitly notes that exact resetting is assumed and that initialization perturbations are only tested numerically.
Significance. If the main theorem is corrected, the paper makes a useful contribution: it provides one of the first finite-sample guarantees for learning a local linear model of a nonlinear stochastic system with a constrained initialization region, without requiring global Lipschitzness of the unmodeled dynamics. The decomposition of the error into noise, nonlinearity, and regularization terms is clean, the data acquisition scheme is simple and deterministic, and the numerical experiments support the qualitative predictions. The proofs are self-contained in the appendix, including persistent excitation, sub-Gaussian concentration, and Taylor remainder bounds. The exact-initialization limitation is disclosed honestly, and robustness to initialization jitter is offered only as empirical evidence. The claimed O(N^{-1/4}) rate, if supported, would be a useful improvement over the existing practice for nonlinear system identification.
major comments (1)
- [Theorem 1, Eq. (8)] The displayed "Error due to noise" term contains a spurious factor 1/q and an inconsistent denominator. In the proof, Eqs. (9)-(10) combined with Lemma 2 and Lemma 1 give the noise contribution bounded by 3 sigma_w sqrt(log(9n/delta) + (n+p) log(1 + ...)) / sqrt(N q^2/(2(n+p)) + lambda), with no 1/q factor. For m = 0 and lambda = 0, the printed term scales as 1/(q^2 sqrt(N)), so the recommended choice q proportional to N^{-1/4} leaves this term O(1), contradicting the claimed O(N^{-1/4}) consistency in Section 4.2. The proof's own bound balances the O(beta q) nonlinearity term exactly at q proportional to N^{-1/4}, so Eq. (8) and the related rate statements in Section 4.2 must be corrected. I recommend replacing the noise term by 3 sigma_w sqrt(L) / sqrt(N q^2/(2(n+p)) + lambda) or an equivalent conservative upper bound without the 1/q factor, and re-deriving the displayed constants in the theorem.
minor comments (4)
- [Section 7.4, proof of Lemma 3] The square-root expression following Eq. (24) is ambiguous as typeset; it should read sqrt(2(n+p)/(N q^2 + 2 lambda (n+p))) + 2 sqrt(lambda)(n+p)/(N q^2 + 2 lambda (n+p)). The current typesetting suggests that the second summand is inside the radical, which is dimensionally inconsistent.
- [Theorem 1, Eq. (8) and Lemma 2] The logarithmic factor in Theorem 1 omits the term zeta = 4 lambda (n+p)/N that appears in the denominator of Lemma 2's log argument. This omission is a valid loosening of the bound, but it should be explicitly acknowledged so that the two displays are visibly consistent.
- [Section 5.1] The numerical robustness experiment adds Gaussian perturbations to the designed initial conditions, but the formal analysis assumes exact resetting. The paper's own caveat at the end of Section 5.1 correctly states that a detailed analysis is left for future work; I recommend making this limitation explicit in the contributions or abstract as well, since the formal guarantee does not cover inexact initialization.
- [Theorem 1, Eq. (8)] The expression sqrt(lambda N n beta^2 b^2 q^4) in the regularization term should be parenthesized or written as sqrt(lambda N n) beta b q^2 to avoid ambiguity about what is inside the radical.
Circularity Check
No significant circularity: the finite-sample bound follows from Taylor's theorem, deterministic persistent excitation, and generic concentration/matrix lemmas, with no fitted parameter renamed as a prediction.
full rationale
The paper's target Θ is defined by the Taylor expansion in Eq. (2), not by the data; Assumption 1 supplies an independent uniform quadratic bound on the remainder. The estimation error decomposition in Eq. (6) is exact algebra from the batch relation X = ΘZ + W + R. Theorem 1 then assembles Lemma 1 (persistent excitation from Algorithm 1's deterministic ±q pattern), Lemma 2 (sub-Gaussian concentration), and Lemma 3 (remainder bound) with explicit constants. The only self-cited ingredients are Lemma 4 and Lemma 6 from [33], which are generic concentration and positive-semidefinite comparison statements whose assumptions do not include the target identification rate, so they constitute independent support rather than a self-referential premise. The paper explicitly acknowledges the exact-initialization limitation in Section 5.1 and leaves initialization-noise analysis to future work; that is a reported limitation, not a circular step. The apparent 1/q factor discrepancy between the displayed noise term of Eq. (8) and the proof's Lemma 2 bound is a correctness/scaling issue, not a case of the conclusion being assumed as an input, and is therefore outside this circularity pass.
Assumptions & free parameters
free parameters (3)
- q
- m
- lambda
assumptions (5)
- domain assumption Each component function of f has continuous second-order partial derivatives, so the Taylor remainder satisfies |r_{i,k}| <= beta ||z_k||_1^2 locally (Assumption 1).
- domain assumption The feasible region S contains the points m +/- q e_i for all i (Assumption 2).
- domain assumption f(0)=0 and the state and input are perfectly measured.
- domain assumption Process noise w_k are independent sub-Gaussian with parameter sigma_w^2.
- standard math Sub-Gaussian concentration inequality (Lemma 4, from the authors' earlier paper [33]) and matrix inequalities (Lemmas 5,6) are correct.
Cite this review
Pith. "Pith review of Learning Linearized Models from Nonlinear Systems under Initialization Constraints with Finite Data." pith.science (2026). https://pith.science/paper/KYKRZXAB
@misc{pith2026250504954,
author = {Pith},
title = {Pith review of: Learning Linearized Models from Nonlinear Systems under Initialization Constraints with Finite Data},
year = {2026},
howpublished = {\url{https://pith.science/paper/KYKRZXAB}},
note = {Machine review of arXiv:2505.04954}
}
read the original abstract
The identification of a linear system model from data has wide applications in control theory. The existing work that provides finite sample guarantees for linear system identification typically uses data from a single long system trajectory under i.i.d. random inputs, and assumes that the underlying dynamics is truly linear. In contrast, we consider the problem of identifying a linearized model when the true underlying dynamics is nonlinear, given that there is a certain constraint on the region where one can initialize the experiments. We provide a multiple trajectories-based deterministic data acquisition algorithm followed by a regularized least squares algorithm, and provide a finite sample error bound on the learned linearized dynamics. Our error bound shows that one can consistently learn the linearized dynamics, and demonstrates a trade-off between the error due to nonlinearity and the error due to noise. We validate our results through numerical experiments, where we also show the potential insufficiency of linear system identification using a single trajectory with i.i.d. random inputs, when nonlinearity does exist.
Figures
Reference graph
Works this paper leans on
-
[33]
Learning dynamical systems by leveraging data from similar systems
Lei Xin, Lintao Ye, George Chiu, and Shreyas Sundaram. Learning dynamical systems by leveraging data from similar systems. arXiv preprint arXiv:2302.04344 , 2023
arXiv 2023
-
[1]
Safely learning dynamical systems from short trajectories
Amir Ali Ahmadi, Abraar Chaudhry, Vikas Sindhwani, and Stephen Tu. Safely learning dynamical systems from short trajectories. In Learning for Dynamics and Control , pages 498–509. PMLR, 2021
work page 2021
-
[2]
State space modeling of time series
Masanao Aoki. State space modeling of time series. Springer Science & Business Media, 2013
work page 2013
-
[3]
The impact of machine learning on economics
Susan Athey. The impact of machine learning on economics. In The economics of artificial intelligence: An agenda , pages 507–547. University of Chicago Press, 2018
work page 2018
-
[4]
Consistency and asymptotic normality of some subspace algorithms for systems without observed inputs
Dietmar Bauer, Manfred Deistler, and Wolfgang Scherrer. Consistency and asymptotic normality of some subspace algorithms for systems without observed inputs. Automatica, 35(7):1243–1254, 1999
work page 1999
-
[5]
Hermitian matrix inequalities and a conjecture
NN Chan and Man Kam Kwong. Hermitian matrix inequalities and a conjecture. The American Mathematical Monthly, 92(8):533–541, 1985
work page 1985
-
[6]
S ¸tefan Cobza¸ s, Radu Miculescu, Adriana Nicolae, et al. Lipschitz functions. Springer, 2019
work page 2019
-
[7]
Introduction to calculus and analysis , volume 1
Richard Courant, Fritz John, Albert A Blank, and Alan Solomon. Introduction to calculus and analysis , volume 1. Springer, 1965
work page 1965
Show all 35 references
-
[8]
On the sample complexity of the linear quadratic regulator
Sarah Dean, Horia Mania, Nikolai Matni, Benjamin Recht, and Stephen Tu. On the sample complexity of the linear quadratic regulator. Foundations of Computational Mathematics, pages 1–47, 2019
2019
-
[9]
Finite time identification in unstable linear systems
Mohamad Kazem Shirani Faradonbeh, Ambuj Tewari, and George Michailidis. Finite time identification in unstable linear systems. Automatica, 96:342–353, 2018
2018
-
[10]
Data-driven sparse system identification
Salar Fattahi and Somayeh Sojoudi. Data-driven sparse system identification. In Proc. Allerton Conference on Communication, Control, and Computing , pages 462–469, 2018
2018
-
[11]
Higher-order derivatives and taylor’s formula in several variables
Gerald B Folland. Higher-order derivatives and taylor’s formula in several variables. Preprint, pages 1–4, 2005
2005
-
[12]
Learning nonlinear dynamical systems from a single trajectory
Dylan Foster, Tuhin Sarkar, and Alexander Rakhlin. Learning nonlinear dynamical systems from a single trajectory. In Learning for Dynamics and Control , pages 851–861. PMLR, 2020
2020
-
[13]
Deep koopman learning of nonlinear time-varying systems
Wenjian Hao, Bowen Huang, Wei Pan, Di Wu, and Shaoshuai Mou. Deep koopman learning of nonlinear time-varying systems. Automatica, 159:111372, 2024
2024
-
[14]
Ridge regression: Biased estimation for nonorthogonal problems
Arthur E Hoerl and Robert W Kennard. Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12(1):55–67, 1970
1970
-
[15]
On consistency of subspace methods for system identification
Magnus Jansson and Bo Wahlberg. On consistency of subspace methods for system identification. Automatica, 34(12):1507–1519, 1998
1998
-
[16]
System identification
Lennart Ljung. System identification. Wiley Encyclopedia of Electrical and Electronics Engineering, pages 1–19, 1999
1999
-
[17]
Active learning for nonlinear system identification with guarantees
Horia Mania, Michael I Jordan, and Benjamin Recht. Active learning for nonlinear system identification with guarantees. arXiv preprint arXiv:2006.10277 , 2020
2006 arXiv
-
[18]
k-fold cross-validation explained in plain english (for evaluating a model’s performance and hyperparameter tuning), 2020
Rukshan Manorathna. k-fold cross-validation explained in plain english (for evaluating a model’s performance and hyperparameter tuning), 2020
2020
-
[19]
Linear identification of nonlinear systems: A lifting technique based on the koopman operator
Alexandre Mauroy and Jorge Goncalves. Linear identification of nonlinear systems: A lifting technique based on the koopman operator. In 2016 IEEE 55th Conference on Decision and Control (CDC), pages 6500–6505. IEEE, 2016
2016
-
[20]
Machine learning , volume 1
Tom Michael Mitchell et al. Machine learning , volume 1. McGraw-hill New York, 2007
2007
-
[21]
Non-asymptotic identification of LTI systems from a single trajectory
Samet Oymak and Necmiye Ozay. Non-asymptotic identification of LTI systems from a single trajectory. In American control conference, pages 5655–5661. IEEE, 2019
2019
-
[22]
Cross- validation
Payam Refaeilzadeh, Lei Tang, and Huan Liu. Cross- validation. Encyclopedia of Database Systems , 5:532–538, 2009
2009
-
[23]
Subgaussian random variables: An expository note
Omar Rivasplata. Subgaussian random variables: An expository note. Internet publication, PDF , 5, 2012
2012
-
[24]
Linear system theory
Wilson J Rugh. Linear system theory . Prentice-Hall, Inc., 1996
1996
-
[25]
Near optimal finite time identification of arbitrary linear dynamical systems
Tuhin Sarkar and Alexander Rakhlin. Near optimal finite time identification of arbitrary linear dynamical systems. In Proc. International Conference on Machine Learning, pages 5610–5618, 2019
2019
-
[26]
Nonparametric system identification of stochastic switched linear systems
Tuhin Sarkar, Alexander Rakhlin, and Munther Dahleh. Nonparametric system identification of stochastic switched linear systems. In Proc. 2019 IEEE 58th Conference on Decision and Control (CDC), pages 3623–3628. IEEE, 2019. 9
2019
-
[27]
Accurate parameter estimation for safety-critical systems with unmodeled dynamics
Arnab Sarker, Peter Fisher, Joseph E Gaudio, and Anuradha M Annaswamy. Accurate parameter estimation for safety-critical systems with unmodeled dynamics. Artificial Intelligence, page 103857, 2023
2023
-
[28]
Non-asymptotic and accurate learning of nonlinear dynamical systems
Yahya Sattar and Samet Oymak. Non-asymptotic and accurate learning of nonlinear dynamical systems. Journal of Machine Learning Research, 23(140):1–49, 2022
2022
-
[29]
Learning linear dynamical systems with semi-parametric least squares
Max Simchowitz, Ross Boczar, and Benjamin Recht. Learning linear dynamical systems with semi-parametric least squares. In Proc. Conference on Learning Theory, pages 2714–2802, 2019
2019
-
[30]
Learning without mixing: Towards a sharp analysis of linear system identification
Max Simchowitz, Horia Mania, Stephen Tu, Michael I Jordan, and Benjamin Recht. Learning without mixing: Towards a sharp analysis of linear system identification. In Proc. Conference On Learning Theory, pages 439–473, 2018
2018
-
[31]
Learning the dynamics of autonomous linear systems from multiple trajectories
Lei Xin, George Chiu, and Shreyas Sundaram. Learning the dynamics of autonomous linear systems from multiple trajectories. In 2022 American Control Conference (ACC) , pages 3955–3960. IEEE, 2022
2022
-
[32]
Learning linearized models from nonlinear systems with finite data
Lei Xin, George Chiu, and Shreyas Sundaram. Learning linearized models from nonlinear systems with finite data. In 2023 62nd IEEE Conference on Decision and Control (CDC), pages 2477–2482. IEEE, 2023
2023
-
[34]
On the sample complexity of decentralized linear quadratic regulator with partially nested information structure
Lintao Ye, Hao Zhu, and Vijay Gupta. On the sample complexity of decentralized linear quadratic regulator with partially nested information structure. IEEE Transactions on Automatic Control, 2022
2022
-
[35]
Non-asymptotic identification of linear dynamical systems using multiple trajectories
Yang Zheng and Na Li. Non-asymptotic identification of linear dynamical systems using multiple trajectories. IEEE Control Systems Letters, 5(5):1693–1698, 2020. 7 Appendix 7.1 Auxiliary Results Lemma 4 ( [33, Lemma 5]) Let {Ft}t≥0 be a filtra- tion. Let{wt}t≥1 be a Rn-valued s...
2020
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.