REVIEW 4 major objections 6 minor 25 references
Matrix Lie Maps and Neural Networks for Solving Differential Equations
T0 review · 4 major / 6 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read For polynomial ODE systems, a polynomial neural network with weights computed directly from the equation implements a matrix Lie map and approximates the general solution without training.
desk verdict A genuinely useful reframing of polynomial networks as truncated matrix Lie maps, with reproducible code, but the experiments never directly measure one-step map error, so the central claim is under-validated. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the matrix Lie map: the evolution operator of the ODE system written as an infinite polynomial series in Kronecker powers of the initial state, $X(t|t_0) = M(t|t_0)\circ X_0 = \sum_{k\ge0} M_{1k} X_0^{[k]}$, where $X^{[k]}$ is the $k$-fold tensor product of the state vector with itself. The identity that carries the argument is the block recurrence $\frac{d}{dt}M_{ik}=\sum_{j=i}^{k}P_{ij}M_{jk}$, with block-diagonal initial conditions, which yields the weight matrices $W_i=M_{1i}$ once the $P_{ij}$ matrices from the polynomial expansion of the right-hand side are known. The network architecture, parallel layers that form Kronecker powers of the input and sum weighted outputs, is an evaluation circuit for this truncated propagator. In data-driven mode the same circuit becomes a model class whose weights are fitted from state transitions, so the Lie-map structure serves as an inductive bias instead of a derived object.
What would settle it
One decisive check: for a polynomial ODE with a known exact solution and a time step larger than the series convergence radius, compute the seventh-order weights from the recurrence and compare one-step predictions with the exact values; if the error does not shrink with increasing order or diverges, the convergence premise fails. A second check for Burgers: compare the semi-discrete 2000-ODE solution with the exact PDE solution on the same 1000-node mesh; if the difference is close to the reported $5.5\times10^{-3}$ MSE, the spatial discretization, not the Lie map, sets the reported accuracy.
Extended reading notes
Core claim
The central discovery is the identification of the polynomial neural network map $Y = W_0 + W_1 X + W_2 X^{[2]} + \cdots + W_k X^{[k]}$ with the truncated matrix Lie map of the differential equation. For a system written as $\frac{d}{dt}X = \sum_{k\ge0} P^1_k(t) X^{[k]}$, the weight matrices $W_i$ are the blocks $M_{1i}$ of the Lie transform, computed from the recurrence $\frac{d}{dt}M_{ik} = \sum_{j=i}^{k} P_{ij}M_{jk}$ with initial blocks $M_{kk}(t_0)=I^{[k]}$. This makes the network a propagator derived from the equation rather than an approximator fitted to solutions: once the weights are computed for a time step, the same map advances every state in the convergence region. For data-driven problems the same polynomial form is fitted to a time series; the Van der Pol experiment trains on one trajectory and reports mean relative errors around $10^{-5}$ on new initial conditions. For Burgers' equation the PDE is semi-discretized into a 2000-dimensional ODE system, and the resulting Lie-map network uses a time step five times larger than the benchmark finite-difference method while reporting lower mean squared error and less elapsed time.
Load-bearing premise
The load-bearing premise is that the truncated polynomial Lie-map series converges to the true solution over the chosen time step; for the Burgers example, an additional load-bearing premise is that the finite-difference spatial semi-discretization accurately represents the PDE, since the paper does not quantify that spatial error.
Editorial extensions
If this is right
- For a known polynomial system, a simulator is obtained without training and without a numerical ODE solver: compute the weights once from the block recurrence, then iterate the polynomial map.
- One network covers all initial conditions in the convergence region; the Van der Pol fits from a single trajectory and produces mean relative errors around $10^{-5}$ for new starting points.
- Accuracy improves with truncation order: the Van der Pol tests report mean relative errors of $1.1\times10^{-2}$, $4\times10^{-4}$, and $4.7\times10^{-6}$ for third-, fifth-, and seventh-order maps.
- For PDEs, the same method applies after semi-discretization; the Burgers example uses a time step five times larger than the benchmark finite-difference scheme and reports lower MSE ($5.5\times10^{-3}$ vs $8.0\times10^{-2}$) and lower elapsed time ($0.016$ s vs $0.055$ s).
- For unknown equations, the same architecture can be fitted directly to time-series data, providing a data-driven model that generalizes to new initial conditions without an assumed analytic form.
Reading between the lines
- If the convergence assumption holds beyond the tested examples, the same construction could act as a coarse propagator for stiff or multiscale systems, since the map is a function of the time step rather than a local discretization; this regime is not examined in the paper.
- For Burgers' equation, the reported MSE conflates Lie-map truncation error with the error of the finite-difference spatial semi-discretization; a clean separation would compare the semi-discrete ODE solution against the exact PDE solution on the same 1000-node mesh.
- The data-driven mode's generalization likely depends on how well one trajectory covers the relevant state space; multi-stable or chaotic systems would require training data that visits the needed regions, an issue the paper lists as open for further research.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript proposes a class of polynomial neural networks whose output is a truncated matrix Lie map (Eq. (4)). For polynomial ODE systems of the form (1), the authors argue that the network weights can be computed directly from the equation via Eq. (3), so that the network approximates the flow map and can be reused for arbitrary initial conditions without retraining. The same architecture is then applied in a data-driven mode, fitting weights from a single observed trajectory. The approach is demonstrated on the Van der Pol oscillator (Section 3) and on Burgers' equation (Section 4), where the PDE is first reduced to a system of ODEs by a finite-difference semi-discretization. The paper concludes that the Lie-map network can outperform traditional step-by-step numerical integration in accuracy and runtime.
Significance. If the central claim is correct, the construction is appealing: for polynomial ODEs, the map weights W_i = M_1i are derived from the equation rather than fitted, the network represents a genuine map rather than a particular solution, and the same computed or trained network can predict dynamics for new initial conditions. The paper also provides reproducible code (Section 5) and tests the data-driven version on initial conditions not seen in training. However, the reported experiments do not yet establish the load-bearing claim: the single-step error of the truncated Lie map is never measured, the convergence region is not characterized, and the Burgers example mixes an unquantified spatial-discretization error with the Lie-map truncation error. The contribution is therefore plausible but currently under-supported.
major comments (4)
- [§3.1, Eq. (4)] The accuracy of the Lie-map network is only reported as a mean relative error of the full trajectory over ten time units (0.0110, 0.0004, and 4.7e-6 for third, fifth, and seventh orders). Because the Van der Pol oscillator is dissipative, trajectories from different initial conditions collapse to the same limit cycle, so trajectory-level agreement can be deceptively good even when the one-step map is inaccurate. The quantity that directly tests the truncation of Eq. (2) is the one-step error ||W0 + W1 X + ... + Wk X[k] - X(Δt|X)||, and it is not reported. Please add the one-step error as a function of truncation order and Δt, and show its behavior over a range of initial conditions.
- [§4.2, Eq. (8)] The PDE-to-ODE conversion in Eq. (8) is not a hyperbolic approximation of Burgers' equation: the right-hand side of Eq. (6) contains both a diffusive term ν u_xx and a convective term u u_x, and after spatial discretization the system for U becomes a method-of-lines semi-discretization rather than ODEs of the form (8) with f(x,U) alone. The paper does not analyze the spatial-truncation error of this semi-discretization, so the MSE of 5.5e-3 reported in Table 2 includes an unquantified component that is not attributable to the Lie map. A spatial-convergence study (varying Δx at fixed Δt and vice versa) is needed before any accuracy comparison with the FDM can be interpreted.
- [§2, Eq. (2)] The central claim that Eq. (4) with weights W_i = M_1i approximates the general solution requires a uniform convergence statement for the truncated series (2) over a known region of initial conditions and for a fixed Δt. The only backing offered is Ref. [17], which is from the same group, and no convergence region or step-size bound is stated for the Van der Pol or Burgers examples. Please either provide a self-contained error bound or a precise statement of the needed theorem, or report an empirical convergence study in Δt and truncation order that maps the region where the one-step map is accurate.
- [Table 2] The comparison in Table 2 is between the Lie-map network with Δt = 1.25e-3 on a 1000x500 mesh and a first-order upwind/Euler FDM with Δt = 2.5e-4 on a 1000x2000 mesh. This does not support the conclusion that the proposed method provides better accuracy with less computational time: the FDM is only first-order accurate, the elapsed times are given without hardware or implementation details, and no refinement study shows how either error scales. A comparison against a higher-order reference solution and a convergence table in both Δx and Δt would be needed.
minor comments (6)
- [General] Please harmonize the terminology: the title and abstract use 'matrix Lie maps' while the body refers to 'matrix Lie transform'.
- [Figures 3-5] Axis labels, legends, and color descriptions are missing or incomplete in several figures; please make the plots self-contained.
- [§3.1-3.2] Please state precisely how the mean relative error is defined (norm, time interval, number of samples), and report per-trajectory errors for the new initial conditions rather than only a pooled mean.
- [Table 2] Please specify the units of the elapsed time, the computing environment, and how the MSE is computed over the spatial grid at t = 0.5.
- [§5] Please include a version or commit hash for the GitHub repository and list the dependencies needed to reproduce the reported numbers.
- [§2.1] The matrices P_ij in Eq. (3) are said to be taken from Ref. [14] but are not defined in the paper; a short definition would make Section 2 self-contained.
Circularity Check
No significant circularity: weights are computed from the ODE by the Lie-map recurrence and validated against independent numerical and analytic benchmarks.
full rationale
The central derivation is not circular. Eq. (4) defines the network output as the truncated Lie map, and Eq. (3) supplies a parameter-free recurrence for the weight matrices from the given ODE (1); nothing is fitted to the target solution in the simulation mode. The Van der Pol simulation is checked against an independent eighth-order Adams integration (Section 3.1), and the data-driven example in Section 3.2 fits one trajectory and then reports errors for new initial conditions, an out-of-sample prediction rather than a renamed fit. The Burgers example computes the Lie-map weights from a semi-discretized ODE system and compares against the analytic solution via MSE at t = 0.5 (Section 4.2, Table 2), so the benchmark is external. The paper relies on prior work for convergence and accuracy theory, including self-citations [14,17], but it also cites the independent Dragt monograph [13] for the same Lie-map machinery; a self-citation alone, without an exhibited reduction of the target claim to its own input, is not circularity under the rules. Validation gaps, such as the absence of a direct one-step error report and the unquantified spatial discretization error for Burgers, are correctness concerns rather than circularity.
Assumptions & free parameters
free parameters (4)
- truncation order k =
3, 5, 7 (Van der Pol); 3 (Burgers)
- time step Δt =
0.01 (Van der Pol); 1.25e-3 (Burgers)
- spatial discretization and mesh =
1000 grid points, upwind first-order nonlinear term, centered second-order diffusion
- network hyperparameters for data-driven fit =
third order, Adamax optimizer
assumptions (4)
- domain assumption The vector field F(t,X) can be expanded in a convergent Taylor series in X (equation (1)).
- domain assumption The truncated Lie map series converges over the used time step.
- ad hoc to paper Burgers' equation can be approximated as a hyperbolic system to derive the ODE set (8).
- ad hoc to paper In the data-driven example, the one-step transition is exactly a polynomial of degree 3.
Cite this review
Pith. "Pith review of Matrix Lie Maps and Neural Networks for Solving Differential Equations." pith.science (2026). https://pith.science/paper/MIFJ2TIS
@misc{pith2026190806088,
author = {Pith},
title = {Pith review of: Matrix Lie Maps and Neural Networks for Solving Differential Equations},
year = {2026},
howpublished = {\url{https://pith.science/paper/MIFJ2TIS}},
note = {Machine review of arXiv:1908.06088}
}
read the original abstract
The coincidence between polynomial neural networks and matrix Lie maps is discussed in the article. The matrix form of Lie transform is an approximation of the general solution of the nonlinear system of ordinary differential equations. It can be used for solving systems of differential equations more efficiently than traditional step-by-step numerical methods. Implementation of the Lie map as a polynomial neural network provides a tool for both simulation and data-driven identification of dynamical systems. If the differential equation is provided, training a neural network is unnecessary. The weights of the network can be directly calculated from the equation. On the other hand, for data-driven system learning, the weights can be fitted without any assumptions in view of differential equations. The proposed technique is discussed in the examples of both ordinary and partial differential equations. The building of a polynomial neural network that simulates the Van der Pol oscillator is discussed. For this example, we consider learning the dynamics from a single solution of the system. We also demonstrate the building of the neural network that describes the solution of Burgers' equation that is a fundamental partial differential equation.
Figures
Figures from the paper (2 more)
Reference graph
Works this paper leans on
-
[17]
The convergence and accuracy of the matrix formalism approxima- tion
Andrianov S. The convergence and accuracy of the matrix formalism approxima- tion. In: Proceedings of ICAP2012, Rostock, Germany, 9395 (2012)
work page 2012
-
[1]
Lagaris, I.E., Likas, A., Fotiadis, D.I.: Artificial neural networks for solving ordinary and partial differential equations. Tech. rep. (1997), https://arxiv.org/pdf/physics/9705023.pdf, last accessed 2019/03/03
arXiv 1997
-
[2]
Applied Mathematics, 1, 288292 (2010)
Baymani, M., Kerayechian, A., Effati, S.: Artificial Neural Networks Approach for Solving Stokes Problem. Applied Mathematics, 1, 288292 (2010)
work page 2010
-
[3]
Chiaramonte, M., Kiener, M.: Solving differential equations using neu- ral networks (2013), http://cs229.stanford.edu/proj2013/ChiaramonteKiener- SolvingDifferentialEquationsUsingNeuralNetworks.pdf, last accessed 2019/03/03
work page 2013
-
[4]
Sharma, A.: NeuralNetDiffEq.jl: A Neural Network solver for ODEs, https://julialang.org/blog/2017/10/gsoc-NeuralNetDiffEq, last accessed 2019/03/03
work page 2017
-
[5]
Journal of Computational Physics (2018)
Sirignano, J., Spiliopoulos, K.: DGM: A deep learning algorithm for solving partial differential equations. Journal of Computational Physics (2018)
work page 2018
-
[6]
Weinan, E., Han, J., Jentzen, A.: Deep learning-based numerical methods for high- dimensional parabolic partial differential equations and backward stochastic dif- ferential equations. Tech. rep. (2017), https://arxiv.org/pdf/1706.04702.pdf, last accessed 2019/03/03
arXiv 2017
-
[7]
Anastassi, A.: Constructing Runge-Kutta Methods with the Use of Artificial Neural Networks. Tech. rep. (2013), https://arxiv.org/pdf/1106.1194.pdf, last accessed 2019/03/03. Matrix Lie Maps and Neural Networks for Solving Differential Equations 11
work page Pith review arXiv 2013
Show all 25 references
-
[8]
IEEE Transactions on Neural Networks, vol
Wang, Y., Lin, C.: Runge-Kutta neural network for identification of dynamical systems in high accuracy. IEEE Transactions on Neural Networks, vol. 9, no. 2, 294307 (1998)
1998
-
[9]
Chen, R., Rubanova, Y., Bettencourt, J., Duvenaud, D.: Neural ordinary differen- tial equation, https://arxiv.org/pdf/1806.07366.pdf, last accessed 2019/03/03
2019 arXiv
-
[10]
Journal of Artificial Intelli- gence, 4 (1), 8999 (2011)
Zjavka, L.: Differential polynomial neural network. Journal of Artificial Intelli- gence, 4 (1), 8999 (2011)
2011
-
[11]
Advances in Difference Equations, 469 (2018)
Yang, Y., Hou, M., Luo, J.: A novel improved extreme learning machine algorithm in solving ordinary differential equations by Legendre neural network methods. Advances in Difference Equations, 469 (2018)
2018
-
[12]
Schetinin, V.: Polynomial neural networkslearnt toclassify EEG signals. Tech. rep. (1997), https://arxiv.org/ftp/cs/papers/0504/0504058.pdf, last accessed 2019/03/03
1997
-
[13]
Dragt, A.: Lie methods for nonlinear dynamics with applications to accelerator physics (2011), http://inspirehep.net/record/955313/files/TOC28Nov2011.pdf, last accessed 2019/03/03
2011
-
[14]
Computer Algebra in Sc, Comp., Lecture Notes in Computer Science, 6244, 19–30 (2010)
Andrianov, S.: A role of symbolic computations in beam physics. Computer Algebra in Sc, Comp., Lecture Notes in Computer Science, 6244, 19–30 (2010)
2010
-
[15]
Mathematics and Computers in Simulation, vol
Andrianov, S.: Symbolic Computation of Approximate Symmetries for Ordinary Differential Equations. Mathematics and Computers in Simulation, vol. 57, N 3-5, 147154 (2001)
2001
-
[16]
In: Proceedings of the Abstracts of the International Congress on Computer Systems and Applied Mathematics, 14 (1993)
Andrianov, S.: A matrix representation of the Lie transformation. In: Proceedings of the Abstracts of the International Congress on Computer Systems and Applied Mathematics, 14 (1993)
1993
-
[18]
Long-time predictive modeling of nonlinear dynamical sys- tems using neural networks
Pan, S., Duraisamy, K. Long-time predictive modeling of nonlinear dynamical sys- tems using neural networks. Hindawi Complexity, 4801012 (2018)
2018
-
[19]
Airbus Quantum Computing Challenge, https://www.airbus.com/innovation/tech- challenges-and-competitions/airbus-quantum-computing-challenge.html, last accessed 2019/03/03
2019
-
[20]
Journal of Applied Sciences 7(19), 28122817 (2007)
Hayati, M., Karami, B.: Feedforward neural network for solving partial differential equations. Journal of Applied Sciences 7(19), 28122817 (2007)
2007
-
[21]
F.: Solution of linear partial differential equations by Lie algebraic methods
Casas. F.: Solution of linear partial differential equations by Lie algebraic methods. Journal of Computational and Applied Mathematics, 76, 159-170 (1996)
1996
-
[22]
Note di Matematica, 23, n
Oliveri, F.: Lie symmetries of differential equations: direct and inverse problems. Note di Matematica, 23, n. 2, 195216 (2004/2005)
2004
-
[23]
Providence, R.I.: American Mathemat- ical Society (2010)
Evans, L.C.: Partial Differential Equations. Providence, R.I.: American Mathemat- ical Society (2010)
2010
-
[24]
In: Proceedings of ICAP2012, Rostock, Germany, 99–103 (2012)
Senichev, Y., Lehrach, A., Maier, R., Zyuzin, D., Berz, M., Makino, K., Andrianov, S., Ivanov, A.: Storage ring EDM simulation: methods and results. In: Proceedings of ICAP2012, Rostock, Germany, 99–103 (2012)
2012
-
[25]
In: Proceedings of the Particle Accelerator Conference, 3020–3022 (2014)
Senichev, Y., Ivanov, A., Lehrach, A., Maier, R., Zyuzin, D., Andrianov, S.: Spin tune parametric resonance investigation. In: Proceedings of the Particle Accelerator Conference, 3020–3022 (2014)
2014
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.