Pith. sign in

REVIEW 4 major objections 4 minor 14 references

Semi-Explicit Neural DAEs: Learning Long-Horizon Dynamical Systems with Algebraic Constraints

T0 review · 4 major / 4 minor · reviewed 2026-08-07 · deepseek-v4-flash

Pith's one-line read Projecting every step of a neural ODE onto its constraint manifold keeps known conservation laws exact and improves long-horizon prediction across six benchmarks.

desk verdict A useful projection framework for constrained neural ODEs, but the abstract overclaims state-error consistency and the closest prior method is never benchmarked. read the letter →

arxiv 2505.20515 v1 pith:R4QI4KLC submitted 2025-05-26 cs.LG cs.NAmath.DSmath.NA

classification cs.LGcs.NAmath.DSmath.NA MSC 68T0765L8034A09
keywords neuralordinarydifferentialequationsdifferential-algebraicmanifoldprojectionalgebraicconstraintsconservationlawslong-horizondynamicsphysics-informedmachinelearningstabilizedODEs
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Most neural ODEs learn unconstrained dynamics, so trajectories drift off physical invariants over long horizons; soft penalties and stabilization terms only slow the drift. This paper proposes to enforce the invariant $g(u,t)=0$ the way classical solvers for semi-explicit DAEs do: after every network-predicted ODE step, solve a small projection problem that returns the closest point on the constraint manifold. The claim, tested on six dynamical systems with closed-form invariants, is that this step-wise projection keeps mean constraint violation below $10^{-10}$, gives state errors at least competitive with baselines, and costs less inference time than stabilization for the same accuracy. If right, it means a simple, architecture-agnostic solver modification is sufficient to learn physically consistent long-horizon dynamics whenever the constraint is known, without bespoke Hamiltonian or Lagrangian network designs.

What carries the argument

The constraint-projection step is the Lagrange multiplier solve $z = \tilde u_{n+1} + (\partial g(z)/\partial z)^T \lambda$, $g(z)=0$, which finds the nearest point on the manifold $g(u,t)=0$ to the unconstrained predictor $\tilde u_{n+1}$. The robust variant uses multiple Jacobian factorizations to converge the nonlinear system; the fast variant approximates $\partial g(z)/\partial z$ by $\partial g(\tilde u_{n+1})/\partial u$ and applies Newton with a single fixed Jacobian factorization. This step carries the entire argument: it is what turns a drifted prediction into a feasible one, and differentiating through it with the implicit function theorem keeps the whole pipeline trainable. One step of this projection with Forward Euler and $\gamma \approx 1/h$ produces $u_{n+1} = \tilde u_{n+1} - J_u^T(J_u J_u^T)^{-1} g(\tilde u_{n+1})$, which the paper identifies as the Stabilized Neural ODE update, thereby unifying relaxation and stabilization methods as approximations of exact projection.

What would settle it

Take a benchmark with a known invariant and deliberately corrupt the constraint, for example use $g(u,t) + \epsilon h(u,t)$ with small $\epsilon$, or run a trajectory that passes through a point where $\partial g/\partial u$ loses full row rank, and record constraint violation over 1000 time units; if projection still yields errors near $10^{-10}$ the method is more robust than its derivation suggests, and if the error jumps, the claim holds only for exact nondegenerate invariants.

Watch

Extended reading notes

Core claim

PNODEs are neural ODEs $u' = f(u,\theta,t)$ coupled with an algebraic constraint $g(u,t)=0$ and solved as a semi-explicit DAE. The paper's central discovery is that explicitly solving the projection $u_{n+1} = \arg\min_z \|z - \tilde u_{n+1}\|^2$ subject to $g(z)=0$ at every integration step, rather than penalizing violation or adding a soft restoring force, is what makes learned trajectories stay physically consistent. Two variants are derived from the Lagrange equations $z = \tilde u_{n+1} + (\partial g/\partial z)^T\lambda$: a robust nonlinear solve with repeated Jacobian factorizations and a cheaper single-factorization Newton iteration. The paper further shows that substituting a fixed stabilization gain $\gamma$ for $1/h$ in one projected Euler step recovers the Stabilized Neural ODE formula, so prior relaxation methods are special cases of the projection. Across all six benchmarks the projection variants achieve mean constraint violation below $10^{-10}$, often orders of magnitude under Stabilized NODEs, and at fixed error tolerance they run faster than stabilization baselines.

Load-bearing premise

Everything rests on the algebraic constraint $g(u,t)=0$ being known exactly and its Jacobian having full row rank on the manifold, so that the projection equations are well-posed and the nonlinear solver converges; if the invariant is misspecified, missing, or degenerate, the projection either fails or pins the trajectory to the wrong manifold.

Editorial extensions

If this is right

  • Known conservation laws become hard constraints: every output state satisfies $g(u,t)=0$ to solver tolerance, so long-horizon trajectories no longer drift off the manifold.
  • The mechanism is architecture-agnostic, so it can be added to any neural ODE solver with a differentiable projection, not just to specially designed Hamiltonian or Lagrangian networks.
  • Stabilization gains disappear as a hyperparameter: tuning $\gamma$ in Stabilized NODEs becomes unnecessary if one performs the full projection instead of the one-step approximation.
  • At a fixed error budget the projected variants are faster than stabilized ones, which matters for real-time robotics and simulation applications.
  • If correct, models can train on short windows and extrapolate to much longer horizons, since constraint satisfaction prevents error accumulation.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The paper's results assume the constraint $g(u,t)=0$ is given and nondegenerate; a natural extension is to couple PNODE with constraint discovery, but then the claimed $10^{-10}$ violations would only hold for the discovered manifold after verification, and the claim does not directly cover unknown constraints.
  • One testable extension is to time-varying or parameterized manifolds $g(u,t)=0$, such as moving robotic linkages; the paper lists this as future work, so a benchmark with a moving constraint would show whether the projection machinery transfers.
  • The projection preserves invariants pointwise but is not a symplectic integrator by itself; the paper leaves unclear whether energy and angular-momentum errors accumulate secularly over extremely long horizons, and measuring that drift would be a useful check.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 4 minor

Summary. The paper proposes Manifold-Projected Neural ODEs (PNODEs), a method for learning dynamical systems with known algebraic constraints. At each integration step the Neural ODE's unconstrained prediction is projected onto the constraint manifold g(u,t)=0, either by a robust iterative nonlinear solve or by a cheaper single-Jacobian-f factorization scheme. The formulation is presented as a semi-explicit DAE, and the authors show that the Stabilized Neural ODE (SNODE) can be viewed as an approximation of one projection step. Experiments on six benchmark systems report long-horizon state error, constraint violation, and inference time, and the abstract claims consistent improvement over baselines, constraint violation below 1e-10, and lower runtime at fixed accuracy.

Significance. If the empirical claims were fully supported, this would be a useful and practical contribution: the projection idea is simple, the derivation in Section 3 is standard and appears correct, the unification of stabilization methods is conceptually valuable, and the code is made available. The method's guarantee of constraint satisfaction by construction is a genuine strength for applications that require hard invariants. However, the headline empirical claims need careful qualification: the constraint-violation numbers are enforced by the projection rather than learned, and the state-accuracy results in Table 2 do not support 'consistently outperform baselines' without further analysis.

major comments (4)
  1. [Abstract and Table 2] The abstract's claim that 'PNODEs consistently outperform baselines across six benchmark problems' is not supported by the reported state-accuracy metric. In Table 2, for Mass-Spring the SNODE baseline has mean relative state error 2.6766e-1 versus PNODE's 2.9497e-1; for Two-Body, NODE+SC achieves 8.7444e-2 versus PNODE's 1.9658e-1, and SNODE(gamma=2.0) achieves 1.5651e-1 versus PNODE(MF)'s 2.2290e-1. The error bars overlap substantially, so the comparisons are not statistically decisive. The 'consistent outperformance' claim should be restricted to constraint violation, or the paper should present a matched-accuracy comparison showing that projection improves or at least preserves state prediction at equal inference cost.
  2. [Section 3, Eqs. (5)-(8), and Table 2] The constraint-violation results below 1e-10 are circular evidence for the method's predictive value. The projection step solves g(z)=0 to solver tolerance at every integration step, so any projection-based method will report near-zero constraint error regardless of the learned dynamics. Table 2's constraint columns therefore measure the nonlinear solver's tolerance, not a learned quantity. The paper should report the projection solver tolerance used, state explicitly that constraint satisfaction is guaranteed by construction, and reposition the constraint-violation numbers as a sanity check rather than a headline advantage over methods that do not project.
  3. [Section 4, Baseline Models] The closest prior projection-based approach, White et al. (2024), is cited and described as a special case of the proposed method but is not included as a baseline in any experiment. Without a head-to-head comparison to this method, the empirical claim of outperforming 'baselines' is incomplete and the novelty advantage over the closest competitor is not demonstrated. The authors should add White et al. (2024) to the benchmarks or clearly justify its omission.
  4. [Section 4, Figure 4 and runtime claims] The claim that 'PNODEs consistently achieve lower runtime compared to other methods for a given level of error tolerance' is not directly established. Figure 4 plots error against time per batch, but Table 2 shows different methods at different error levels, and no matched-error runtime table is provided. A direct comparison reporting runtime at matched state-error thresholds would make the efficiency claim compelling; as presented, the runtime advantage appears only in selected points of the figure.
minor comments (4)
  1. [Table 1] For the Two-Body problem, the invariant E(q1,q2,p1,p2)=q1*p2 - q2*p1 is angular momentum, not energy; labeling it E is misleading and should be corrected to L or H.
  2. [Table 2] The column header says 'Mean Squared Constraints Error' while the text and Figure 4 refer to 'Mean Abs. Constraints Error'; these should be unified to avoid confusion about which statistic is reported.
  3. [Section 3, Eq. (8)] The definition 'J_u^T = ∂g(˜u_{n+1})/∂u' contains a stray unmatched parenthesis; this should be cleaned up, and all Jacobian transposes should be defined consistently.
  4. [Section 3, Eq. (10)] The derivation of SNODE as a special case replaces 1/h by a fixed γ; this is an approximation, not an exact equivalence. The text states this correctly, but it would help to emphasize that the equivalence is formal and asymptotic in the step size, not an exact identity for finite h.

Circularity Check

1 steps flagged · score 6.0 of 10

Constraint-violation headline is definitional: the projection step solves g(z)=0 at every integration step, so the reported <1e-10 violation is solver tolerance rather than a learned prediction; state-error and runtime comparisons remain independent.

  1. self definitional [Abstract; Section 3, Eqs. (3)-(5); Table 2]
    "Abstract: 'PNODEs consistently outperform baselines across six benchmark problems achieving a mean constraint violation error below 10^{-10}.' Section 3, Eqs. (3)-(4): 'un+1 ∈ arg min_z ||z − ũn+1||2 subject to g(z) = 0'."

    The reported constraint-violation metric is the residual g(u) of the trajectory. By definition, each integration step replaces the unconstrained update ũn+1 with the solution of the constrained least-squares problem (3)-(4), i.e., a point z with g(z)=0 (Eq. 5) up to nonlinear-solver tolerance. Hence the measured mean constraint error is the tolerance of the projection solver, not a learned or predicted quantity. Any method that projects every step by solving g(z)=0 will report near-machine-zero violation regardless of the neural-network dynamics. The headline 'achieving a mean constraint violation error below 10^-10' therefore restates the method's definition rather than providing independent empirical confirmation.

full rationale

The state-accuracy and runtime claims are grounded in external comparisons against NODE, NODE+SC, and SNODE baselines and are not circular; the derivation that SNODE is a special case of PNODE (Eqs. 8-10) is a direct algebraic reduction with explicit approximations, not a self-citation. No load-bearing self-citation or imported uniqueness theorem appears. The one genuine circularity is the constraint-violation headline: because the method's output is defined as the projection solving g(z)=0 at every step, the reported <1e-10 constraint error is the solver tolerance by construction. The claim that PNODEs 'consistently outperform' in state accuracy is not circular, though Table 2 shows PNODE does not beat all baselines on mass-spring (2.95e-1 vs SNODE 2.68e-1) and two-body (1.97e-1 vs NODE+SC 8.74e-2) relative state error; that is a claim-evidence gap, not circularity. Score 6 reflects one central headline metric reducing by construction while the rest of the contribution retains independent empirical content.

Assumptions & free parameters 2 free parameters · 3 assumptions · 0 invented entities

The method itself introduces no new fitted physical constants or invented entities. The central empirical headline, constraint violation below 10^-10, is to a significant degree a direct artifact of the projection solver's tolerance, which is not reported. The neural network weights are learned from simulated data, and the constraint manifold is provided in closed form for every benchmark, so the method's ability to discover constraints is not tested. The baseline SNODE gamma values are hand-tuned, which colors the efficiency comparison.

free parameters (2)
  • Projection solver tolerance = not reported (NonlinearSolve default)
    The reported near-zero constraint violations are a direct function of the tolerance used in the nonlinear solve; the paper does not specify it for each benchmark.
  • Single-factorization Newton step count = 1 (fixed)
    The fast PNODE variant approximates the projection by one Newton step with fixed Jacobian (Eq. 7); the effect of this approximation on accuracy is not quantified.
assumptions (3)
  • domain assumption The constraint function g(u,t) is known a priori and exactly characterizes the invariant manifold M = {u : g(u,t)=0}.
    Section 3 opens with 'Many physical systems evolve under algebraic constraints... These constraints are often known in closed form'; every benchmark uses a hand-derived invariant.
  • domain assumption g has full row rank Jacobian on the manifold, so J J^T is invertible and the projection equations are well-posed (index-1 DAE assumption).
    Eq. (8) inverts J J^T; no rank or conditioning analysis is given.
  • standard math The neural-network parameterized f and the numerical solver step size h are such that the projected update remains stable and the local error bound O(h^(p+1)) applies.
    The paper relies on standard ODE/DAE integration theory (Hairer et al.) without restating it.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Semi-Explicit Neural DAEs: Learning Long-Horizon Dynamical Systems with Algebraic Constraints." pith.science (2026). https://pith.science/paper/R4QI4KLC

@misc{pith2026250520515,
  author       = {Pith},
  title        = {Pith review of: Semi-Explicit Neural DAEs: Learning Long-Horizon Dynamical Systems with Algebraic Constraints},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/R4QI4KLC}},
  note         = {Machine review of arXiv:2505.20515}
}
abstract

Despite the promise of scientific machine learning (SciML) in combining data-driven techniques with mechanistic modeling, existing approaches for incorporating hard constraints in neural differential equations (NDEs) face significant limitations. Scalability issues and poor numerical properties prevent these neural models from being used for modeling physical systems with complicated conservation laws. We propose Manifold-Projected Neural ODEs (PNODEs), a method that explicitly enforces algebraic constraints by projecting each ODE step onto the constraint manifold. This framework arises naturally from semi-explicit differential-algebraic equations (DAEs), and includes both a robust iterative variant and a fast approximation requiring a single Jacobian factorization. We further demonstrate that prior works on relaxation methods are special cases of our approach. PNODEs consistently outperform baselines across six benchmark problems achieving a mean constraint violation error below $10^{-10}$. Additionally, PNODEs consistently achieve lower runtime compared to other methods for a given level of error tolerance. These results show that constraint projection offers a simple strategy for learning physically consistent long-horizon dynamics.

Figures

Figures reproduced from arXiv: 2505.20515 by the authors.

Figure 1
Figure 1. Qualitative comparison of learned dynamics across neural ODE variants. We show predicted trajectories from various neural ODE models on two benchmark problems: (a) Lotka￾Volterra predator-prey dynamics and (b) a 2D mass-spring system with conserved energy. Vanilla neural ODEs diverge over time due to lack of constraint enforcement. Adding soft penalties improves short-term behavior but fails to prevent long-term dri… view at source ↗
Figure 2
Figure 2. Overview of the Projected Neural ODE Architecture. Our model augments a standard Neural ODE solver by adding a constraint projection step. At each integration step, the neural network predicts an unconstrained update, which is then projected back onto the constraint manifold using a nonlinear solver. This projection enforces algebraic constraints explicitly, ensuring the system evolves on the constraint manifold. Th… view at source ↗
Figure 3
Figure 3. Training Pipeline for Neural ODEs: We train the model using overlapping time sequences, enabling efficient mini-batching without requiring collocation losses. Each batch serves as a short rollout, while continuity across sequences (from overlapping time sequence) allows the model to learn long-horizon dynamics. In contrast, multiple shooting methods optimize trajectory segments sequentially, requiring explicit conti… view at source ↗
Figures from the paper (6 more)
Figure 4
Figure 4. Figure 4: Accuracy & Constraint Satisfaction vs Inference Time: Each point represents a method’s performance on a specific system, showing relative state error (top), constraint violation (bottom), and inference time (x-axis). PNODE variants consistently achieve lower runtime co…
Figure 5
Figure 5. Figure 5: Projected Neural ODE has the lowest constraint violations on six benchmark systems. We report the relative state error (left axis) and absolute constraint violation (right axis) over long integration horizons for each method: Vanilla NODE, NODE with Soft Constraints, S…
Figure 6
Figure 6. Figure 6 [PITH_FULL_IMAGE:figures/full_fig_p012_6.png]
Figure 7
Figure 7. Figure 7: Qualitative Plots of Predicted Trajectories for the Nonlinear Spring 2D problem. 12 [PITH_FULL_IMAGE:figures/full_fig_p012_7.png]
Figure 8
Figure 8. Figure 8: Qualitative Plots of Predicted Trajectories for the Robot Arm problem. x y Ground Truth x y Vanilla Neural ODE x y z Vanilla Neural ODE with Soft Constraints x y z Stabilized Neural ODE x y z Stabilized Neural ODE (gamma=2.0) x y z Stabilized Neural ODE (gamma=10.0) x …
Figure 9
Figure 9. Figure 9: Qualitative Plots of Predicted Trajectories for the Rigid-Body problem. The vanilla NODE case produces divergent trajectory and is plotted for a shorter time-horizon compared to the other cases. 13 [PITH_FULL_IMAGE:figures/full_fig_p013_9.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

14 extracted references · 5 canonical work pages

  1. [1]

    B., and Edelman, A

    Bezanson, J., Karpinski, S., Shah, V . B., and Edelman, A. Julia: A fast dynamic language for technical computing. arXiv preprint arXiv:1209.5145,

  2. [5]

    10 Kingma, D. P. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980,

  3. [12]

    Differentiable programming for differential equations: A review

    Sapienza, F., Bolibar, J., Sch¨afer, F., Groenke, B., Pal, A., Boussange, V ., Heimbach, P., Hooker, G., P´erez, F., Persson, P.-O., et al. Differentiable programming for differential equations: A review. arXiv preprint arXiv:2406.09699,

  4. [14]

    URL https: //arxiv.org/abs/2410.23667. 11 A Qualitative Visualization of Learned Dynamical Systems q2 −1.0 −0.5 0.0 0.5 1.0 Ground Truth q1 −1.5 −1.0− 0.5 0 .0 0.5 q2 −1.0 −0.5 0.0 0.5 1.0 Vanilla Neural ODE q1 −1.5 −1.0−0. 5 0 .0 0.5 Vanilla Neural ODE with Soft Constraints Stabilized Neural ODE Stabilized Neural ODE (gamma=2.0) q1 −1.5−1 .0−0. 5 0.0 0 ....

  5. [1986]

    Gruver, N., Finzi, M., Stanton, S., and Wilson, A. G. Deconstructing the inductive biases of hamiltonian neural networks. arXiv preprint arXiv:2202.04836,

  6. [1989]

    J., Guo, X., and Rackauckas, C

    Ma, Y ., Dixit, V ., Innes, M. J., Guo, X., and Rackauckas, C. A comparison of automatic differentiation and continuous sensitivity analysis for derivatives of differential equation solutions. In 2021 IEEE High Performance Extreme Computing Conference (HPEC), pp. 1–9. IEEE,

  7. [1996]

    Lagrangian neural networks

    Cranmer, M., Greydanus, S., Hoyer, S., Battaglia, P., Spergel, D., and Ho, S. Lagrangian neural networks. arXiv preprint arXiv:2003.04630,

  8. [1999]

    Stabilized Neural Differential Equations for Learning Dynamics with Explicit Constraints

    White, A., Kilbertus, N., Gelbrecht, M., and Boers, N. Stabilized neural differential equations for learning constrained dynamics. arXiv preprint arXiv:2306.09739,

Show all 14 references
  1. [2014]

    Neural differential algebraic equations

    Koch, J., Shapiro, M., Sharma, H., Vrabie, D., and Drgona, J. Neural differential algebraic equations. arXiv preprint arXiv:2403.12938,

  2. [2017]

    Universal differential equations for scientific machine learning.arXiv preprint arXiv:2001.04385,

    Rackauckas, C., Ma, Y ., Martensen, J., Warner, C., Zubov, K., Supekar, R., Skinner, D., Ramadhan, A., and Edelman, A. Universal differential equations for scientific machine learning.arXiv preprint arXiv:2001.04385,

  3. [2018]

    On Efficient Training & Inference of Neural Differential Equations, 2023a

    Pal, A. On Efficient Training & Inference of Neural Differential Equations, 2023a. Pal, A. Lux: Explicit Parameterization of Deep Neural Networks in Julia, April 2023b. URL https://doi.org/10.5281/zenodo.7808903. If you use this software, please cite it as below. Pal, A., Holt...

  4. [2019]

    Challenges in training pinns: A loss landscape perspective

    Rathore, P., Lei, W., Frangella, Z., Lu, L., and Udell, M. Challenges in training pinns: A loss landscape perspective. arXiv preprint arXiv:2402.01868,

  5. [2022]

    On neural differential equations

    Kidger, P. On neural differential equations. arXiv preprint arXiv:2202.02435,

  6. [2024]

    Lim, Y . H. and Kasim, M. F. Unifying physical systems’ inductive biases in neural ode using dynamics constraints. arXiv preprint arXiv:2208.02632,

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.