REVIEW 4 major objections 5 minor 1 cited by
Adding conservation and Lyapunov losses to a variational Gaussian-process model yields better predictions of conservative, dissipative, and port-Hamiltonian dynamics from noisy trajectory data than unregularized baselines.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
The paper extends symplectic spectral Gaussian processes with energy, volume, and Lyapunov regularizers to learn conservative, dissipative, and port-Hamiltonian dynamics from noisy data.
T0 review reviewed 2026-08-04 challenge →
load-bearing objection A useful, clearly written extension of Symplectic Spectrum GPs with physics regularizers, but the paper's own tables contradict the 'improved across systems' claim and the empirical story needs a major cleanup before the results can be taken at face value. the 4 major comments →
Learning Generalized Hamiltonian Dynamics with Stability from Noisy Trajectory Data
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
Core claim
The paper's central claim is that the right inductive bias for generalized Hamiltonian learning is not a bigger network but a set of physics constraints layered onto a variational Gaussian process. It parameterizes the Hamiltonian as a random-Fourier-feature GP, separates the conservative term J∇H, the dissipation term D∇H, and the external force F(t) into distinct modules, and fits all of them by propagating sampled initial states through a differentiable ODE solver. The loss is the ELBO plus three regularizers—energy conservation, volume conservation (Liouville), and Lyapunov stability—with weights adapted by a gradient descent-ascent scheme. The paper finds that this regularized objective
What carries the argument
The load-bearing object is the random-Fourier-feature Gaussian process prior on H(q,p), whose cos/sin basis functions have learned frequencies and weights and give analytic gradients ∇H. Around this, the paper builds three modules: the symplectic matrix J for conservative flow, a diagonal non-positive dissipation matrix D=diag(0,...,0,−η₁²,...,−η_d²) for dissipative flow, and an MLP external forcing F(t) for port-Hamiltonian flow. These feed a multi-term loss: a variational ELBO (Monte-Carlo expected log-likelihood plus KL penalties on weights and initial states) and three physics regularizers—energy conservation along the flow, volume conservation via the characteristic function of a sample
Load-bearing premise
Everything about the dissipative and port-Hamiltonian versions rests on assuming damping acts only along each momentum coordinate and never couples coordinates: D=diag(0,...,0,−η₁²,...,−η_d²). If real dissipation mixes coordinates, the model cannot represent the physics.
What would settle it
Fit the model to data from a coupled damped oscillator whose dissipation matrix has nonzero off-diagonal entries, so damping in one coordinate drags the other. If the diagonal parameterization cannot represent the vector field, test-trajectory error will stay high and the measured energy dissipation will not match the true rate; that observation would pin the structural assumption as the bottleneck.
If this is right
- A single model, with one Hamiltonian module and one dissipation/forcing module, can cover all three classes of generalized Hamiltonian dynamics.
- Users need only noisy (q,p) trajectories, not time-derivative labels, and the method returns predictive uncertainty.
- When the noise level is known a priori, performance improves in most tested systems, because the model can separate observation noise from the true dynamics.
- The volume regularizer suppresses spurious divergence in the learned vector field, which helps predictions stay faithful beyond the training horizon.
Where Pith is reading between the lines
- The diagonal dissipation assumption is the natural next test; a full dissipation matrix would extend the method to anisotropic or coupled damping, though it would break the clean energy and volume identities the regularizers currently rely on.
- The volume-loss term is effectively the divergence term of the Onsager-Machlup functional, so the same machinery should extend to stochastic Hamiltonian systems with state-dependent noise, where the most probable path carries the physics.
- Because the implemented Lyapunov loss keeps only the positivity penalty on H (the non-increase half is inherited from the energy regularizer on the conservative flow), the stability guarantee is empirical; a certified guarantee would need the Hamiltonian parameterized to be globally positive-definite by construction.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a variational framework for learning generalized Hamiltonian dynamics (conservative, dissipative, and port-Hamiltonian) from noisy, sparse phase-space trajectories. The Hamiltonian is represented as a random Fourier feature approximation of a Gaussian process, and training combines an ELBO data-fit term with soft regularizers for energy conservation, volume conservation, and Lyapunov stability. Dissipation is parameterized as a diagonal matrix with a zero q-block and non-positive p-block, external forcing is restricted to the momentum coordinates and modeled by an MLP, and several multi-loss balancing schemes (equal weighting, GDA, MTAdam, Jacobian descent) are compared. Experiments are reported on pendulum, spring, Hénon–Heiles, and Duffing systems across the three classes, with baselines HNN/DHNN/PHNN and SSGP.
Significance. If the empirical claims held, the paper would provide a practical uncertainty-aware extension of symplectic spectral Gaussian processes to dissipative and port-Hamiltonian systems, with physics-informed regularizers and a public code release. The methodological ingredients are coherent and the experimental setup covers a useful range of systems and noise levels. However, the central claim of improved performance across systems is not supported by the paper's own tables: several reported numbers contradict the captions, and differences are generally within one standard deviation. The structural restriction to diagonal dissipation also limits the claimed generality. The contribution is incremental relative to SSGP, but the underlying idea is plausible and the failures are mostly in claim calibration and experimental reporting rather than in the derivation.
major comments (4)
- [§4.2, Tables 4 and 5] The headline claim in Section 4.2 — 'our method can achieve improved performance across systems in each of the various classes of generalized Hamiltonian dynamics' — is not supported by the reported numbers. In Table 4, the Forced Spring row shows SSGP at 0.0293±0.0102 versus Ours (Equal) 0.0311±0.0126 and Ours (GDA) 0.0319±0.0129, contradicting the caption's concession that the method loses on that system. In Table 5, for the damped pendulum at noise 0.1, SSGP is 0.0897±0.1240 while Ours (Equal) is 0.1097±0.1511 and Ours (GDA) is 0.1119±0.1540, directly contradicting the caption 'superior performance in each case of noise level.' Since these differences are within one standard deviation and no significance tests or repeated-seed statistics are reported, the evidence is at best mixed. The claims must be restricted to the systems and regimes where the method actually wins, or supported by
- [§3.2, Eq. (11)–(13); §3.4, Eq. (27)–(31)] The dissipative model is restricted to D = diag(0,...,0, -η_1^2, ..., -η_d^2). This is load-bearing: the separated conservative/dissipative parameterization, the energy-dissipation identity Eq. (27)–(29), the volume-dissipation identity Eq. (30)–(31), and the regularizers all depend on this diagonal form. For realistic dissipative or port-Hamiltonian systems with off-diagonal or state-dependent damping, the model cannot represent the true vector field, and the proposed regularizers would enforce the wrong dissipation laws. Since the title and abstract claim generalized Hamiltonian dynamics, the paper should either relax this assumption, or explicitly state and empirically test the limitation (e.g., with a coordinate-coupled damping example), rather than presenting the method as broadly applicable.
- [§3.6, Eq. (26)] Equation (26) defines the Lyapunov regularizer with two terms, but §3.6 states: 'in practice, since the first term is already satisfied by enforcing conservation of energy we omit it in the code implementation.' Thus the implemented Lyapunov term contains only ReLU(−H), i.e., a non-negativity penalty, not the stability condition dH/dt ≤ 0. The method description, Algorithm 1, and the stability claims in the abstract and introduction should be aligned with what is actually implemented. If the derivative part is omitted, the claim that the method enforces 'Lyapunov stability' is overstated.
- [§4.2, Table 8] The ablation study shows that adding the full set of regularizers can degrade test accuracy. For Windy Pendulum, the unregularized ELBO gives MSE 0.0493, while the full equal-weighted model gives 0.0670 and the full GDA-balanced model gives 0.2972; only the GDA energy-only variant (0.0303) improves over the unregularized model. This is an additional, concrete contradiction to the 'improved performance across systems' claim, and it highlights that the balancing strategy strongly determines whether regularizers help. The paper should report a principled selection rule for the balancing method and present this ablation as evidence of sensitivity rather than uniform benefit.
minor comments (5)
- [Figure 2, Table 1] The system name 'Hénon-Helies' should be 'Hénon-Heiles'.
- [§2.2] The dynamics equations labeled (dqdp-P), (dqdp-DP), (dqdp-S), etc. are not numbered in the main text. Numbering them would make cross-referencing easier.
- [§3.8, Tables 5–7] The treatment of the zero-noise case is only described in prose ('where σ is known to be zero, the negative log-likelihood is not well defined, so we use MSE'). Clarify how the 'noise 0' rows were computed for the SSGP baseline and for each 'Ours' variant.
- [Algorithm 1 and §3.3] The learning rate is denoted α in Algorithm 1, and α is also used for the exponential-stability exponent in §3.3. This notation collision should be fixed.
- [Tables 4–7] The captions use different levels of claims: Table 4 says 'in each system besides forced spring', Table 5 says 'superior performance in each case', Table 6 says 'majority of cases', and Table 7 says 'typically performs best'. Unify the claim language with what the numbers support.
Circularity Check
Physics regularizers are self-consistency terms that are identities of the model class; central trajectory-MSE evaluation is not manufactured.
specific steps
-
self definitional
[Section 3.3 (Conservation Law Regularizers), Eq. (23); Section 3.2, Eq. (1); Section 3.4, Eq. (27)]
"which can be softly enforced with the following additional loss term: LEnergy = Eq,p,t [H(ρt(q,p))− H(q,p)]2. The Hamiltonian flow map ρt(·) = Φθ(t;·,w,ω) is the mapping from phase space at the initial time to a future time, defined by integrating along the Hamiltonian vector field."
For conservative systems the dynamics are parameterized as ẋ=J∇H, so the flow ρt satisfies dH(ρt)/dt = ∇HᵀJ∇H = 0; hence H(ρt(q,p))−H(q,p) ≡ 0 and LEnergy is identically zero for any learned H. The volume regularizer is likewise zero because ∇·(J∇H)=0. For dissipative and port-Hamiltonian cases the paper states the conservation losses are evaluated on only the conservative part J∇H, so they remain identically zero. The Lyapunov term is also automatic by Eq. 27, dH/dt = −Σ(η_i ∂H/∂p_i)² ≤ 0, which the paper itself concedes by omitting that term in implementation. These 'physics constraints' are therefore restatements of the model's own parameterization rather than independent physical evidence. However, the central reported metric, held-out trajectory MSE, is an external benchmark and is no
full rationale
No load-bearing self-citations were found: the ELBO derivation follows the non-author SSGP paper [12], and the RFF basis is explicitly attributed to [12]; none of the cited references are by the present authors. The main empirical claim, improved test-trajectory MSE over HNN variants and SSGP, is evaluated on held-out noisy trajectories and is not a fitted quantity or a renamed training loss. The only notable circularity is in the physics-enforcement portion of the method: the conservation and Lyapunov regularizers are defined in terms of the model's own flow and parameterization, and for the model classes considered they reduce to algebraic identities (energy conservation along J∇H flow, zero divergence of J∇H, and dissipation law forced by the diagonal D parameterization). Thus the regularizers cannot provide independent evidence of physical correctness and are essentially vacuous as constraints; their inclusion in the reported improvements is therefore not substantiated. This is a partial self-consistency issue, not a circularity of the central predictive claim, so the score is 2 rather than higher.
Axiom & Free-Parameter Ledger
free parameters (9)
- sigma_0
- b
- sqrt(C)
- Lambda
- a
- sigma
- eta
- vartheta
- lambda_1, lambda_2, lambda_3
axioms (6)
- domain assumption The dynamics belong to one of three known classes: conservative (1), dissipative (2), or port-Hamiltonian (3).
- domain assumption The Hamiltonian H is a sample from a zero-mean Gaussian process with an RFF spectral kernel.
- ad hoc to paper The dissipation matrix D is diagonal with zero q-block and nonpositive p-block.
- ad hoc to paper The external forcing F(t) affects only the momentum coordinates.
- domain assumption Observations are noisy with i.i.d. Gaussian noise and known/variance-modeled sigma.
- standard math Trajectories are computed by deterministic ODE integration from a latent noisy initial condition.
Cite this review
Pith. "Pith review of Learning Generalized Hamiltonian Dynamics with Stability from Noisy Trajectory Data." pith.science (2026). https://pith.science/paper/5AK7CGAJ
@misc{pith2026250907280,
author = {Pith},
title = {Pith review of: Learning Generalized Hamiltonian Dynamics with Stability from Noisy Trajectory Data},
year = {2026},
howpublished = {\url{https://pith.science/paper/5AK7CGAJ}},
note = {Machine review of arXiv:2509.07280}
}
read the original abstract
We introduce a robust framework for learning various generalized Hamiltonian dynamics from noisy, sparse phase-space data and in an unsupervised manner based on variational Bayesian inference. Although conservative, dissipative, and port-Hamiltonian systems might share the same initial total energy of a closed system, it is challenging for a single Hamiltonian network model to capture the distinctive and varying motion dynamics and physics of a phase space, from sampled observational phase space trajectories. To address this complicated Hamiltonian manifold learning challenge, we extend sparse symplectic, random Fourier Gaussian processes learning with predictive successive numerical estimations of the Hamiltonian landscape, using a generalized form of state and conjugate momentum Hamiltonian dynamics, appropriate to different classes of conservative, dissipative and port-Hamiltonian physical systems. In addition to the kernelized evidence lower bound (ELBO) loss for data fidelity, we incorporate stability and conservation constraints as additional hyper-parameter balanced loss terms to regularize the model's multi-gradients, enforcing physics correctness for improved prediction accuracy with bounded uncertainty.
Figures
Forward citations
Cited by 1 Pith paper
-
Learning Material-Aware Hamiltonian Risk Fields for Safe Navigation
A learned context-energy term in port-Hamiltonian policies creates selective risk navigation that activates evasive forces only when safer paths are available.
Reference graph
Works this paper leans on
-
[1]
Learning unknown ODE models with Gaussian processes
Markus Heinonen et al. “Learning unknown ODE models with Gaussian processes”. In:International Conference on Machine Learning. PMLR. 2018, pp. 1959–1968
work page 2018
-
[2]
Neural ordinary differential equations
Ricky T. Q. Chen et al. “Neural ordinary differential equations”. In:Conference on Neural Information Processing Systems(2018)
work page 2018
-
[3]
Learning dynamical systems from partial observations
Ibrahim Ayed et al. “Learning dynamical systems from partial observations”. In:arXiv:1902.11136(2019)
Pith/arXiv arXiv 1902
-
[4]
Learning stable deep dynamics models
Gaurav Manek and J. Zico Kolter. “Learning stable deep dynamics models”. In:Neural information processing systems(2019)
work page 2019
-
[5]
Neural SDE: stabilizing neural ODE networks with stochastic noise
Xuanqing Liu et al. “Neural SDE: stabilizing neural ODE networks with stochastic noise”. In:arXiv preprint, arXiv:1906.02355(2019)
Pith/arXiv arXiv 1906
-
[6]
Neural sdes as infinite-dimensional gans
Patrick Kidger et al. “Neural sdes as infinite-dimensional gans”. In:International conference on machine learning. PMLR. 2021, pp. 5453–5463
work page 2021
-
[7]
Sam Greydanus, Misko Dzamba, and Jason Yosinski. “Hamiltonian neural networks”. In:Neural Information Processing Systems(2019)
work page 2019
-
[8]
Symplectic Gaussian process regression of maps in Hamiltonian systems
Katharina Rath et al. “Symplectic Gaussian process regression of maps in Hamiltonian systems”. In:Chaos: An Interdisciplinary Journal of Nonlinear Science(2021)
work page 2021
-
[9]
Learning Energy Conserving Dynamics Efficiently with Hamiltonian Gaussian Processes
Magnus Ross and Markus Heinonen. “Learning energy conserving dynamics efficiently with Hamiltonian Gaussian processes”. In:arXiv preprint arXiv:2303.01925(2023)
work page internal anchor Pith review Pith/arXiv arXiv 2023
-
[10]
Dissipative Hamiltonian neural networks: Learning dissipative and conservative dynamics separately
Andrew Sosanya and Sam Greydanus. “Dissipative Hamiltonian neural networks: Learning dissipative and conservative dynamics separately”. In:arXiv preprint arXiv:2201.10085(2022). 19
Pith/arXiv arXiv 2022
-
[11]
Dissipative SymODEN: encoding Hamiltonian dynamics with sissipation and control into deep learning
Yaofeng Desmond Zhong, Biswadip Dey, and Amit Chakraborty. “Dissipative SymODEN: encoding Hamiltonian dynamics with sissipation and control into deep learning”. In:ICLR 2020 Workshop on Integration of Deep Neural Models and Differential Equations. 2020.URL: https://openreview.net/forum?id=knjWFNx6CN
work page 2020
-
[12]
Symplectic spectrum Gaussian processes: learning Hamiltonians from noisy and sparse data
Yusuke Tanaka, Tomoharu Iwata, and Naonori Ueda. “Symplectic spectrum Gaussian processes: learning Hamiltonians from noisy and sparse data”. In:Neural Information Processing Systems(2022)
work page 2022
-
[13]
Port-Hamiltonian systems theory: an introductory overview
Arjan van der Schaft and Dimitri Jeltsema. “Port-Hamiltonian systems theory: an introductory overview”. In: F oundations and Trends® in Systems and Control1.2-3 (2014), pp. 173–378
work page 2014
-
[14]
Port-Hamiltonian neural networks for learning explicit time-dependent dynamical systems
Shaan A Desai et al. “Port-Hamiltonian neural networks for learning explicit time-dependent dynamical systems”. In:Physical Review E104.3 (2021), p. 034312
work page 2021
-
[15]
J. Meiss. “Hamiltonian systems”. In:Scholarpedia2.8 (2007). revision #197503, p. 1943.DOI: 10 . 4249 / scholarpedia.1943
work page 2007
-
[16]
Mohamed Aziz Bhouri and Paris Perdikaris. “Gaussian processes meet NeuralODEs: a Bayesian framework for learning the dynamics of partially observed systems from scarce and noisy data”. In:Philosophical Transactions of the Royal Society A380.2229 (2022), p. 20210201
work page 2022
-
[17]
Random features for large-scale kernel machines
Ali Rahimi and Benjamin Recht. “Random features for large-scale kernel machines”. In:Advances in neural information processing systems20 (2007)
2007
-
[18]
Sparse spectrum Gaussian process regression
Miguel L ´azaro-Gredilla et al. “Sparse spectrum Gaussian process regression”. In:The Journal of Machine Learning Research11 (2010), pp. 1865–1881
work page 2010
-
[19]
Spherical structured feature maps for kernel approximation
Yueming Lyu. “Spherical structured feature maps for kernel approximation”. In:International Conference on Machine Learning. PMLR. 2017, pp. 2256–2264
work page 2017
-
[20]
Gaussian process port-Hamiltonian systems: Bayesian learning with physics prior
Thomas Beckers et al. “Gaussian process port-Hamiltonian systems: Bayesian learning with physics prior”. In: 2022 IEEE 61st Conference on Decision and Control (CDC). 2022, pp. 1447–1453.DOI: 10.1109/CDC51059. 2022.9992733
-
[21]
LyaNet: a Lyapunov framework for training neural odes
Ivan Dario Jimenez Rodriguez, Aaron D Ames, and Yisong Yue. “LyaNet: a Lyapunov framework for training neural odes”. In:International Conference on Machine Learning(2022)
work page 2022
-
[22]
The Onsager-Machlup function as Lagrangian for the most probable path of a diffusion process
Detlef D¨urr and Alexander Bach. “The Onsager-Machlup function as Lagrangian for the most probable path of a diffusion process”. In:Communications in Mathematical Physics60 (1978), pp. 153–170
work page 1978
-
[23]
Onsager-Machlup functional for stochastic differential equations with time-varying noise
Xinze Zhang and Yong Li. “Onsager-Machlup functional for stochastic differential equations with time-varying noise”. In:arXiv preprint arXiv:2407.04290(2024)
work page internal anchor Pith review Pith/arXiv arXiv 2024
-
[24]
Machine learning framework for computing the most probable paths of stochastic dynamical systems
Yang Li, Jinqiao Duan, and Xianbin Liu. “Machine learning framework for computing the most probable paths of stochastic dynamical systems”. In:Physical Review E103 (2021)
work page 2021
-
[25]
Trajectory entropy of continuous stochastic processes at equilib- rium
Kevin R Haas, Haw Yang, and Jhih-Wei Chu. “Trajectory entropy of continuous stochastic processes at equilib- rium”. In:The Journal of Physical Chemistry Letters5.6 (2014), pp. 999–1003
work page 2014
-
[26]
On gradient descent ascent for nonconvex-concave minimax problems
Tianyi Lin, Chi Jin, and Michael Jordan. “On gradient descent ascent for nonconvex-concave minimax problems”. In:Proceedings of the 37th International Conference on Machine Learning. Ed. by Hal Daum ´e III and Aarti Singh. V ol. 119. Proceedings of Machine Learning Research. PMLR, 2020, pp. 6083–6093.URL: https:// proceedings.mlr.press/v119/lin20a.html
work page 2020
-
[27]
A single-loop smoothed gradient descent-ascent algorithm for nonconvex-concave min-max problems
Jiawei Zhang et al. “A single-loop smoothed gradient descent-ascent algorithm for nonconvex-concave min-max problems”. In:Advances in neural information processing systems33 (2020), pp. 7377–7389
work page 2020
-
[28]
Adam: A Method for Stochastic Optimization
Diederik P. Kingma and Jimmy Ba. “Adam: A Method for Stochastic Optimization”. In:3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings. Ed. by Yoshua Bengio and Yann LeCun. 2015.URL: http://arxiv.org/abs/1412.6980
Pith/arXiv arXiv 2015
-
[29]
MTAdam: Automatic Balancing of Multiple Training Loss Terms
Itzik Malkiel and Lior Wolf. “MTAdam: automatic balancing of multiple training loss terms”. In:arXiv preprint arXiv:2006.14683(2020)
work page internal anchor Pith review Pith/arXiv arXiv 2006
-
[30]
Jacobian descent for multi-objective optimization
Pierre Quinton and Val ´erian Rey. “Jacobian descent for multi-objective optimization”. In:arXiv preprint arXiv:2406.16232(2024)
Pith/arXiv arXiv 2024
-
[31]
Pytorch: An imperative style, high-performance deep learning library
Adam Paszke et al. “Pytorch: An imperative style, high-performance deep learning library”. In:Advances in neural information processing systems32 (2019). 20
work page 2019
This paper was first reviewed by deepseek-v4-flash on August 4, 2026.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.