REVIEW 2 major objections 4 minor 56 references
Learning Physics from Data: a Thermodynamic Interpretation
T0 review · 2 major / 4 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read When learning the dynamics of a damped rigid body, adding dissipation removes the energy ambiguity that pure Hamiltonian trajectories leave behind.
desk verdict Worth reading for the Casimir-lifting observation, but the paper overgeneralizes from one special dissipation model and its numerical demo is an in-sample fit. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the GENERIC evolution equation (General Equation for Non-Equilibrium Reversible-Irreversible Coupling), written as $\dot x_i = L_{ij}\,\partial E/\partial x_j + \partial\Xi/\partial x^*_i$ evaluated at $x^* = \partial S/\partial x$, which splits dynamics into a reversible Hamiltonian part generated by a Poisson bivector $L$ and an irreversible gradient part driven by a dissipation potential $\Xi$. For the rigid body the Poisson bracket is non-canonical, $\{F,G\} = -\boldsymbol m \cdot (\partial F/\partial \boldsymbol m \times \partial G/\partial \boldsymbol m)$, and the Casimir $|\boldsymbol m|^2$ is conserved by the reversible part. Adding the energetic Ehrenfest regularization, $\dot{\boldsymbol m} = \boldsymbol m \times \partial E/\partial \boldsymbol m - (\tau/2)\, L^T (\partial^2 E/\partial \boldsymbol m \partial \boldsymbol m)\, L\,(\partial E/\partial \boldsymbol m)$, keeps $|\boldsymbol m|^2$ fixed while dissipating kinetic energy, which makes the Casimir visible in the trajectory and therefore learnable.
What would settle it
Simulate a rigid body with the same quadratic energy but a different Casimir-preserving dissipation, for example Rayleigh damping proportional to angular velocity, fit the same quadratic Ansatz to the trajectory, and check whether the learned inverse inertia tensor converges to the exact one as the trajectory lengthens; if it does not, the identifiability result is specific to the energetic Ehrenfest regularisation.
Extended reading notes
Core claim
The paper's central claim is that reversible dynamics alone carries no information about the Casimirs of its Poisson bracket, so any energy learned from a purely Hamiltonian trajectory is determined only up to a shift by a function of those Casimirs (for the rigid body, up to a multiple of $|\boldsymbol m|^2$). When the same system is observed with dissipation included, the Casimirs enter the dynamics and the full energy becomes identifiable. The authors verify this on the damped rigid body: with $ au=0$ the learned quadratic energy differs from the exact one by a Casimir shift, while for $ au>0$ the learned matrix of second derivatives converges to the exact inverse inertia tensor.
Load-bearing premise
The argument assumes the observed dissipation has the specific energetic Ehrenfest form of Eq. (23), that the quadratic Ansatz for the energy is correct, and that the Poisson bivector and timestep of the numerical scheme are known; if a real system dissipates through a different Casimir-preserving mechanism, the paper does not establish that the full energy remains identifiable.
Editorial extensions
If this is right
- For any system with a non-canonical Poisson bracket, purely Hamiltonian trajectory data determine the energy only up to the Casimir invariants of the bracket; generative models that ignore this will return shifted energies.
- Adding irreversible dynamics of the type considered in Eq. (23) makes the full energy identifiable, so dissipative data are not a nuisance but a resource for learning physics.
- The thermodynamic viewpoint supplies the missing embedding between reduced and detailed manifolds: reduction is entropy-driven and the embedding can be constructed via the maximum-entropy principle, connecting manifold learning methods such as POD and LLE with GENERIC.
- Learned reduced models with GENERIC structure can be integrated to predict future states on the reduced manifold and then lifted to the original data space, giving predictions in the rich space where validation is meaningful.
Reading between the lines
- The identifiability claim is demonstrated for one parametric family of dissipation (the energetic Ehrenfest regularization); a natural extension would test whether other Casimir-preserving dissipation mechanisms, such as linear Rayleigh damping, also lift the degeneracy.
- If dissipation lifts the energy ambiguity generally, then deliberately adding controlled dissipation to experimental protocols could become a practical identification technique for the energies of non-canonical systems.
- The entropy-driven learning picture suggests that fluctuations in the database carry thermodynamic information about the learning dynamics itself; analysing those fluctuations could supplement deterministic trajectory fitting.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper proposes a thermodynamic interpretation of machine learning, in which learning/reduction is viewed as a dissipative dynamics driven by entropy within the GENERIC framework, while reversible Hamiltonian evolution is interpreted as propagation within a level of description. The authors illustrate the idea with POD, where the Rayleigh quotient is interpreted as an entropy and eigendecomposition as a gradient flow, and with a rigid-body example in which the energy is learned from angular-momentum trajectories. The central new claim is that for dynamics with non-canonical Poisson brackets, the energy can be reconstructed only up to Casimirs of the bracket from reversible trajectories, but when dissipation is present the full energy becomes identifiable; this is demonstrated numerically for the energetic Ehrenfest regularization of Eq. (23).
Significance. If the general identifiability claim were established, the paper would provide a useful bridge between non-equilibrium thermodynamics and data-driven modeling: the Casimir obstruction is a real and often ignored issue in learning Hamiltonian systems, and the idea that dissipation of the specific Ehrenfest type reveals Casimirs is an interesting and testable observation. The paper ships reproducible code for the rigid-body experiment and states a falsifiable prediction (full energy identifiable with dissipation of the form (23)). The mathematical facts invoked about Casimirs and about the gradient-flow representation of eigenproblems are correct. However, the paper is primarily conceptual; it does not provide a general identifiability theorem, and the only quantitative evidence is a self-consistency check on data generated by the same model. The significance is therefore moderate: as a perspective piece with a concrete illustration, it is valuable; as a general result, it is incomplete.
major comments (2)
- [Sec. 6 and Sec. 5, Eq. (23)] The claim in the abstract, introduction, and conclusion that 'when having both the reversible and irreversible (dissipative) terms, the whole energy can be learned' is stated without qualification, but the demonstration only covers the energetic Ehrenfest dissipation of Eq. (23), where the dissipative term contains the Hessian of E and is therefore sensitive to Casimir shifts E -> E + λ |m|^2 because L^T L = |m|^2 I - m m^T. For a generic Casimir-conserving dissipation that is a gradient projected onto the sphere, e.g. dm/dt = m × grad E - γ (I - m_hat m_hat^T) grad E with γ > 0, the shift changes grad E by 2λ m, which lies in the kernel of the projector, so the observed trajectory is identical for all λ and the full energy remains unidentifiable. The paper itself states in Sec. 5 that the Poisson bivector, timestep, quadratic Ansatz, and dissipation mechanism are assumed known. The general conclusion is therefore not established; the authors should either prove an identifiability condition for the class of GENERIC dissipations under consideration or restrict the claim to the specific dissipative structure of Eq. (23).
- [Sec. 5] The numerical experiment is an in-sample self-consistency check: the trajectories are generated by integrating Eq. (23) with a known quadratic energy and known τ, and the learning algorithm fits the same parametric family to those same trajectories. The paper does not report any out-of-sample prediction, noise sensitivity, or cross-validation, so the demonstration supports identifiability of the parameters from perfectly observed data only, not the ability to learn energy from real noisy data. The text should state this explicitly (or add an out-of-sample experiment) so the reader does not infer a stronger claim than the experiment supports.
minor comments (4)
- [Sec. 5, paragraph after Fig. 2] The sentence 'By adding dissipation, the Casimirs now play a role in the dynamics, and the can be learned from the trajectory' contains a typo: 'the' should be 'they'.
- [Fig. 2 caption] The caption states both that the energy error 'eventually vanishes as the dissipation becomes significant' and that 'the higher the exact value of the coefficient (stronger dissipation), the higher is the error between the exact and learned values'; these statements appear contradictory, and the text should clarify whether the latter refers only to the error in τ and why that error increases.
- [Sec. 3.2.4] The entropy S(x) in Eq. (12) is introduced as an interpretation ('We shall interpret ...'), not as a derived quantity; stating explicitly that this is an analogy would help readers distinguish between the thermodynamic formalism and the POD algorithm.
- [Sec. 4] The free-surface-liquid illustration is a summary of previous work [12] with no new simulation; consider shortening it or clearly labeling it as a review so that the novel contribution of the paper is not obscured.
Circularity Check
No significant circularity: the Sec. 5 fit is an identifiability test with known ground truth, not an out-of-sample prediction, and the Sec. 6 generalization is an extrapolation beyond the demonstrated dissipation family rather than a circular step.
full rationale
The paper's central numerical demonstration in Sec. 5 is an inverse-problem check: synthetic trajectories are generated from the quadratic energy Eq. (21)-(22) using the energetic Ehrenfest dissipation Eq. (23), and then the same parametric form is fitted by least squares. The paper explicitly states that the learned energy and tau are compared with 'the exact ones (used when generating trajectories).' This is not circular in the forbidden sense: the fit is not presented as an out-of-sample prediction, and the experiment is designed to show identifiability of the energy matrix when dissipation is present. The fact that the data are generated from the same ansatz is exactly what makes the ground-truth comparison meaningful; it does not force the claimed result, because with tau = 0 the same fit demonstrably fails to identify the Casimir direction. The mathematical mechanism is explicit in Eq. (23): the dissipative term contains L^T (d^2 E/dm dm) L dE/dm, so a Casimir shift E -> E + lambda m^2 changes the dissipative term even though it leaves L m = 0; the numerical fit then recovers the full Hessian. This is a valid demonstration for the stated model class. The paper's broader Sec. 6 wording ('the whole energy can be learned') goes beyond the one dissipation family demonstrated, since Sec. 5 assumes the Poisson bivector, timestep, quadratic Ansatz, and the Ehrenfest dissipation mechanism are known. That is a limitation of scope and a potential overgeneralization, i.e., a correctness or risk concern, not a circularity: no equation in the paper reduces to its own input by definition, and no fitted parameter is renamed as a prediction. The heavy reliance on the authors' own GENERIC and Ehrenfest literature ([14]-[17], [23], [28], [33], [37], [38]) is normal citation of previously published, externally falsifiable frameworks; in particular Eq. (23) is quoted from [38] rather than derived from the present data. Consequently no circular step meeting the required quote-and-reduction standard is present.
Assumptions & free parameters
free parameters (4)
- Energy matrix E_ij entries =
not reported, only squared errors in Fig. 2
- Dissipation coefficient tau =
learned values in [0, 8e-3] (exact values used to generate data)
- Number of retained POD modes k (and LLE neighbor count K) =
not specified
- Time step of numerical scheme =
not stated
assumptions (6)
- domain assumption Reduced dynamics has the GENERIC form (3): dx/dt = L grad E + gradient of dissipation potential.
- domain assumption Energy of the rigid body is a quadratic form in angular momentum (Eq. 21).
- standard math The Poisson bracket of the rigid body is the non-canonical bracket (19).
- ad hoc to paper The Rayleigh quotient S(x) = x^T A x / x^T x is the entropy of the POD learning process.
- domain assumption Dissipative term in Eq. (23) is the energetic Ehrenfest regularization with known structure.
- ad hoc to paper Data trajectories in Sec. 5 are generated by the same model that is subsequently fitted.
invented entities (2)
-
POD entropy (Rayleigh quotient reinterpreted as thermodynamic entropy)
-
Learning time evolution / learning dynamics
Cite this review
Pith. "Pith review of Learning Physics from Data: a Thermodynamic Interpretation." pith.science (2026). https://pith.science/paper/UH266D7A
@misc{pith2026190901074,
author = {Pith},
title = {Pith review of: Learning Physics from Data: a Thermodynamic Interpretation},
year = {2026},
howpublished = {\url{https://pith.science/paper/UH266D7A}},
note = {Machine review of arXiv:1909.01074}
}
read the original abstract
Experimental data bases are typically very large and high dimensional. To learn from them requires to recognize important features (a pattern), often present at scales different to that of the recorded data. Following the experience collected in statistical mechanics and thermodynamics, the process of recognizing the pattern (the learning process) can be seen as a dissipative time evolution driven by entropy from a detailed level of description to less detailed. This is the way thermodynamics enters machine learning. On the other hand, reversible (typically Hamiltonian) evolution is propagation within the levels of description, that is also to be recognized. This is how Poisson geometry enters machine learning. Learning to handle free surface liquids and damped rigid body rotation serves as an illustration.
Reference graph
Works this paper leans on
-
[1]
Gesamtausgabe,Ludwig Boltzmann Gesamtausgabe - Collected Works(1983)
L. Gesamtausgabe,Ludwig Boltzmann Gesamtausgabe - Collected Works(1983)
work page 1983
- [2]
- [3]
-
[4]
JohnsHopkinsStudiesintheMathematicalSci- ences (Johns Hopkins University Press, 2013)
G.Golub,C.VanLoan, MatrixComputations. JohnsHopkinsStudiesintheMathematicalSci- ences (Johns Hopkins University Press, 2013). URLhttps://books.google.cz/books? id=X5YfsuCWpxMC
work page 2013
- [5]
-
[6]
Wasserman, Annual Review of Statistics and Its Application5(1), 501 (2018)
L. Wasserman, Annual Review of Statistics and Its Application5(1), 501 (2018)
work page 2018
-
[7]
S.Brunton,J.Proctor,J.Kutz,ProceedingsoftheNationalAcademyofSciences(2016). DOI 10.1073/pnas.1517384113
- [8]
Show all 56 references
-
[9]
Kevrekidis, G
Y. Kevrekidis, G. Samaey, Scholarpedia5(9), 4847 (2010)
2010
- [10]
-
[11]
W. E, J. Han, Q. Li, Research in the Mathematical Sciences6(1), 10 (2018). DOI 10.1007/ s40687-018-0172-y. URL https://doi.org/10.1007/s40687-018-0172-y
2018 doi
-
[12]
B. Moya, D. Gonzalez, I. Alfaro, F. Chinesta, E. Cueto, Computational Mechanics64(2), 511 (2019). DOI 10.1007/s00466-019-01705-3. URL https://doi.org/10.1007/ s00466-019-01705-3
2019 doi
-
[13]
C. Maes, K. Netočný, eprint arXiv:cond-mat/0202501 (2002)
2002 arXiv
-
[14]
Grmela, H.C
M. Grmela, H.C. Öttinger, Phys. Rev. E56, 6620 (1997). DOI 10.1103/PhysRevE.56.6620. URL http://link.aps.org/doi/10.1103/PhysRevE.56.6620
1997 doi
-
[15]
Öttinger, M
H.C. Öttinger, M. Grmela, Phys. Rev. E56, 6633 (1997). DOI 10.1103/PhysRevE.56.6633
1997 doi
-
[16]
Öttinger,Beyond Equilibrium Thermodynamics(Wiley, 2005)
H. Öttinger,Beyond Equilibrium Thermodynamics(Wiley, 2005)
2005
-
[17]
Pavelka, V
M. Pavelka, V. Klika, M. Grmela,Multiscale Thermo-Dynamics(De Gruyter, Berlin, Boston, 2018). DOI 10.1515/9783110350951. URL http://www.degruyter.com/view/books/ 9783110350951/9783110350951/9783110350951.xml
2018 doi
-
[18]
Pavelka, V
M. Pavelka, V. Klika, M. Grmela, Phys. Rev. E90(062131) (2014)
2014
-
[19]
Onsager, Phys
L. Onsager, Phys. Rev.37, 405 (1931). DOI 10.1103/PhysRev.37.405. URLhttp://link. aps.org/doi/10.1103/PhysRev.37.405
1931 doi
- [20]
- [21]
-
[22]
de Groot, P
S.R. de Groot, P. Mazur,Non-equilibrium Thermodynamics(Dover Publications, New York, 1984)
1984
-
[23]
Grmela, V
M. Grmela, V. Klika, M. Pavelka, Phys. Rev. E92(032111) (2015)
2015
-
[24]
Grmela, Journal of Statistical Physics166(2), 282 (2017)
M. Grmela, Journal of Statistical Physics166(2), 282 (2017)
2017
-
[25]
Grmela, Journal of Physics Communications2(032001) (2018)
M. Grmela, Journal of Physics Communications2(032001) (2018)
2018
-
[26]
Shannon, Bell System Technical Journal27, 379 (1948)
C.E. Shannon, Bell System Technical Journal27, 379 (1948)
1948
-
[27]
Jaynes, Physical Review106(4), 620 (1957)
E.T. Jaynes, Physical Review106(4), 620 (1957)
1957
-
[28]
Gorban, I
A. Gorban, I. Karlin,Invariant Manifolds for Physical and Chemical Kinetics. Lecture Notes in Physics (Springer, 2005). URLhttp://books.google.cz/books?id=hjvjPmL5rPwC
2005
-
[29]
Klika, M
V. Klika, M. Pavelka, P. Vágner, M. Grmela, Entropy21(715) (2019). DOI doi:10.3390/ e21070715
2019
-
[30]
Cambridge Mathematical Library (Cambridge University Press, 1990)
S.Chapman,T.Cowling,D.Burnett,C.Cercignani, TheMathematicalTheoryofNon-uniform Gases: An Account of the Kinetic Theory of Viscosity, Thermal Conduction and Diffusion in Gases. Cambridge Mathematical Library (Cambridge University Press, 1990). URLhttps: //books.google.cz/books?i...
1990
-
[31]
Callen,Thermodynamics: an introduction to the physical theories of equilibrium thermo- statics and irreversible thermodynamics(Wiley, 1960)
H. Callen,Thermodynamics: an introduction to the physical theories of equilibrium thermo- statics and irreversible thermodynamics(Wiley, 1960). URLhttp://books.google.cz/ books?id=mf5QAAAAMAAJ
1960
-
[32]
Turkington, J Stat Phys152, 569 (2013)
B. Turkington, J Stat Phys152, 569 (2013)
2013
-
[33]
Pavelka, V
M. Pavelka, V. Klika, M. Grmela, Journal of Statistical PhysicsAccepted(2020) Learning Physics from Data: a Thermodynamic Interpretation 23
2020
-
[34]
Dover Books on Physics (Dover Publications, 1990)
P.Ehrenfest,T.Ehrenfest, TheConceptualFoundationsoftheStatisticalApproachinMechan- ics. Dover Books on Physics (Dover Publications, 1990)
1990
-
[35]
A.N.Gorban,I.V.Karlin,H.C.Öttinger,L.L.Tatarinova,PhysicalReviewE 63(066124)(2001)
2001
-
[36]
I.V.Karlin,L.L.Tatarinova,A.N.Gorban,H.C.Öttinger,PhysicaA:StatisticalMechanicsand its Applications327(3-4), 399 (2003)
2003
-
[37]
Pavelka, V
M. Pavelka, V. Klika, M. Grmela, Entropy20 (2018)
2018
-
[38]
Pavelka, V
M. Pavelka, V. Klika, M. Grmela, Physica D: Nonlinear Phenomena 399, 193 (2019). DOIhttps://doi.org/10.1016/j.physd.2019.06.006.URL http://www.sciencedirect.com/ science/article/pii/S0167278918305232
2019 doi
-
[39]
doi.org/10.1016/j.camwa.2012.11.019
M.Grmela,ComputersandMathematicswithApplications 65(10),1457(2013).DOIhttp://dx. doi.org/10.1016/j.camwa.2012.11.019. URLhttp://www.sciencedirect.com/science/ article/pii/S0898122112006803
2013 doi
-
[40]
Grmela, Entropy16(3), 1652 (2014)
M. Grmela, Entropy16(3), 1652 (2014). DOI 10.3390/e16031652
2014 doi
-
[41]
Čapek,R.U.R
K.l.. Čapek,R.U.R. (Rossum’s Universal Robots)(London ; New York :Penguin Books, 2004)
2004
-
[42]
Chatterjee, Current Science78(7) (2000)
A. Chatterjee, Current Science78(7) (2000)
2000
-
[43]
Brockett, Linear algebra and its applications146, 79 (1991)
R. Brockett, Linear algebra and its applications146, 79 (1991). DOI 10.1016/0024-3795(91) 90021-N
1991 doi
-
[44]
Bloch, P.S
A.M. Bloch, P.S. Krishnaprasad, J.E. Marsden, T.S. Ratiu, Annales de l’I.H.P. Analyse non linéaire 11(1), 37 (1994)
1994
-
[45]
Absil, International Journal of Unconventional Computing2(4), 291 (2006)
A. Absil, International Journal of Unconventional Computing2(4), 291 (2006)
2006
-
[46]
Gingold, J
R. Gingold, J. Monaghan, Mon. Not. R. Astron. Soc.181(3), 375 (1977)
1977
-
[47]
DOI10.1103/PhysRevE.67.026705
P.Español,M.Revenga,Phys.Rev.E 67,026705(2003). DOI10.1103/PhysRevE.67.026705. URL https://link.aps.org/doi/10.1103/PhysRevE.67.026705
2003 doi
-
[48]
Ellero, P
M. Ellero, P. Espaňol, Appl. Math. Mech.39(1), 103 (2018)
2018
-
[49]
DOI 10.1007/s00161-018-0677-z
D.González,F.Chinesta,E.Cueto,ContinuumMechanicsandThermodynamics(2018). DOI 10.1007/s00161-018-0677-z
2018 doi
-
[50]
González, F
D. González, F. Chinesta, E. Cueto, Frontiers Materials6(14) (2019)
2019
-
[51]
SpecialIssueonLinear Systems and Control
R.Brockett,LinearAlgebraanditsApplications 122-124,761(1989). SpecialIssueonLinear Systems and Control
1989
-
[52]
Landau, E
L. Landau, E. Lifshitz,Mechanics. Butterworth-Heinemann (Butterworth-Heinemann, 1976)
1976
-
[53]
Arnold, Annales de l’institut Fourier16(1), 319 (1966)
V. Arnold, Annales de l’institut Fourier16(1), 319 (1966)
1966
-
[54]
DOI 10.2307/1999527
J.Marsden,T.Ratiu,A.Weinstein,Transactionsoftheamericanmathematicalsociety 281(1), 147 (1984). DOI 10.2307/1999527
1984 doi
-
[55]
Simo, J.E
J.C. Simo, J.E. Marsden, P.S. Krishnaprasad, Archive for Rational Mechanics and Analy- sis 104(2), 125 (1988). DOI 10.1007/BF00251673. URL https://doi.org/10.1007/ BF00251673
1988 doi
-
[56]
Pavelka, M
M. Pavelka, M. Šípka. machine-learning-rigid-body. https://github.com/enaipi/machine- learning-rigid-body.git (2020)
2020
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.