A study of path measures based on second-order Hamilton--Jacobi equations and their applications in stochastic thermodynamics
Pith reviewed 2026-05-19 00:57 UTC · model grok-4.3
The pith
Thermodynamic irreversibility appears as the difference between forward and backward second-order Hamilton-Jacobi equations, with large deviation rate functions equivalent to Onsager-Machlup functionals.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Second-order Hamilton-Jacobi equations derived from the probabilistic structure of path measures give the large deviation rate function, which is proved identical to the Onsager-Machlup functional for stochastic gradient systems. Entropy production then decomposes so that its irreversible part equals the difference between the forward and backward second-order Hamilton-Jacobi equations. The same equations also recover the solutions of finite-horizon entropy minimization and Schrödinger's problem, thereby embedding stochastic thermodynamics inside stochastic geometric mechanics.
What carries the argument
Second-order Hamilton-Jacobi equations that convert the probabilistic law of path measures into both a large-deviation rate function and an entropy-production decomposition.
If this is right
- Large-deviation principles for path measures follow directly once the second-order Hamilton-Jacobi structure is known.
- Entropy-minimization problems on finite time horizons and Schrödinger's problem are recovered as instances of stochastic geometric mechanics.
- Entropy production splits into a reversible part and an irreversible part given exactly by the difference of forward and backward second-order Hamilton-Jacobi equations.
- The same framework yields a unified treatment of large deviations, entropy minimization, and thermodynamic irreversibility.
Where Pith is reading between the lines
- The forward-backward difference may supply a practical route to compute entropy production by solving the pair of Hamilton-Jacobi equations numerically.
- The same second-order structure could be tested on non-gradient drifts to see whether the equivalence with Onsager-Machlup functionals survives.
- Connections between the Hamilton-Jacobi formulation and optimal-control or quantum-dissipation problems become visible once the second-order equations are written explicitly.
Load-bearing premise
Second-order Hamilton-Jacobi equations supply a complete and rigorous link between the law of path measures and the entropy-production decomposition without extra regularity or approximation conditions on the underlying processes.
What would settle it
A concrete stochastic gradient system in which the large-deviation rate function computed from the path-measure law differs from the Onsager-Machlup functional obtained from the associated second-order Hamilton-Jacobi equation.
read the original abstract
This paper provides a systematic investigation of the mathematical structure of path measures and their profound connections to stochastic differential equations (SDEs) through the framework of second-order Hamilton--Jacobi (HJ) equations. This approach establishes a unified methodology for analyzing large deviation principles (LDPs), entropy minimization, and entropy production in stochastic systems. Second-order HJ equations are shown to play a central role in bridging stochastic dynamics and measure theory while forming the foundation of stochastic geometric mechanics and their applications in stochastic thermodynamics. The large deviation rate function is rigorously derived from the probabilistic structure of path measures and proved to be equivalent to the Onsager--Machlup functional of stochastic gradient systems coupled with second-order HJ equations. We revisit entropy minimization problems, including finite time horizon problems and Schr\"{o}dinger's problem, demonstrating the connections with stochastic geometric mechanics. Furthermore, we present a novel decomposition of entropy production for stochastic systems, revealing that thermodynamic irreversibility can be interpreted as the difference of the corresponding forward and backward second-order HJ equations. Together, this work establishes a comprehensive mathematical study of the relations between path measures and stochastic dynamical systems, and their diverse applications in stochastic thermodynamics and beyond.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper provides a systematic investigation of the mathematical structure of path measures connected to SDEs via second-order Hamilton-Jacobi equations. It claims to rigorously derive large deviation rate functions from the probabilistic structure of path measures and prove their equivalence to the Onsager-Machlup functional for stochastic gradient systems, revisit entropy minimization problems including finite-horizon and Schrödinger problems, and present a novel decomposition of entropy production as the difference between corresponding forward and backward second-order HJ equations, thereby interpreting thermodynamic irreversibility.
Significance. If the central derivations hold with the necessary rigor, the work establishes a unified framework bridging path measures, second-order HJ equations, and stochastic thermodynamics. The claimed equivalence of the LDP rate function to the Onsager-Machlup functional and the HJ-based decomposition of entropy production could offer new analytical tools for irreversibility in stochastic systems and strengthen connections to stochastic geometric mechanics.
major comments (1)
- [Derivation of LDP rate function and equivalence to Onsager-Machlup functional (main theorems section)] The abstract and main claims assert a rigorous derivation of the large deviation rate function from path measures and its equivalence to the Onsager-Machlup functional of stochastic gradient systems coupled with second-order HJ equations. This equivalence is load-bearing for both the LDP and the entropy production decomposition. However, the passage to the second-order HJ equations (likely via Itô's formula or variational principles) requires unstated regularity conditions on the SDE coefficients, such as C² smoothness, uniform ellipticity, and linear growth bounds. These are not explicitly stated or verified for the general path measures considered, creating a potential gap that would render the thermodynamic interpretations non-rigorous.
minor comments (2)
- [Abstract] The abstract uses the term 'rigorously derived' without a brief parenthetical on the key regularity assumptions; adding this would improve clarity for readers.
- [Introduction and notation sections] Notation for forward and backward second-order HJ equations should be introduced with explicit definitions and any domain/boundary conditions in the early sections to aid readability.
Simulated Author's Rebuttal
We thank the referee for their careful reading and constructive comments on our manuscript. We address the major comment below and will incorporate the suggested clarifications to strengthen the rigor of the derivations.
read point-by-point responses
-
Referee: [Derivation of LDP rate function and equivalence to Onsager-Machlup functional (main theorems section)] The abstract and main claims assert a rigorous derivation of the large deviation rate function from path measures and its equivalence to the Onsager-Machlup functional of stochastic gradient systems coupled with second-order HJ equations. This equivalence is load-bearing for both the LDP and the entropy production decomposition. However, the passage to the second-order HJ equations (likely via Itô's formula or variational principles) requires unstated regularity conditions on the SDE coefficients, such as C² smoothness, uniform ellipticity, and linear growth bounds. These are not explicitly stated or verified for the general path measures considered, creating a potential gap that would render the thermodynamic interpretations non-rigorous.
Authors: We appreciate the referee for identifying this important point to ensure full mathematical rigor. The derivations indeed rely on Itô's formula applied to solutions of the second-order HJ equations and on variational principles connecting path measures to the Onsager-Machlup functional. These steps require the SDE coefficients to be C² smooth, the diffusion matrix to be uniformly elliptic, and linear growth bounds to hold in order to guarantee well-posedness of the SDEs, validity of the large deviation principle, and applicability of the thermodynamic interpretations. While these conditions are standard for the class of stochastic gradient systems considered in the paper and were implicitly used throughout the analysis, we agree they were not explicitly stated or verified in the main theorems section. In the revised manuscript we will add a dedicated paragraph (or short subsection) immediately preceding the main results that explicitly lists these regularity assumptions and confirms their satisfaction for the path measures under study. This clarification will make the scope of the equivalence and the entropy-production decomposition fully rigorous without changing any of the core statements or proofs. revision: yes
Circularity Check
No significant circularity; derivations start from path measures and SDEs
full rationale
The paper derives the large deviation rate function directly from the probabilistic structure of path measures and establishes its equivalence to the Onsager-Machlup functional through coupling with second-order HJ equations. The entropy production decomposition is introduced as an interpretation of the difference between forward and backward HJ equations. These steps are framed as beginning from the underlying stochastic dynamics and measure theory rather than presupposing thermodynamic outputs or reducing via self-definition, fitted inputs renamed as predictions, or load-bearing self-citations. No equations or claims in the abstract or described chain exhibit the enumerated circular patterns, and the methodology is presented as self-contained against external probabilistic benchmarks.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption Second-order Hamilton-Jacobi equations can be coupled to the probabilistic structure of path measures to derive large deviation rate functions.
Lean theorems connected to this paper
-
IndisputableMonolith/Foundation/ArrowOfTime.leanarrow_from_z echoes?
echoesECHOES: this paper passage has the same mathematical shape or conceptual pattern as the Recognition theorem, but is not a direct formal dependency.
thermodynamic irreversibility can be interpreted as the difference of the corresponding forward and backward second-order HJ equations... large deviation rate function proved equivalent to the Onsager-Machlup functional
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
second-order Hamilton–Jacobi equation (2.13) ... Φ(ω)=∫V dt + g(ω(T))
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
-
[1]
B. D. Anderson. Reverse-time diffusion equation models.Stochastic Processes and their Applications, 12(3):313–326, 1982
work page 1982
-
[2]
P. Ao. Emerging of stochastic dynamical equalities and steady state thermodynamics from darwinian dynamics.Communications in Theoretical Physics, 49(5):1073, 2008
work page 2008
-
[3]
V. I. Arnol’d.Mathematical Methods of Classical Mechanics, volume 60. Springer Science & Business Media, 2013
work page 2013
-
[4]
Baudoin.Diffusion Processes and Stochastic Calculus
F. Baudoin.Diffusion Processes and Stochastic Calculus. European Mathematical Society, 2014
work page 2014
-
[5]
J.-M. Bismut. Conjugate convex functions in optimal stochastic control.Journal of Mathematical Analysis and Applications, 44(2):384–404, 1973
work page 1973
-
[6]
J.-M. Bismut. Linear quadratic optimal stochastic control with random coefficients.SIAM Journal on Control and Optimization, 14(3):419–444, 1976
work page 1976
-
[7]
N. M. Boffi and E. Vanden-Eijnden. Deep learning probability flows and entropy production rates in active matter.Proceedings of the National Academy of Sciences, 121(25):e2318106121, 2024
work page 2024
-
[8]
V. I. Bogachev.Gaussian Measures. Number 62 in Placeholder Series. American Mathematical Soc., 1998
work page 1998
-
[9]
K. L. Chung and J.-C. Zambrini.Introduction to Random Time and Quantum Randomness, vol- ume 1. World Scientific, new edition, 2003
work page 2003
-
[10]
M. G. Crandall, L. C. Evans, and P.-L. Lions. Some properties of viscosity solutions of Hamilton- Jacobi equations.Transactions of the American Mathematical Society, 282(2):487–502, 1984
work page 1984
- [11]
-
[12]
A. Dembo and O. Zeitouni.Large Deviations Techniques and Applications, volume 38. Springer Berlin Heidelberg, 2010
work page 2010
-
[13]
Q. Du, T. Li, X. Li, and W. Ren. The graph limit of the minimizer of the Onsager-Machlup functional and its computation.Science China Mathematics, 64:239–280, 2021
work page 2021
-
[14]
D. D¨ urr and A. Bach. The Onsager-Machlup function as Lagrangian for the most probable path of a diffusion process.Communications in Mathematical Physics, 60(2):153–170, 1978
work page 1978
-
[15]
W. H. Fleming and H. M. Soner.Controlled Markov Processes and Viscosity Solutions, volume 25. Springer-Verlag, 2006
work page 2006
-
[16]
Friedman.Partial Differential Equations of Parabolic Type
A. Friedman.Partial Differential Equations of Parabolic Type. Prentice-Hall, Englewood Cliffs, NJ, 1964
work page 1964
- [17]
-
[18]
M. Giaquinta and S. Hildebrandt.Calculus of Variations I, II, volume 310, 311. Springer-Verlag Berlin Heidelberg, 1996
work page 1996
- [19]
-
[20]
Hollander.Large Deviations, volume 14
F. Hollander.Large Deviations, volume 14. American Mathematical Soc., 2000
work page 2000
-
[21]
Q. Huang and J.-C. Zambrini. Hamilton–Jacobi–Bellman equations in stochastic geometric mechan- ics. InPhysical Sciences Forum, volume 5, page 37. MDPI, 2022
work page 2022
-
[22]
Q. Huang and J.-C. Zambrini. From second-order differential geometry to stochastic geometric mechanics.Journal of Nonlinear Science, 33(4):67, 2023
work page 2023
-
[23]
Q. Huang and J.-C. Zambrini. Gauge transformations in stochastic geometric mechanics. InInter- national Conference on Geometric Science of Information, pages 583–591. Springer, 2023
work page 2023
-
[24]
Q. Huang and J.-C. Zambrini. Stochastic geometric mechanics in nonequilibrium thermodynamics: Schr¨ odinger meets Onsager.Journal of Physics A: Mathematical and Theoretical, 56(13):134003, 2023
work page 2023
-
[25]
arXiv preprint arXiv:2504.06628 (2025)
Y. Huang, C. Liu, B. Miao, and X. Zhou. Entropy production in non-Gaussian active matter: A unified fluctuation theorem and deep learning framework.arXiv preprint arXiv:2504.06628, 2025
-
[26]
B. Jamison. Reciprocal processes.Zeitschrift f¨ ur Wahrscheinlichkeitstheorie und Verwandte Gebiete, 30(1):65–86, 1974
work page 1974
-
[27]
Kallenberg.Foundations of Modern Probability
O. Kallenberg.Foundations of Modern Probability. Springer, 1997
work page 1997
-
[28]
I. Karatzas and S. Shreve.Brownian Motion and Stochastic Calculus, volume 113. Springer Science & Business Media, 2012
work page 2012
-
[29]
Stochastic derivatives and generalized h-transforms of Markov processes
C. L´ eonard. Stochastic derivatives and generalizedh-transforms of Markov processes.arXiv preprint arXiv:1102.3172, 2011
work page internal anchor Pith review Pith/arXiv arXiv 2011
- [30]
- [31]
- [32]
- [33]
-
[34]
Y. Lu, A. Stuart, and H. Weber. Gaussian approximations for transition paths in Brownian dynamics. SIAM Journal on Mathematical Analysis, 49(4):3005–3047, 2017
work page 2017
-
[35]
S. Machlup and L. Onsager. Fluctuations and irreversible process. II. systems with kinetic energy. Physical Review, 91(6):1512, 1953
work page 1953
- [36]
-
[37]
T. Mikami. Monge’s problem with a quadratic cost by the zero-noise limit of h-path processes. Probability Theory and Related Fields, 129(2):245–260, 2004
work page 2004
-
[38]
Nelson.Dynamical Theories of Brownian Motion, volume 106
E. Nelson.Dynamical Theories of Brownian Motion, volume 106. Princeton University Press, 2nd edition, 2001
work page 2001
-
[39]
Nualart.The Malliavin Calculus and Related Topics, volume 1995
D. Nualart.The Malliavin Calculus and Related Topics, volume 1995. Springer, 2006
work page 1995
-
[40]
L. Onsager and S. Machlup. Fluctuations and irreversible processes.Physical Review, 91(6):1505, 1953
work page 1953
-
[41]
´E. Pardoux. Bsdes, weak convergence and homogenization of semilinear PDEs. InNonlinear analysis, differential equations and control, pages 503–549. Springer, 1999
work page 1999
-
[42]
E. Pardoux and S. Peng. Adapted solution of a backward stochastic differential equation.Systems & Control Letters, 14(1):55–61, 1990
work page 1990
-
[43]
S. Peng. Stochastic Hamilton–Jacobi–Bellman equations.SIAM Journal on Control and Optimiza- tion, 30(2):284–304, 1992
work page 1992
-
[44]
F. J. Pinski, G. Simpson, A. M. Stuart, and H. Weber. Kullback–Leibler approximation for probabil- ity measures on infinite dimensional spaces.SIAM Journal on Mathematical Analysis, 47(6):4091– 4122, 2015
work page 2015
-
[45]
H. Qian. Mathematical formalism for isothermal linear irreversibility.Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences, 457(2011):1645–1655, 2001
work page 2011
-
[46]
H. Qian. Nonlinear stochastic dynamics of mesoscopic homogeneous biochemical reaction sys- tems—an analytical theory.Nonlinearity, 24(6):R19, 2011
work page 2011
-
[47]
U. Seifert. Entropy production along a stochastic trajectory and an integral fluctuation theorem. Physical Review Letters, 95(4):040602, 2005
work page 2005
-
[48]
Z. Selk, W. Haskell, and H. Honnappa. Information projection on Banach spaces with applications to state independent KL-weighted optimal control.Applied Mathematics and Optimization, 84(1):805– 835, 2021
work page 2021
-
[49]
Z. Selk and H. Honnappa. The small-noise limit of the most likely element is the most likely element in the small-noise limit.arXiv preprint arXiv:2209.04523, 2022
-
[50]
A. M. Stuart. Inverse problems: a bayesian perspective.Acta Numerica, 19:451–559, 2010
work page 2010
-
[51]
E. Todorov. Efficient computation of optimal actions.Proceedings of the National Academy of Sciences, 106(28):11478–11483, 2009
work page 2009
- [52]
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.