SGLD favors wide loss minima through the Eyring free-energy formula, and GANs act like a predator-prey system that pushes learning out of narrow likelihood maxima.
The Arrhenius formula in kinetic theory and Witten's spectral asymptotics
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
A new approach to the proof of the Arrhenius formula of kinetic theory is proposed. We prove this formula starting from the equation of diffusion in a potential. We put this diffusion equation in the form of evolutionary equation generated by some Schroedinger operator. We show that the Arrhenius formula for the rate of over the barrier transitions follows from the formula for the rate of quantum tunnel transitions for the considered Schroedinger operator. Relation of the proposed approach and the Witten method of the proof of the Morse inequalities is discussed. In our approach the Witten spectral asymptotics takes the form of the low temperature limit and the Arrhenius formula is a correction to the Witten asymptotics.
citation-role summary
citation-polarity summary
fields
cs.LG 1years
2024 1verdicts
CONDITIONAL 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
Control of Overfitting with Physics
SGLD favors wide loss minima through the Eyring free-energy formula, and GANs act like a predator-prey system that pushes learning out of narrow likelihood maxima.