Entropy production for autoregressive generative models is defined as the log-ratio of forward to protocol-reversed sequence probabilities and is computable at ordinary log-likelihood cost.
To examine how the Monte Carlo estimates stabilize as the sample size grows, Figure 6 plots the cumulative sample mean ofσ token/Tandσ block/T ′ forT= 120, as a function ofN
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cond-mat.stat-mech 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Stochastic Thermodynamics for Autoregressive Generative Models: A Non-Markovian Perspective
Entropy production for autoregressive generative models is defined as the log-ratio of forward to protocol-reversed sequence probabilities and is computable at ordinary log-likelihood cost.