REVIEW 3 major objections 5 minor 1 cited by
Direct estimates of irreversibility from time series
T0 review · 3 major / 5 minor · reviewed 2026-08-10 · deepseek-v4-flash
Pith's one-line read A model-free estimator of forward-reverse trajectory divergence, corrected for finite-sample bias, recovers zero irreversibility in equilibrium and detects a nonzero arrow of time in single retinal neurons.
desk verdict A clean bias-correction recipe for plug-in irreversibility estimates, with a provocative retina result that outruns the paper's own validation. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The machinery is the plug-in estimator of Eq. (9) joined to the bias expansion of Eq. (10). The central object is $D_{KL}$, the Kullback-Leibler divergence between the probability of a discretized trajectory word $W$ and the probability of its time-reversed partner $\tilde W$; the estimator counts how much more often forward words appear than reversed words. Because empirical counts fluctuate, the plug-in estimate is biased upward, with a leading term $A/N$ whose coefficient is $A=\frac{1}{2}[\Omega'+\sum_W P(W)/P(\tilde W)]$. Extrapolating across sample sizes removes the leading bias, and using the asymptotic form $D_{KL}(T)\to\sigma T+\sigma_1$ extracts a rate $\sigma$ from finite windows.
What would settle it
Generate a long stationary, time-reversible but non-Markovian time series with known zero irreversibility, for example a Gaussian process with symmetric autocorrelation, and apply the estimator to 200 ms windows: if the extrapolated $D_{KL}$ is systematically nonzero across many realizations the bias expansion is missing a term, while if it is zero within error the correction works as claimed.
Extended reading notes
Core claim
The central claim is that a model-free, direct estimator of the forward-reverse trajectory divergence can be made quantitatively reliable by correcting its finite-sample bias. The plug-in estimator is $\hat{D}_N(T)=\sum_W P_N(W)\ln[P_N(W)/P_N(\tilde W)]$, and the paper derives the bias expansion $\langle \hat{D}_N(T)\rangle = D_{KL}(T)+A/N+B/N^2+\cdots$ with $A=\frac{1}{2}[\Omega'+\sum_W P(W)/P(\tilde W)]$, then extrapolates to $N\to\infty$. On a simulated two-state Markov chain obeying detailed balance this recovers $D_{KL}=0$ within a standard deviation, and on a driven three-state cycle the extrapolated $D_{KL}(T)/T$ converges to the known entropy-production rate $\sigma\approx20.7\mathrm{s}^{-1}$ when the time bin is small enough. On salamander retinal data, the extrapolated $D_{KL}(T=200\mathrm{ms})$ is nonzero for almost every single neuron, vanishes after shuffling the spike trains, and grows supralinearly with $T$ on the 40-200 ms scale.
Load-bearing premise
The method assumes the observed trajectory windows are independent draws from a single fixed distribution, so that the finite-sample bias has exactly the $1/N$ plus $1/N^2$ form that the extrapolation removes; no test of this assumption is reported for the retina spike trains.
Editorial extensions
If this is right
- A nonzero extrapolated $D_{KL}$ from a stationary time series is evidence that the underlying dynamics are not time-reversal invariant, without needing a physical model of the system.
- For Markovian dynamics the method recovers the thermodynamic entropy-production rate from trajectory data alone, matching the analytic rate when the discretization bin is small enough.
- Because any binary Markov model obeys detailed balance, the observed nonzero $D_{KL}$ in single retinal neurons identifies the non-Markovian character of the spike train.
- The supralinear growth of $D_{KL}(T)$ means that evidence for the arrow of time accumulates synergistically across successive brief windows rather than additively.
Reading between the lines
- A natural next test is to push the same estimator to longer windows, where the supralinear growth should cross over to a linear $D_{KL}(T)\sim\sigma T$ if a finite entropy-production rate exists; locating that crossover would give a rate for retinal spike trains.
- Because the $1/N$ coefficient involves ratios $P(W)/P(\tilde W)$, data sets in which many time-reversed words are never observed may need a regularized estimator, and sensitivity of the extrapolation to that regulator would reveal when the bias expansion has broken down.
- Applied to pairs or populations of simultaneously recorded neurons, the same method could test whether the arrow-of-time evidence is enhanced by correlations between cells, rather than only by temporal correlations within each cell.
- The method should transfer to other high-dimensional time series with a well-defined forward-reverse pairing, such as gene expression or weather records, where model-based entropy-production estimates are unavailable.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a model-free estimator of the Kullback-Leibler divergence between the distributions of forward and time-reversed trajectories, based on plug-in frequency estimates and a finite-sample bias correction. The authors derive a bias expansion (Eqs. 10-11), extrapolate to infinite sample size, validate the method on a two-state Markov chain (recovering D_KL = 0) and a three-state cycle (recovering the analytic entropy-production rate), and apply it to spike trains from salamander retinal ganglion cells, reporting nonzero D_KL for single neurons and supralinear growth with window length.
Significance. If the estimator is valid in the regimes where it is applied, this is a significant methodological contribution: it provides a direct, dynamics-agnostic route to quantifying irreversibility from time series, with clean synthetic validation and a novel neural-data application. The paper also gives a concrete formula for the leading finite-sample bias, which is useful beyond the specific extrapolation procedure. However, the strength of the retina claim depends on assumptions about sample independence and the handling of unobserved words, and these assumptions are not checked; the method as presented is therefore not yet established in the regime of its headline application.
major comments (3)
- [Eq. (9) and Section 'We start by discretizing'] The plug-in estimator in Eq. (9) is undefined whenever a word W is observed but its time reverse ~W is not: the term ln[PN(W)/PN(~W)] diverges. The manuscript never states how zero reverse counts are handled (pseudocounts, omission, or otherwise), and any such regularization changes the bias and invalidates the unmodified expansion in Eqs. (10)-(11). This is not a technicality for the retina application, where rare words are common; the authors must specify the procedure used and account for its effect on the bias.
- [Eq. (10) and Fig. 3] The bias expansion in Eq. (10) is derived from Eq. (6), which assumes that the N word samples are independent draws from the true distribution. In the retina experiment, the 200 ms words are cut from a continuous spike train, and consecutive words are likely overlapping and correlated; the paper reports no test of independence and no check that the 1/N + 1/N^2 extrapolation is valid for such data. The shuffle control in Fig. 3 breaks temporal correlations, so it only demonstrates unbiasedness for independent samples; it does not test the null hypothesis of a time-reversible but correlated process. If the effective sample size is much smaller than N, the extrapolation can leave a residual bias that masquerades as genuine irreversibility, directly undermining the central claim about single-neuron D_KL.
- [Eqs. (10)-(11)] The derivation of the bias expansion is only sketched ('following the same path as for the entropy'), and the coefficient A in Eq. (11) is asserted without a full derivation or a reference. Since the entire extrapolation procedure rests on this expansion, the authors should provide a complete derivation (or a supplementary appendix) that covers the treatment of palindromic words, the definition of Omega', and the conditions under which the 1/N^2 term has the stated form.
minor comments (5)
- [Eq. (8)] The standard Miller-Madow correction for the plug-in entropy estimator is (Omega - 1)/(2N), not Omega/(2N); if the authors intend the large-Omega approximation, they should state this explicitly.
- [Abstract and Section 'In summary'] The term 'model-free' is used for a method that assumes a particular parametric bias expansion and sample independence; consider softening this wording to 'assumption-light' or 'dynamics-agnostic'.
- [Fig. 1 caption] The caption contains a typo: '1=N' should be '1/N'.
- [Fig. 3 inset] The inset shows D_KL(T) normalized by D_KL(T=10 Delta_tau) and averaged over ten neurons; please clarify how the normalization is performed and whether the error bars include the across-cell variance.
- [Retina application] The text does not report the number of spike trains, the total recording duration, or the number of words used per cell; these details are necessary to assess the reliability of the extrapolation in Fig. 3.
Circularity Check
No significant circularity: the bias-corrected D_KL estimator is validated against analytic models and the extrapolated target is not used to set fit parameters.
full rationale
The central derivation is self-contained. The plug-in estimator in Eq (9) is a direct definition-based estimator of Eq (2); the bias expansion in Eq (10) is derived from the sampling covariance in Eq (6), with the leading coefficient in Eq (11) computed from the underlying distribution. The extrapolation fits the nuisance coefficients A and B to the observed 1/N dependence and reads off the intercept D_KL; the target is not used to constrain the fit, so the recovery of D_KL = 0 for a two-state Markov chain and the analytic slope for the three-state cycle are genuine external checks, not consequences of the fitting procedure. The retina measurements are an application of the calibrated estimator. The paper does cite prior work by the same group (e.g., Refs. [34,35,37,40,41,49,52-55]), but these citations are not load-bearing for the derivation: the entropy-extrapolation strategy is also attributed to independent sources [33,36], and no uniqueness theorem or ansatz is imported from the authors' own papers to force the choice of estimator. Concerns that the independence assumption behind Eq (6) may fail for correlated 200 ms neural windows, or that zero reverse counts are not discussed, are correctness/robustness issues rather than circular reductions; they do not make the estimate equal to its input by construction.
Assumptions & free parameters
free parameters (3)
- A =
not reported
- B =
not reported
- sigma_1 =
not reported
assumptions (6)
- domain assumption The plug-in estimator bias has a regular expansion in powers of 1/N (Eq 10) with finite coefficients A and B.
- domain assumption The N word samples are independent draws from P(W).
- domain assumption Correlations between consecutive words diminish subextensively with increasing word length, so longer words approach independence.
- domain assumption At large T, DKL(T) ≈ σT + σ1 (Eq 14).
- domain assumption Shuffling the time axis produces a valid null with DKL=0.
- domain assumption The support of the reverse distribution includes all observed forward words, so plug-in ratios are finite in the N→∞ limit.
Cite this review
Pith. "Pith review of Direct estimates of irreversibility from time series." pith.science (2026). https://pith.science/paper/RKPG6XOE
@misc{pith2026241219772,
author = {Pith},
title = {Pith review of: Direct estimates of irreversibility from time series},
year = {2026},
howpublished = {\url{https://pith.science/paper/RKPG6XOE}},
note = {Machine review of arXiv:2412.19772}
}
abstract
The arrow of time can be quantified through the Kullback-Leibler divergence ($D_{KL}$) between the distributions of forward and reverse trajectories in a system. Many approaches to estimate this rely on specific models, but the use of incorrect models can introduce uncontrolled errors. Here, we describe a model-free method that uses trajectory data directly to estimate the evidence for irreversibility over finite windows of time. To do this we build on previous work to identify and correct for errors that arise from limited sample size. Importantly, our approach accurately recovers $D_{KL} = 0$ in systems that adhere to detailed balance, and the correct nonzero $D_{KL}$ for data generated by well understood models of nonequilibrium systems. We apply our method to trajectories of neural activity in the retina as it responds to naturalistic inputs, and find evidence of irreversibility in single neurons, emphasizing the non-Markovian character of these data. These results open new avenues for investigating how the brain represents the arrow of time.
Figures
Forward citations
Cited by 1 Pith paper
-
Experimentally accessible measurement of irreversibility in stochastic systems by categorizing single-molecule displacements
Displacements grouped by starting and ending location yield a model-free Kullback-Leibler measure of irreversibility that bounds entropy production and can be measured from single-molecule data.
Reference graph
Works this paper leans on
-
[1]
I. A. Mart ´ ınez, G. Bisker, J. M. Horowitz, and J. M. R. Parrondo. Inferring broken detailed balance in the absence of observable currents. Nature Communications 10(1), 3542 (2019)
work page 2019
-
[2]
J. Van der Meer, B. Ertel, and U. Seifert, Thermody- namic inference in partially accessible Markov networks: a unifying perspective from transition-based waiting time distributions. Physical Review X12(3), 031025 (2022)
work page 2022
-
[3]
P. E. Harunari, A. Dutta, M. Polettini, and ´E. Rold´ an, What to learn from a few visible transitions’ statistics? Physical Review X12(4), 041026 (2022)
work page 2022
-
[4]
Ehrich, Tightest bound on hidden entropy production from partially observed dynamics
J. Ehrich, Tightest bound on hidden entropy production from partially observed dynamics. Journal of Statisti- cal Mechanics: Theory and Experiment2021(8), 083214 (2021)
work page 2021
-
[5]
A. Ghosal and G. Bisker, Inferring entropy production rate from partially observed Langevin dynamics under coarse-graining. Physical Chemistry Chemical Physics 24(39), 24021–24031 (2022)
work page 2022
-
[6]
P. Pietzonka and F. Coghi, Thermodynamic cost for pre- cision of general counting observables. Physical Review E 109(6), 064128 (2024)
work page 2024
- [7]
-
[8]
A. Ghosal and G. Bisker, Entropy production rates for different notions of partial information. Journal of Physics D: Applied Physics56(25), 254001 (2023)
work page 2023
Show all 56 references
-
[9]
Teza and A
G. Teza and A. L. Stella, Exact coarse graining preserves entropy production out of equilibrium. Physical Review Letters 125(11), 110601 (2020)
2020
-
[10]
Nitzan, A
E. Nitzan, A. Ghosal, and G. Bisker, Universal bounds on entropy production inferred from observed statistics. Physical Review Research5(4), 043251 (2023)
2023
-
[11]
D. J. Skinner and J. Dunkel, Estimating entropy pro- duction from waiting time distributions. Physical Review Letters 127(19), 198101 (2021)
2021
-
[12]
Li, C.-W
J. Li, C.-W. J. Liu, M. Szurek, and N. Fakhri, Measuring irreversibility from learned representations of biological patterns. PRX Life 2(3), 033013 (2024)
2024
-
[13]
J. L. Lebowitz and H. Spohn, A Gallavotti–Cohen-type symmetry in the large deviation functional for stochas- tic dynamics. Journal of Statistical Physics95, 333–365 (1999)
1999
-
[14]
Seifert, Entropy production along a stochastic trajec- tory and an integral fluctuation theorem.Physical Review Letters 95(4), 040602 (2005)
U. Seifert, Entropy production along a stochastic trajec- tory and an integral fluctuation theorem.Physical Review Letters 95(4), 040602 (2005)
2005
-
[15]
Gaspard, Time-reversed dynamical entropy and irre- versibility in Markovian random processes
P. Gaspard, Time-reversed dynamical entropy and irre- versibility in Markovian random processes. Journal of Statistical Physics 117, 599–615 (2004)
2004
-
[16]
Jarzynski, Rare events and the convergence of expo- nentially averaged work values.Physical Review E73(4), 046105 (2006)
C. Jarzynski, Rare events and the convergence of expo- nentially averaged work values.Physical Review E73(4), 046105 (2006)
2006
-
[17]
Maes and K
C. Maes and K. Netoˇ cn` y, Time-reversal and entropy. Journal of Statistical Physics110, 269–310 (2003). 5
2003
-
[18]
J. M. R. Parrondo, C. Van den Broeck, and R. Kawai, Entropy production and the arrow of time. New Journal of Physics 11(7), 073008 (2009)
2009
-
[19]
Seifert, Stochastic thermodynamics, fluctuation the- orems and molecular machines
U. Seifert, Stochastic thermodynamics, fluctuation the- orems and molecular machines. Reports on Progress in Physics 75(12), 126001 (2012)
2012
-
[20]
Esposito and C
M. Esposito and C. Van den Broeck, Three detailed fluctuation theorems. Physical Review Letters 104(9), 090601 (2010)
2010
-
[21]
Schnakenberg, Network theory of microscopic and macroscopic behavior of master equation systems
J. Schnakenberg, Network theory of microscopic and macroscopic behavior of master equation systems. Re- views of Modern Physics48(4), 571–585 (1976)
1976
-
[22]
Van den Broeck and M
C. Van den Broeck and M. Esposito, Ensemble and tra- jectory thermodynamics: A brief introduction. Physica A: Statistical Mechanics and its Applications418, 6–16 (2015)
2015
-
[23]
Mallick, Some recent developments in non-equilibrium statistical physics
K. Mallick, Some recent developments in non-equilibrium statistical physics. Pramana 73, 417–451 (2009)
2009
-
[24]
Peliti and S
L. Peliti and S. Pigolotti, Stochastic Thermodynamics: An Introduction, (Princeton University Press, Princeton NJ, 2021)
2021
-
[25]
Ziener, A
R. Ziener, A. Maritan, and H. Hinrichsen, On entropy production in nonequilibrium systems. Journal of Sta- tistical Mechanics: Theory and Experiment , 2015(8), P08014 (2015)
2015
-
[26]
Porporato, J
A. Porporato, J. R. Rigby, and E. Daly, Irreversibility and fluctuation theorem in stationary time series. Phys- ical Review Letters98(9), 094101 (2007)
2007
-
[27]
Rold´ an and J
´E. Rold´ an and J. M. R. Parrondo, Estimating dissipa- tion from single stationary trajectories. Physical Review Letters 105(15), 150607 (2010)
2010
-
[28]
S. Ro, B. Guo, A. Shih, T. V. Phan, R. H. Austin, D. Levine, P. M. Chaikin, and S. Martiniani, Model-free measurement of local entropy production and extractable work in active matter. Physical Review Letters129(22), 220601 (2022)
2022
-
[29]
van der Meer, J
J. van der Meer, J. Deg¨ unther, and U. Seifert, Time- resolved statistics of snippets as general framework for model-free entropy estimators. Physical Review Letters 130(25), 257101 (2023)
2023
-
[30]
P. E. Harunari, Uncovering nonequilibrium from unre- solved events. Physical Review E110(2), 024122 (2024)
2024
-
[31]
J. H. Fritz, B. Ertel, and U. Seifert, Entropy estimation for partially accessible Markov networks based on im- perfect observations: Role of finite resolution and finite statistics, arXiv preprint arXiv:2412.04102(2024)
2024 arXiv
-
[32]
Kapustin, A
U. Kapustin, A. Ghosal, and G. Bisker, Utilizing time- series measurements for entropy-production estimation in partially observed systems. Physical Review Research 6(2), 023039 (2024)
2024
-
[33]
G. A. Miller, Note on the bias of information estimates. In Information Theory in Psychology II-B, H. Quastler, ed., pp. 95–100 (Free Press, Glencoe IL, 1955)
1955
-
[34]
S. P. Strong, R. Koberle, R. R. de Ruyter Van Steveninck, and W. Bialek, Entropy and information in neural spike trains. Physical Review Letters80(1), 197–200 (1998)
1998
-
[35]
Bialek, Biophysics: Searching for Principles, (Prince- ton University Press, Princeton NJ, 2012)
W. Bialek, Biophysics: Searching for Principles, (Prince- ton University Press, Princeton NJ, 2012)
2012
-
[36]
Panzeri and A
S. Panzeri and A. Treves, The upward bias in measures of information derived from limited data samples. Neural Computation 7(2), 399–407 (1995)
1995
-
[37]
Tkaˇ cik, O
G. Tkaˇ cik, O. Marre, D. Amodei, E. Schneidman, W. Bialek, and M. J. Berry, Searching for collective behav- ior in a large network of sensory neurons. PLoS Compu- tational Biology 10(1), e1003408 (2014)
2014
-
[38]
S. K. Ma, Calculation of entropy from data of motion. Journal of Statistical Physics26, 221–240 (1981)
1981
-
[39]
Meshulam and W
L. Meshulam and W. Bialek, Statistical mechanics for networks of real neurons. arXiv:2409.00412 [cond- mat.dis-nn] (2024)
2024 arXiv
-
[40]
Nemenman, F
I. Nemenman, F. Shafee, and W. Bialek, Entropy and inference, revisited. In Advances in Neural Informa- tion Processing 14,T. G. Dietterich, S. Becker, and Z. Ghahramani, eds., pp. 471–478 (MIT Press, Cambridge MA, 2002)
2002
-
[41]
Nemenman, W
I. Nemenman, W. Bialek, and R. de Ruyter van Steveninck, Entropy and information in neural spike trains: Progress on the sampling problem. Physical Re- view E 69, 056111 (2004)
2004
-
[42]
J. Li, J. M. Horowitz, T. R. Gingrich, and N. Fakhri, Quantifying dissipation using fluctuating currents. Na- ture Communications 10, 1666 (2019)
2019
-
[43]
Jarzynski, Nonequilibrium equality for free energy differences
C. Jarzynski, Nonequilibrium equality for free energy differences. Physical Review Letters 78(14), 2690–2693 (1997)
1997
-
[44]
Su´ arez, R
A. Su´ arez, R. Silbey, and I. Oppenheim, Phase transi- tion in the Jarzynski estimator of free energy differences. Physical Review E85(5), 051108 (2012)
2012
-
[45]
G. E. Crooks, Entropy production fluctuation theorem and the nonequilibrium work relation for free energy dif- ferences. Physical Review E60(3), 2721–2726 (1999)
1999
-
[46]
Collin, F
D. Collin, F. Ritort, C. Jarzynski, S. B. Smith, I. Tinoco Jr, and C. Bustamante, Verification of the Crooks fluctu- ation theorem and recovery of RNA folding free energies. Nature 437(7056), 231–234 (2005)
2005
-
[47]
Coghi, L
F. Coghi, L. Buffoni, and S. Gherardini, Convergence of the integral fluctuation theorem estimator for nonequilib- rium Markov systems. Journal of Statistical Mechanics: Theory and Experiment2023(6), 063201 (2023)
2023
-
[48]
A. L. Stella, A. Chechkin, and G. Teza, Anomalous Dy- namical Scaling Determines Universal Critical Singulari- ties, Phys. Rev. Lett., 130, 20, 207104 (2023)
2023
-
[49]
Levien, T
E. Levien, T. GrandPre, and A. Amir, Large deviation principle linking lineage statistics to fitness in micro- bial populations. Physical Review Letters125(4), 048102 (2020)
2020
-
[50]
E. G. Hidalgo, T. Nemoto, and V. Lecomte, Finite-time and finite-size scalings in the evaluation of large-deviation functions: Numerical approach in continuous time. Phys- ical Review E95, 012102 (2017)
2017
-
[51]
U. Ray, G. K. Chan, and D. T. Limmer, Importance sam- pling large deviations in nonequilibrium steady states. I. The Journal of Chemical Physics, 148, 094103 (2018)
2018
-
[52]
GrandPre, K
T. GrandPre, K. Klymko, K. K. Mandadapu, and D. T. Limmer, Entropy production fluctuations encode collec- tive behavior in active matter. Physical Review E 103, 012613 (2021)
2021
-
[53]
Teza and A
G. Teza and A. L. Stella, Universal and non-universal signatures in the scaling functions of critical variables, arXiv preprint arXiv:2407.07782(2024)
2024 arXiv
-
[54]
A. L. Stella, A. Chechkin, and G. Teza, Universal sin- gularities of anomalous diffusion in the Richardson class, Phys. Rev. E, 107, 5, 054118 (2023)
2023
-
[55]
G. Teza, S. Iubini, M. Baiesi, A. L. Stella, and C. Van- derzande, Rate dependence of current and fluctuations in jump models with negative differential mobility, Phys- ica A: Statistical Mechanics and its Applications, 552, 6 123176 (2020)
2020
-
[56]
Angeli, S
L. Angeli, S. Grosskinsky, A. M. Johansen, and A. Piz- zoferrato, Rare event simulation for stochastic dynamics in continuous time. Journal of Statistical Physics 176, 1185 (2019)
2019
Reviewed August 10, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.