Asymptotically consistent prediction of extremes in chaotic systems:1 stationary case

Michael LuValle

REVIEW 4 major objections 4 minor 13 references

Asymptotically consistent prediction of extremes in chaotic systems:1 stationary case

T0 review · 4 major / 4 minor · reviewed 2026-08-14 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read The paper argues that delay-coordinate embedding plus nearest-neighbor linear regression makes extreme-value prediction in stationary chaotic systems asymptotically consistent.

desk verdict A suggestive sketch with one worthwhile lemma, but the central consistency claim for extreme extrapolation is not established. read the letter →

arxiv 1908.01231 v2 pith:QMPLGRGN submitted 2019-08-03 stat.AP nlin.CD

Michael LuValle This is my paper · ORCID

classification stat.APnlin.CD MSC 37M1037D4562M1062G3262G08

keywords extremevaluepredictionchaotictimeseriesdelay-coordinateembeddingnearestneighborregressiontangent-planeextrapolationasymptoticconsistencystationaryattractorSRBmeasure

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tries to establish that extreme values in a stationary chaotic system can be predicted with asymptotic consistency, without any parametric model of extremes. The mechanism is delay-coordinate embedding followed by nearest-neighbor linear regression: when the embedding dimension is more than twice the box dimension of the attractor, the delay map is an immersion, meaning its derivative is one-to-one, so the fitted regression surface converges to the tangent plane of the underlying dynamics. Extrapolating along that tangent plane is first-order accurate, which the paper argues makes prediction of values far outside the observed range consistent as the record grows. For systems of unknown or higher dimension, the paper argues that a unique SRB measure (the natural invariant measure of the attractor) preserves differentiability of the collapsed conditional expectation, and that residual distributions around the fitted planes provide probabilistic predictions of extremes.

What carries the argument

The central object is the delay-coordinate map $F(x)=(h_1(x),\ldots,h_1(g^{p_1-1}(x)),\ldots,h_J(x),\ldots,h_J(g^{p_J-1}(x)))$, which sends a state on the attractor to a vector of time-lagged measurements. The load-bearing machinery is the embedding theorem in [1]: for $p>2\,\mathrm{boxdim}(A)$, $F$ is one-to-one and an immersion on smooth submanifolds of the attractor, and for $p\le 2d$ its self-intersection set has dimension at most $2d-p$. These facts certify that a linear regression over nearest neighbors in the reconstructed space converges to the tangent plane of the underlying map, converting extrapolation from a zero-order average to a first-order linear prediction. The paper's corollary extends the self-intersection bound to two strictly distinct delay maps, and the SRB-measure argument preserves differentiability when variables are integrated out, so residual distributions around the fitted planes carry the probabilistic content for extremes.

What would settle it

Run the proposed estimator on a stationary chaotic flow with a known attractor dimension: embed with more than twice the box dimension, fit nearest-neighbor linear regressions, and extrapolate to a future value far outside the sampled range; if the prediction error does not shrink as the observation record and neighbor count grow, the central consistency claim is false.

Watch

Extended reading notes

Core claim

The central claim is that asymptotic consistency of extreme-value prediction is a geometric consequence of embedding, not an assumption about tail distributions. With $p$ time-lagged coordinates as inputs and one future coordinate as the target, the delay-coordinate map is one-to-one and immersive when $p>2\,\mathrm{boxdim}(A)$; the paper therefore treats the local regression of the target on the $p$ inputs as converging to the tangent plane of the map. Because the chaotic orbit samples the attractor ergodically and the number of nearest neighbors grows more slowly than the sample size, the tangent-plane extrapolation is claimed to be correct to first order, so a predicted extreme is an asymptotically consistent estimate rather than a nearest-neighbor average. In the intermediate regime where the reconstruction is not a full embedding, the paper proves a corollary that two strictly distinct delay-coordinate maps cannot share a self-intersection point, so their predictions cannot both be wrong at the same location; combined with a unique SRB measure (the attractor's natural invariant measure), the residual distribution around the plane gives a probabilistic forecast of extremes.

Load-bearing premise

The claim rests on the assumption that a tangent plane estimated from nearest neighbors inside a small observed neighborhood remains an accurate model when extrapolated to an extreme value far outside that neighborhood.

Editorial extensions

If this is right

For a stationary chaotic system with known attractor dimension, choosing an embedding with more than twice that dimension and a neighbor count growing more slowly than the sample size gives forecasts of extremes that improve as the record grows.
No extreme-value parametric model is needed; the same local regression machinery produces a probabilistic forecast from the residuals around the tangent plane when the embedding is incomplete.
Two strictly distinct embeddings in the intermediate dimension range cannot both be wrong at the same point, so disagreement between their predictions flags locations where the tangent-plane approximation is unreliable.
Building many random p-variable subsets from a candidate set of delay coordinates turns a single prediction into a predictive distribution of the extreme response.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

Editorial extension: if the tangent-plane extrapolation is the right error model, the dominant error for very large extremes should scale with attractor curvature rather than sampling noise, so a curvature-corrected variant is a natural next test.
Editorial extension: the residual-based predictive distribution can be compared with generalized Pareto tail fits on simulated chaotic data; disagreement would show where the geometric and statistical extreme-value pictures diverge.
Editorial extension: the disjoint-intersection corollary suggests a practical diagnostic that two agreeing embeddings identify a nonsingular point, while disagreement means neither tangent-plane forecast should be trusted alone.
Editorial extension: the same local-tangent argument may carry over to slowly non-stationary systems with short-window re-estimation, though the paper's consistency proof is deliberately limited to the stationary case.

Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

The paper is a rough draft of a theory for asymptotically consistent extreme-value prediction in stationary chaotic systems. The one genuinely new piece is Corollary 1: for two strictly distinct delay maps with dimensions between boxdim(A) and 2 boxdim(A), their δ-distant self-intersection sets are disjoint. The proof sketch is plausible and looks correct. That is a real, citable lemma, and it is the part worth keeping.

The rest is a synthesis of known embedding results (Sauer et al.) and nearest-neighbor regression (Stone), applied to a worthwhile problem. The idea that a local linear fit on delay-coordinate neighbors might extrapolate to extremes is a natural framing, and the paper honestly notes that a simple mean of neighbors only gives 0th-order accuracy.

The load-bearing step does not hold up. The paper asserts that because the delay map is immersive, the regression surface converges to the tangent plane, and that this 'will provide an extrapolation correct to the 1st order rather than the 0th order.' That is not a consequence of the embedding theorem. An immersive map has an injective derivative at each point, which says nothing about the size of the remainder term when you move a finite distance away from the fitted neighborhood. For an extreme event, the antecedent state can be in a low-density tail of the observed neighborhood, and the extrapolation distance need not shrink as n grows. Without a rate bound tying neighborhood radius, curvature, tail probability, and extreme threshold, the asymptotic consistency claim is unsupported. The stress-test note is right on this.

The SRB measure argument also rests on a false premise: typical SRB measures for dissipative chaotic systems are singular with respect to Lebesgue measure, not absolutely continuous. So the claim that differentiability is preserved under marginalization is not established.

The empirical section is explicitly not the proposed method—it uses climate-model ensembles and post-selection—so it provides no validation. The writing is garbled in places, with missing references and unexplained notation, which makes the paper harder to assess than it should be.

Who is this for? Researchers working on the theory of dynamic forecasting or embedding-based prediction. They would find Corollary 1 useful but the main theorem unconvincing. The paper deserves a serious referee because the problem is important and the lemma is new, but the central claim needs either a real proof or a substantial reframing as a conjecture with supporting numerics. If I were asked to referee it, I would engage, but I would not recommend acceptance without major revision.

Referee Report

4 major / 4 minor

Summary. The paper claims to establish asymptotic consistency for the prediction of extreme values in stationary chaotic systems. The proposed method combines delay-coordinate embedding (Sauer et al.) with nearest-neighbor linear regression on the embedded variables. The central argument is that, because the delay-coordinate map is an immersion when the number of delay coordinates p exceeds twice the box dimension of the attractor, a locally fitted linear regression surface converges to the tangent plane of the target map, and therefore extrapolation to extreme values is correct to first order rather than zeroth order. The paper then extends the argument to the case of unknown attractor dimension by considering multiview embeddings, disjoint sampling, and conditional expectations based on SRB measures, and it illustrates the approach with a qualitative discussion of a precipitation prediction exercise.

Significance. If the central claim were rigorously established, the paper would provide a practically relevant bridge between embedding theory and extreme-value prediction in chaotic time series. The paper identifies a real problem and cites the relevant literature from nonlinear dynamics and nonparametric regression. Its strength is the proposal that local tangent-plane information, rather than local averaging, could enable extrapolation to extremes. However, the significance is severely limited because the central mathematical step is not proven, the main assumption about SRB measures is false for typical chaotic attractors, and the extension to unknown dimension rests on an unverified ad hoc assumption. The paper is more of a research proposal or position statement than a worked-out theory.

major comments (4)

[p. 1-2, construction paragraph] The load-bearing assertion is the sentence: 'because of the immersive nature the regression surface is converging to the tangent plane of the mapping, which will provide an extrapolation correct to the 1st order rather than the 0th order.' This step is not justified. Sauer et al.'s theorem guarantees that the delay-coordinate map is an immersion, but an immersion only controls the derivative locally; Taylor's theorem with remainder shows that the error in extrapolating from a fitted tangent plane at x0 to a point x is bounded by (1/2) sup||Hessian|| ||x - x0||^2 along a path. For an extreme value of y, the antecedent x may lie far outside the fitted neighborhood, and ||x - x0|| need not shrink as the sample size grows. The paper provides no bound connecting neighborhood radius, curvature, tail probability, and extreme threshold, so the claimed asymptotic consistency for extremes is unsupported.
[p. 2, SRB measure paragraph] The paper states: 'Since the SRB measure is absolutely continuous with respect to lebesgue measure, this preserves differentiability on the collapsed system.' This assumption is false for typical chaotic attractors, including the Lorenz, Hénon, and many other physically relevant systems, where the SRB measure is supported on a set of zero Lebesgue measure and is singular with respect to Lebesgue measure. Consequently, the claimed preservation of differentiability of the conditional expectation E(Y|x) after marginalizing over unobserved variables does not follow from the cited theory. The paper does not identify any class of systems for which the assumption holds, and it gives no numerical example satisfying it.
[p. 3, 'best approximation' assumption] In the extension to arbitrary p, the paper says: 'Assume the conditional system inherits the properties relevant to Sauer et al's theorem 2.10 with respect to this best approximation.' This is an unproved, ad hoc assumption that is load-bearing for the multiview embedding claim. The paper neither proves that such a best approximation exists with the required regularity nor that the conditional system indeed inherits the relevant properties. Without this step, the argument for the p < 2 boxdim(A) regime, and for the practical recommendation to use multiple p-variable regressions, is a leap rather than a derivation.
[p. 2-3, Corollary 1] The proof of Corollary 1 is not rigorous. It invokes Sauer et al.'s theorem 2.7 for the product map (F_i, F_j) and argues that if the two self-intersection sets intersect, then the product map has a self-intersection, contradicting theorem 2.7 because the product dimension exceeds 2d. However, theorem 2.7 requires additional hypotheses (e.g., constraints on periodic orbits), and the proof does not carefully handle the distinction between a self-intersection of the product map and the intersection of the two self-intersection sets. The corollary is used to justify the 'disjoint sampling' multiview approach, so this gap affects a central part of the claimed extension.

minor comments (4)

[References and citations] The citations are inconsistent: Sauer et al. is sometimes cited as [1] and sometimes as [2], and the text 'some extension [].7' contains a missing reference. The reference list should be carefully updated.
[Notation and typography] The mathematical notation is heavily garbled, for example the box dimension formula is unreadable in the text: '𝑏𝑜𝑥 𝑑𝑖𝑚(𝐴)=𝑙𝑖𝑚ఌ→଴ቀ௟௢௚(ேഄ)ି ௟௢௚(ఌ)ቁ'. Equations need to be typeset cleanly.
[Figure and empirical example] The precipitation prediction example refers to a figure that is not included in the manuscript, and the description is too vague to be reproducible. The paper should either include the figure and data-processing details or remove the example as non-essential.
[p. 2, 'It turns out' sentence] The sentence 'It turns out we can bound the predictability of the tangent planes a little bit based on a further result of Sauer et al[1], and the some extension [].7' promises a bound that is never stated. Either provide the bound or delete the sentence.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the central derivation rests on external embedding and regression-consistency theorems; self-citations are peripheral.

full rationale

The paper's derivation chain is: (1) Sauer et al.'s Embedology theorem supplies immersion when p>2 boxdim(A); (2) Stone's theorem supplies consistent nearest-neighbor regression; (3) the paper adds the assumption that a local linear regression converges to the tangent plane and therefore extrapolates 'to the 1st order'. Steps (1) and (2) are external mathematical results with stated assumptions that do not include the paper's extreme-value conclusion, so they are genuine evidence. Step (3) is an unproved extrapolation assumption—Taylor's theorem gives no error control at finite distances—but it is an assumption about approximation quality, not an equation that defines the prediction as its input. The self-citations (LuValle [7], patents [8],[9]) support only an efficiency remark and an illustrative empirical example that the paper explicitly says 'is not exactly the method described in this paper'; neither is load-bearing for the asymptotic consistency claim. No parameter is fitted to extreme data and then renamed a prediction. Hence there is no circularity; the weaknesses are correctness or rigor risks rather than input-output equivalence.

Assumptions & free parameters 3 free parameters · 6 assumptions · 0 invented entities

The paper adds a corollary and a framework, but its central claims rest on external embedding theorems, an ergodicity and SRB assumption, and two explicitly ad hoc structural assumptions. No data or code accompany the method, and the illustrative application is not the proposed method.

free parameters (3)

Number of delay coordinates per view, p
The method requires p > 2 boxdim(A) for full immersion; no data-driven choice is given for unknown dimension.
Number of nearest neighbors, m
Must satisfy m goes to infinity and m = o(n); no finite-sample rule is provided.
Equal probability weight for each set of p variables = 1/(number of sets)
Assumed in the precipitation plot to combine predictive distributions; no evidence is given for this weighting.

assumptions (6)

standard math Delay-coordinate map F is one-to-one and an immersion when p > 2 boxdim(A) (Sauer et al.).
External theorem used as the foundation for tangent-plane regression; not re-derived here.
standard math The self-intersection set Sigma(F,delta) has box dimension at most 2d-p when p <= 2d (Sauer et al.).
Used for Corollary 1 and the disjoint-system argument.
standard math Nearest-neighbor regression is consistent (Stone 1977).
Used to claim convergence of conditional mean estimates.
domain assumption The chaotic system is stationary, ergodic, and has a unique SRB measure.
Ergodicity lets time averages replace space averages; unique SRB measure is required for the conditional-expectation tangent-plane statement but is not guaranteed.
ad hoc to paper The SRB measure is absolutely continuous with respect to Lebesgue measure.
Needed to argue marginalization preserves differentiability, but this is false for typical fractal attractors.
ad hoc to paper The conditional system on 2p-1 variables inherits the properties relevant to Sauer's theorem 2.10.
Explicitly assumed in the arbitrary-p extension without proof or example.

how reviews work

0 comments

Cite this review

Pith. "Pith review of Asymptotically consistent prediction of extremes in chaotic systems:1 stationary case." pith.science (2026). https://pith.science/paper/QMPLGRGN

@misc{pith2026190801231,
  author       = {Pith},
  title        = {Pith review of: Asymptotically consistent prediction of extremes in chaotic systems:1 stationary case},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/QMPLGRGN}},
  note         = {Machine review of arXiv:1908.01231}
}

read the original abstract

In many real world chaotic systems, the interest is typically in determining when the system will behave in an extreme manner. Flooding and drought, extreme heatwaves, large earthquakes, and large drops in the stock market are examples of the extreme behaviors of interest. For clarity, in this paper we confine ourselves to the case where the chaotic system to be predicted is stationary so theory for asymptotic consistency can be easily illuminated. We will start with a simple case, where the attractor of the chaotic system is of known dimension so the answer is clear from prior work. Some extension will be made to stationary chaotic system with higher dimension where a number of empirical results will be described and a theoretical framework proposed to help explain them.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

13 extracted references · 13 canonical work pages

[1]

applying nearest neighbor regression on these p variables to predict y (Stone et al[5]),

work page
[2]

by letting the number of neighbors in the regression go to infinity as the number of observations

work page
[3]

assuming the conditions for ergodicity [2] ,as the observing time grows and the number of nearest neighbors goes to infinity and

work page
[4]

This however is not much help in extrapolating to new extremes with new dependent variables

ensuring the number of neighbors =o(number of observations) We can ensure consistent estimate of the new value as the mean of the data . This however is not much help in extrapolating to new extremes with new dependent variables. To accomplish the extrapolation, we apply the immersion property. Instead of taking the mean of the nearest neighbor dependent ...

work page 2014
[5]

Embedology

Sauer, T., Yoreck, J. and Casdagli, M. “Embedology”, Journal of Statistical Physics, 65, 579-616 (1991)

work page 1991
[6]

Ergodic Theory of chaos and strange attractors, Reviews of modern Physics, 57, 617-656, (1985)

Eckmann, J.P., and Ruelle, D. Ergodic Theory of chaos and strange attractors, Reviews of modern Physics, 57, 617-656, (1985)

work page 1985
[7]

Prediction in Projection

Garland J. and Bradley E., "Prediction in Projection", Chaos 25, 123108 (2015); doi: 10.1063/1.4936242

work page doi:10.1063/1.4936242 2015
[8]

Information leverage in interconnected ecosystems, overcoming the curse of dimensionality

Ye, H., and Sugihara G.,(2016), "Information leverage in interconnected ecosystems, overcoming the curse of dimensionality", Science, Vol 353, issue 6502, 922-925

work page 2016

Show all 13 references

[9]

C. J. Stone, Ann. Stat. 5, 595–620 (1977)

1977
[10]

What are SRB Measures and which dynamical systems have them

Young LS, “What are SRB Measures and which dynamical systems have them”, Journal of Statistical Physics, vol 108, #516,733-754
[11]

A simple statistical approach to prediction in open high dimensional chaotic systems

LuValle, “A simple statistical approach to prediction in open high dimensional chaotic systems”, arXiv, stat, 1902.04727

1902 arXiv
[12]

Predicting climate data using climate attractors derived from a global climate model

LuValle, M.J, (2016), “Predicting climate data using climate attractors derived from a global climate model”, US Patent 9,262,723

2016
[13]

Statistical Prediction Functions for Natural Chaotic Systems and computer model thereof

LuValle M. J. (2019), "Statistical Prediction Functions for Natural Chaotic Systems and computer model thereof". US Patent 10,234,595

2019

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.

[1] [1]

applying nearest neighbor regression on these p variables to predict y (Stone et al[5]),

work page

[2] [2]

by letting the number of neighbors in the regression go to infinity as the number of observations

work page

[3] [3]

assuming the conditions for ergodicity [2] ,as the observing time grows and the number of nearest neighbors goes to infinity and

work page

[4] [4]

This however is not much help in extrapolating to new extremes with new dependent variables

ensuring the number of neighbors =o(number of observations) We can ensure consistent estimate of the new value as the mean of the data . This however is not much help in extrapolating to new extremes with new dependent variables. To accomplish the extrapolation, we apply the immersion property. Instead of taking the mean of the nearest neighbor dependent ...

work page 2014

[5] [5]

Embedology

Sauer, T., Yoreck, J. and Casdagli, M. “Embedology”, Journal of Statistical Physics, 65, 579-616 (1991)

work page 1991

[6] [6]

Ergodic Theory of chaos and strange attractors, Reviews of modern Physics, 57, 617-656, (1985)

Eckmann, J.P., and Ruelle, D. Ergodic Theory of chaos and strange attractors, Reviews of modern Physics, 57, 617-656, (1985)

work page 1985

[7] [7]

Prediction in Projection

Garland J. and Bradley E., "Prediction in Projection", Chaos 25, 123108 (2015); doi: 10.1063/1.4936242

work page doi:10.1063/1.4936242 2015

[8] [8]

Information leverage in interconnected ecosystems, overcoming the curse of dimensionality

Ye, H., and Sugihara G.,(2016), "Information leverage in interconnected ecosystems, overcoming the curse of dimensionality", Science, Vol 353, issue 6502, 922-925

work page 2016