Pith. sign in

REVIEW 4 major objections 6 minor 30 references

Quantifying Cryptocurrency Unpredictability: A Comprehensive Study of Complexity and Forecasting

T0 review · 4 major / 6 minor · reviewed 2026-08-07 · deepseek-v4-flash

Pith's one-line read Five major cryptocurrencies show Brownian-noise complexity, and naive models beat machine-learning and deep-learning forecasters on daily USD prices.

desk verdict A solid univariate forecasting benchmark whose Brownian-noise conclusion is mostly an artifact of using price levels rather than returns; worth refereeing, but needs reframing. read the letter →

arxiv 2502.09079 v1 pith:MRCBJZKO submitted 2025-02-13 q-fin.ST cs.LGq-fin.CP

classification q-fin.STcs.LGq-fin.CP
keywords cryptocurrencyforecastingunivariatetimeseriespermutationentropycomplexity-entropycausalityplaneBrowniannoisenaivemodelsmachinelearningdeep
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Using daily USD prices for Litecoin, Binance Coin, Bitcoin, Ethereum, and XRP between 2020 and 2023, this paper argues that univariate forecasting of cryptocurrencies is essentially comparable to pure noise forecasting. In the Complexity–Entropy plane all five coins sit on the colored-noise line, their power spectra follow roughly $1/f^2$ (Brownian) decay, and permutation Jensen–Shannon distances are smallest to Brownian noise for most coins. Across three training windows and 1-, 7-, and 30-day horizons, naive models match or beat sophisticated statistical, machine-learning, and deep-learning models on MAPE; on shorter windows the series move toward white noise. The conclusion a sympathetic reader takes away is that simple benchmarks are the right yardstick and that price history alone does not support complex forecasting.

What carries the argument

The central measuring device is the Complexity–Entropy causality plane (CH-plane), which plots permutation entropy (the Shannon entropy of ordinal patterns of length $d$) against the intensive Jensen–Shannon statistical complexity. A time series that sits on the 'noises line' of this plane is structurally similar to white, pink, Brownian, or $1/f^{5/2}$ noise; the paper adds the permutation Jensen–Shannon distance to quantify which noise is nearest, and the power spectral density to estimate the exponent $\alpha$ in $S(f)\propto 1/f^{\alpha}$. On the forecasting side, the load-bearing machinery is a rolling-window backtest that retrains each model as the training set grows, and the MAPE metric evaluated only at the forecast horizon, with naive models serving as the baseline that complex models must beat.

What would settle it

Compute the same CH-plane, PSD, and model benchmark on daily returns or log-returns instead of raw prices; if the series move to the white-noise region and the spectral slope flattens to $\alpha\approx 0$, while naive models still win, the Brownian-noise claim is an artifact of cumulative price levels rather than a discovery about crypto dynamics.

Watch

Extended reading notes

Core claim

The paper's central claim is that the five cryptocurrencies' univariate dynamics closely resemble noise processes when measured with permutation entropy, statistical complexity, and power spectral density. All series lie on the noises line of the CH-plane, with a spectral exponent close to $\alpha=2$, the Brownian-motion value; XRP is closest to pink ($1/f$) noise. Consistently, no statistical, machine-learning, or deep-learning model reliably outperforms NaiveDrift or NaiveSeasonal across all settings, and the deep recurrent models often fail badly, with MAPEs near 100 percent on Bitcoin and Ethereum. The authors interpret this as evidence that apparent complexity in cryptocurrency prices is mostly noise, and that forecasting future prices from historical prices alone is largely unfeasible.

Load-bearing premise

The result depends on treating raw USD price levels as the univariate series; any non-stationary random walk would show the same Brownian-like complexity profile, so the noise conclusion may be a property of integration rather than of cryptocurrencies specifically.

Editorial extensions

If this is right

  • If the claim holds, reported gains from univariate crypto price forecasting should be treated skeptically unless they beat a naive baseline on out-of-sample data.
  • Model selection in this domain should default to simple baselines; complex deep architectures add cost and variance without accuracy gains.
  • Shorter training windows push the series closer to white noise, so short-horizon forecasts are not more reliable than long-horizon ones for these assets.
  • The poor performance of Prophet in this setting shows that models assuming seasonality or holiday structure are mismatched to cryptocurrency dynamics.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The Brownian-noise result is likely a generic property of cumulative price levels: any integrated random walk would occupy the same CH-plane region, so a natural extension is to rerun the analysis on returns, where the expected signature would shift to white noise.
  • A testable extension is to check whether volatility clustering or jump dynamics in returns are forecastable even though levels are not; the current study's MAPE on levels would not detect such structure.
  • The naive-model dominance implies that practitioners should evaluate trading strategies net of transaction costs; a random-walk benchmark may already be the best achievable baseline.
  • Adding exogenous covariates such as sentiment or volume is the paper's own suggested escape route, but the evidence here suggests the gains would come from those covariates, not from more elaborate univariate models.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. The paper studies five daily USD cryptocurrency price series (LTC-USD, BNB-USD, BTC-USD, ETH-USD, XRP-USD) from 2020-07-03 to 2023-12-21. It characterizes their complexity using Bandt-Pompe permutation entropy, the Complexity-Entropy causality plane, the power spectral density, and permutation Jensen-Shannon distances to colored noises, and it benchmarks twelve forecasting models (statistical, machine learning, and deep learning) with a rolling-origin evaluation across three training-window lengths and forecast horizons of 1, 7, and 30 days. The paper concludes that cryptocurrency price levels resemble Brownian noise and that univariate forecasting of cryptocurrencies is 'essentially comparable to pure noise forecasting,' with simple Naive models consistently outperforming more complex ML and DL models.

Significance. The forecasting benchmark is a useful negative result: it confirms at daily frequency that simple random-walk-style baselines are hard to beat for these five assets, and it provides a cautionary counterweight to studies that report ML/DL gains without comparing to naive baselines. The rolling-origin evaluation and the inclusion of multiple horizons and time windows are strengths. However, the complexity analysis is applied to raw price levels, so the Brownian-noise resemblance is a generic property of integrated series rather than a cryptocurrency-specific finding; the forecasting comparison lacks formal significance tests; and the DL results contain MAPE values near 99% that look like implementation artifacts. The central claim is defensible only after reframing or after additional analysis on returns or log-prices.

major comments (4)
  1. [Section 3.1 and 4.1 (Figs. 3-4, Table 2)] The complexity analysis is performed on raw USD price levels, yet the conclusions are phrased as properties of cryptocurrency dynamics. For any non-stationary integrated series—for instance the cumulative sum of independent increments, regardless of whether those increments are predictable—the price-level PSD is approximately 1/f^2 and the CH-plane position falls near the Brownian noise line. The reported Brownian resemblance is therefore a mathematical consequence of the level transformation and does not distinguish cryptocurrencies from a generic random walk. This affects the paper's framing in the abstract and Section 5 ('pure noise'). The authors should either re-run the CH-plane/PJSD/PSD analysis on returns or log-prices, or explicitly reframe the result as 'price levels behave like an integrated process; returns are the relevant object for predictability.' Without this, the complexity pillar of the paper does not support cryptocurrency-specific unpredictability.
  2. [Section 4.2 (Tables 3 and 4)] The claim that sophisticated statistical models are 'not statistically distinguishable' from Naive models is not supported by evidence. Table 4 reports mean MAPE and standard deviation, and the text treats overlapping standard deviations as a statistical finding. Overlap of unconditional standard deviations is not a significance test, and the aggregation across assets and windows ignores the rolling-window dependence of the forecast errors. A paired comparison per asset and window (e.g., Diebold-Mariano tests on absolute or squared errors, or a Wilcoxon signed-rank test on MAPE differences) is needed. This matters because the paper's headline conclusion is that naive models are comparable or superior; without a formal test, small numerical differences such as NaiveSeasonal 1.636 vs AutoETS 1.634 at horizon 1 in Table 4 cannot be interpreted as evidence of equivalence.
  3. [Section 3.3 and Table 3] The deep-learning results contain MAPE values near 99% for BTC-USD and ETH-USD across all time windows and horizons (e.g., VanillaRNN 99.091 and LSTM 99.765 for BTC-USD in the 3-year window). Given price levels of tens of thousands of dollars, these values indicate that the models failed to produce usable forecasts rather than that the series is unpredictable. The paper states in Section 3.1 that 'no data preprocessing was applied' and provides no hyperparameters, architecture details, training epochs, or seeds for the DL models. Without this information, or without an evaluation on standardized returns or levels, the conclusion that 'DL models struggle' is based on potentially broken training runs. The authors should report the exact Darts configuration for each DL model and either preprocess inputs (e.g., scaling) or explain why the reported MAPE values are plausible.
  4. [Section 4.1 (Fig. 4)] The statement that the PSD 'consistently follows the power law decay exponent of the Brownian motion' is based on a visual comparison with a 1/f^2 reference line. No power-law exponent is estimated from the data, no confidence intervals are given, and the PSD for shorter time windows is not shown. A quantitative fit of the log-log slope (e.g., via linear regression on the log PSD or a periodogram-based estimator) with uncertainty bounds is needed to support the claim that the exponent is indistinguishable from 2 rather than, say, 1.5 or 2.5. This is load-bearing for the complexity conclusion.
minor comments (6)
  1. [Table 2 caption] The caption reads 'Permutation Jehnsenn-Shannon distances'; this should be 'Permutation Jensen-Shannon distances'.
  2. [Figure 3] The three subfigures (a), (b), and (c) appear to display the same three-panel image; please replace them with the actual CH-plane plots for each of the three time windows.
  3. [Section 3.2] The description of C_JS[P] as 'multiplying this divergence by the entropy of P' omits the required normalization; the standard formula is C_JS[P] = Q_J[P, P_e] * H[P] / H_max, where Q_J includes a normalization constant.
  4. [Section 3.1] The phrase 'no data preprocessing was applied' is ambiguous: clarify whether it refers only to cleaning/missing values, and specify whether input features were standardized for the ML and DL models.
  5. [Section 5] The term 'pure noise forecasting' is never defined; specify the noise forecast benchmark used (e.g., a random walk without drift, or a bootstrap of returns) so the comparison is explicit.
  6. [References] Reference [23] is cited twice with different descriptions in the same paragraph; please review the citation to avoid duplication and clarify which findings come from which study.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: all central claims are direct empirical measurements and out-of-sample forecasts, not reductions to fitted inputs or self-cited premises.

full rationale

The paper is an empirical study rather than a derivation from first principles. The complexity analysis in Section 4.1 directly computes permutation entropy, statistical complexity, PJSD distances, and PSD exponents from the price series; none of these quantities is defined in terms of the paper's conclusion, and no parameter is fitted to the target result and then renamed as a prediction. The forecasting comparison in Section 4.2 trains each model on training windows and evaluates on a held-out test set, with Naive models acting as standard baselines rather than as fitted parameters masquerading as forecasts. The statement that cryptocurrencies resemble Brownian noise reflects a modeling choice to analyze raw USD price levels rather than returns, and the statement that Naive models outperform complex models is an observed empirical outcome. These are validity concerns about the object of analysis, not circular steps in which an equation reduces to itself or a cited result carries the argument. There are no self-citations, uniqueness theorems, or ansatze smuggled in from prior work by the same authors. The paper contains no passage asserting a limitation that exposes a circular step. Under the stated criteria, no load-bearing step reduces to its own input by construction, so the appropriate finding is no significant circularity.

Assumptions & free parameters 1 free parameters · 4 assumptions · 0 invented entities

The central claim rests on standard complexity measures and a set of modeling choices. The main hand-chosen parameter is the embedding dimension d. The most consequential assumption is the use of raw price levels, which makes Brownian-noise behavior largely predetermined. No new theoretical entities are introduced.

free parameters (1)
  • Bandt-Pompe embedding dimension d = d=5 for 3-year window, d=4 for 1-year and 6-month windows
    The CH-plane coordinates and PJSD values depend on the chosen embedding dimension; the paper sets d differently per time window, which changes the maximum entropy baseline and affects comparability of points across windows.
assumptions (4)
  • standard math Permutation entropy and the CH-plane are valid discriminators of stochastic versus deterministic dynamics.
    The paper relies on Bandt-Pompe entropy and Rosso et al.'s complexity-entropy plane as established analysis tools.
  • domain assumption Raw price levels, not returns or log returns, are the appropriate series for assessing univariate predictability.
    The entire complexity and forecasting analysis uses the daily USD exchange rate directly. This assumption determines that the data appear as an integrated series, which makes Brownian-noise behavior expected.
  • domain assumption The Darts library implements each model equivalently to its canonical version, including RNN/LSTM default scaling behavior.
    The authors use Darts for all models but do not document preprocessing or hyperparameters; the near-99% MAPE values for LSTM/RNN suggest possible scaling or convergence issues.
  • domain assumption MAPE on price levels is a meaningful loss function for comparing forecasts across coins.
    MAPE can be sensitive to scale and to values near zero; the paper uses it without robustness checks or alternative metrics.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Quantifying Cryptocurrency Unpredictability: A Comprehensive Study of Complexity and Forecasting." pith.science (2026). https://pith.science/paper/MRCBJZKO

@misc{pith2026250209079,
  author       = {Pith},
  title        = {Pith review of: Quantifying Cryptocurrency Unpredictability: A Comprehensive Study of Complexity and Forecasting},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/MRCBJZKO}},
  note         = {Machine review of arXiv:2502.09079}
}
read the original abstract

This paper offers a thorough examination of the univariate predictability in cryptocurrency time-series. By exploiting a combination of complexity measure and model predictions we explore the cryptocurrencies time-series forecasting task focusing on the exchange rate in USD of Litecoin, Binance Coin, Bitcoin, Ethereum, and XRP. On one hand, to assess the complexity and the randomness of these time-series, a comparative analysis has been performed using Brownian and colored noises as a benchmark. The results obtained from the Complexity-Entropy causality plane and power density spectrum analysis reveal that cryptocurrency time-series exhibit characteristics closely resembling those of Brownian noise when analyzed in a univariate context. On the other hand, the application of a wide range of statistical, machine and deep learning models for time-series forecasting demonstrates the low predictability of cryptocurrencies. Notably, our analysis reveals that simpler models such as Naive models consistently outperform the more complex machine and deep learning ones in terms of forecasting accuracy across different forecast horizons and time windows. The combined study of complexity and forecasting accuracies highlights the difficulty of predicting the cryptocurrency market. These findings provide valuable insights into the inherent characteristics of the cryptocurrency data and highlight the need to reassess the challenges associated with predicting cryptocurrency's price movements.

Figures

Figures reproduced from arXiv: 2502.09079 by the authors.

Figure 1
Figure 1. Cryptocurrency as Brownian Motion Abstract This paper offers a thorough examination of the univariate pre￾dictability in cryptocurrency time-series. By exploiting a combi￾nation of complexity measure and model predictions we explore the cryptocurrencies time-series forecasting task focusing on the exchange rate in USD of Litecoin, Binance Coin, Bitcoin, Ethereum, and XRP. On one hand, to assess the complexity and th… view at source ↗
Figure 2
Figure 2. Overview of the Cryptocurrency time-series [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 4
Figure 4. Power Spectral Density (PSD) plots of the 5 cryp [PITH_FULL_IMAGE:figures/full_fig_p005_4.png] view at source ↗
Figures from the paper (1 more)
Figure 3
Figure 3. Figure 3: Complexity Entropy causality plane (CH-plane) of [PITH_FULL_IMAGE:figures/full_fig_p005_3.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

30 extracted references · 18 canonical work pages

  1. [1]

    W Farida Agustini, Ika Restu Affianti, and Endah RM Putri. 2018. Stock price prediction using geometric Brownian motion. Journal of Physics: Conference Series 974, 1 (mar 2018), 012047. https://doi.org/10.1088/1742-6596/974/1/012047

  2. [2]

    Erdinc Akyildirim, Ahmet Goncu, and Ahmet Sensoy. 2021. Prediction of cryp- tocurrency returns using machine learning. Annals of Operations Research 297, 1 (01 Feb 2021), 3–36. https://doi.org/10.1007/s10479-020-03575-y

  3. [3]

    Christoph Bandt and Bernd Pompe. 2002. Permutation entropy: a natural com- plexity measure for time series. Physical review letters 88, 17 (2002), 174102

  4. [4]

    Baur, KiHoon Hong, and Adrian D

    Dirk G. Baur, KiHoon Hong, and Adrian D. Lee. 2018. Bitcoin: Medium of exchange or speculative assets? Journal of International Financial Markets, Insti- tutions and Money 54 (2018), 177–189. https://doi.org/10.1016/j.intfin.2017.12.004

  5. [5]

    Ahmed Bouteska, Mohammad Zoynul Abedin, Petr Hajek, and Kunpeng Yuan

  6. [6]

    Leo Breiman. 2001. Random forests. Machine learning 45, 1 (2001), 5–32

  7. [7]

    Leopoldo Catania, Stefano Grassi, and Francesco Ravazzolo. 2019. Forecasting cryptocurrencies under model and parameter instability. International Journal of Forecasting 35, 2 (2019), 485–501. https://doi.org/10.1016/j.ijforecast.2018.09.005

  8. [8]

    Tianqi Chen and Carlos Guestrin. 2016. Xgboost: A scalable tree boosting system. In Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining . 785–794

Show all 30 references
  1. [9]

    Massimo Guidolin Daniele Bianchi and Manuela Pedio. 2023. The dynamics of returns predictability in cryptocurrency markets. The European Journal of Finance 29, 6 (2023), 583–611. https://doi.org/10.1080/1351847X.2022.2084343 arXiv:https://doi.org/10.1080/1351847X.2022.2084343

  2. [10]

    Alysha M De Livera, Rob J Hyndman, and Ralph D Snyder. 2011. Forecasting time series with complex seasonal patterns using exponential smoothing. J. Amer. Statist. Assoc. 106, 496 (2011), 1513–1527

  3. [11]

    J. L. Elman. 1990. Finding structure in time. Cognitive Science 14, 2 (1990), 179–211

  4. [12]

    Julien Herzen, Francesco Lässig, Samuele Giuliano Piazzetta, Thomas Neuer, Léo Tafti, Guillaume Raille, Tomas Van Pottelbergh, Marek Pasieka, Andrzej Skrodzki, Nicolas Huguenin, Maxime Dumonal, Jan Kościsz, Dennis Bader, Frédérick Gusset, Mounir Benheddi, Camila Williamson, Mi...

  5. [13]

    Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory.Neural computation 9, 8 (1997), 1735–1780

  6. [14]

    Rob J Hyndman and George Athanasopoulos. 2021. Forecasting: Principles and Practice (3rd ed). OTexts

  7. [15]

    Salim Lahmiri and Stelios Bekiros. 2019. Cryptocurrency forecasting with deep learning chaotic neural networks. Chaos, Solitons & Fractals 118 (2019), 35–40. https://doi.org/10.1016/j.chaos.2018.11.014

  8. [16]

    Salim Lahmiri, Stelios Bekiros, and Frank Bezzina. 2022. Complexity analysis and forecasting of variations in cryptocurrency trading volume with support vector regression tuned by Bayesian optimization under different kernels: An empirical comparison from a large dataset. Expe...

  9. [17]

    Sean McNally, Jason Roche, and Simon Caton. 2018. Predicting the Price of Bitcoin Using Machine Learning. In 2018 26th Euromicro International Conference on Parallel, Distributed and Network-based Processing (PDP) . 339–343. https: //doi.org/10.1109/PDP2018.2018.00060

  10. [18]

    Ujan Mukhopadhyay, Anthony Skjellum, Oluwakemi Hambolu, Jon Oakley, Lu Yu, and Richard Brooks. 2016. A brief survey of Cryptocurrency systems. In 2016 14th Annual Conference on Privacy, Security and Trust (PST) . 745–752. https: //doi.org/10.1109/PST.2016.7906988

  11. [19]

    Satoshi Nakamoto. 2008. Bitcoin: A Peer-to-Peer Electronic Cash System. https: //bitcoin.org/bitcoin.pdf Accessed: 2015-07-01

  12. [20]

    Boris N Oreshkin, Dmitri Carpov, Nicolas Chapados, and Yoshua Bengio. 2019. N-BEATS: Neural basis expansion analysis for time series forecasting. In arXiv preprint arXiv:1905.10437

  13. [21]

    O. A. Rosso, H. A. Larrondo, M. T. Martin, A. Plastino, and M. A. Fuentes. 2007. Distinguishing Noise from Chaos. Phys. Rev. Lett. 99 (Oct 2007), 154102. Issue 15. https://doi.org/10.1103/PhysRevLett.99.154102

  14. [22]

    Helder Sebastião and Pedro Godinho. 2021. Forecasting and trading cryptocur- rencies with machine learning under changing market conditions. Financial Innovation 7, 1 (06 Jan 2021), 3. https://doi.org/10.1186/s40854-020-00217-x

  15. [23]

    Ludermir, and Tatijana Stosic

    Darko Stosic, Dusan Stosic, Teresa B. Ludermir, and Tatijana Stosic. 2019. Explor- ing disorder and complexity in the cryptocurrency space. Physica A: Statistical Mechanics and its Applications 525 (2019), 548–556. https://www.sciencedirect. com/science/article/pii/S0378437119303279

  16. [24]

    Ivan Svetunkov, Nikolaos Kourentzes, and John Keith Ord. 2022. Complex ex- ponential smoothing. Naval Research Logistics (NRL) 69, 8 (2022), 1108–1123. https://doi.org/10.1002/nav.22074

  17. [25]

    Sean J Taylor and Benjamin Letham. 2018. Forecasting at scale. The American Statistician 72, 1 (2018), 37–45

  18. [26]

    Junhuan Zhang, Kewei Cai, and Jiaqi Wen. 2024. A survey of deep learning applications in cryptocurrency. iScience 27, 1 (2024), 108509. https://doi.org/10. 1016/j.isci.2023.108509

  19. [27]

    Ribeiro, and Osvaldo A

    Luciano Zunino, Felipe Olivares, Haroldo V. Ribeiro, and Osvaldo A. Rosso. 2022. Permutation Jensen-Shannon distance: A versatile and fast symbolic tool for complex time-series analysis. Phys. Rev. E 105 (Apr 2022), 045310. Issue 4. https://doi.org/10.1103/PhysRevE.105.045310

  20. [28]

    Tabak, Darío G

    Luciano Zunino, Massimiliano Zanin, Benjamin M. Tabak, Darío G. Pérez, and Osvaldo A. Rosso. 2010. Complexity-entropy causality plane: A useful approach to quantify the stock market inefficiency. Physica A: Statistical Mechanics and its Applications 389, 9 (2010), 1891–1901. h...

  21. [29]

    Alexandra Gabriela Ţiţan. 2015. The Efficient Market Hypothesis: Review of Specialized Literature and Empirical Research. Procedia Economics and Finance 32 (2015), 442–449. https://doi.org/10.1016/S2212-5671(15)01416-1 Emerging Markets Queries in Finance and Business 2014, EMQ...

  22. [2024]

    International Review of Financial Analysis 92 (2024), 103055

    Cryptocurrency price forecasting – A comparative analysis of ensemble learning and deep learning methods. International Review of Financial Analysis 92 (2024), 103055. https://doi.org/10.1016/j.irfa.2023.103055

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.