REVIEW 4 major objections 5 minor 21 references
Comparative analysis of financial data differentiation techniques using LSTM neural network
T0 review · 4 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read Feeding LSTMs fractionally differenced prices, not log returns, improves forecasts and risk-adjusted trading returns.
desk verdict A competent empirical comparison of fractional differencing variants for LSTM forecasting, but the missing persistence baseline and lack of significance tests make the headline claim fragile. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the fractional differencing operator $\Delta^d=(1-B)^d$, expanded through the binomial series into weights $\omega_0=1$ and $\omega_k=-\omega_{k-1}(d-k+1)/k$ applied to past observations, with the tempered variant $\omega_k=-\omega_{k-1}(d-k+1)e^{-\lambda}/k$ for the ARTFIMA version. A fixed-width window keeps only weights above a threshold $\tau$, and the minimal order $d$ is the smallest value for which the transformed series passes the augmented Dickey-Fuller test at the 95% level, so the input is stationary while its correlation with the original price level stays near 0.99 (and above 0.9 even for the ARFIMA-based series). These differentiated series, lagged and combined with SMA, RSI, Bollinger Bands, and MACD indicators, enter LSTM memory cells whose gates decide what long-range information to retain. The machinery embodies the stationarity-versus-memory trade-off the comparison rests on: log returns maximize stationarity but erase memory, while fractional orders keep enough of both for the LSTM to exploit.
What would settle it
Re-run the four-way comparison holding the LSTM architecture, hyperparameters, and random seeds fixed across all transforms, and check whether the fractionally differenced inputs still improve RMSE, MAE, and MAPE and still beat buy-and-hold; if the ranking shifts with seeds or architecture, the memory-preservation explanation is not established. A complementary test is to simulate ARFIMA series with known fractional orders and verify that the LSTM's advantage over log returns grows with the true $d$.
Extended reading notes
Core claim
The central claim is that fractionally differentiated price series are a better input to an LSTM forecaster than logarithmic returns, because full first-order differencing removes an excessive amount of a series' memory. The differencing order $d$ is estimated three ways — De Prado's minimal value that achieves stationarity per the augmented Dickey-Fuller test, the fractional parameter from an ARFIMA$(0,d,0)$ model, and a tempered variant from an ARTFIMA$(0,d,\lambda,0)$ model — and each resulting series, augmented with the same technical indicators, feeds a separately tuned LSTM. On out-of-sample data from 2021 to 2023, either the De Prado or the ARFIMA-based transform yields the lowest RMSE, MAE, and MAPE for every index (for example, S&P 500 RMSE of 49.81 versus 65.30 for log returns), while the tempered series resembles log returns and performs no better, leading the authors to reject the tempering hypothesis. The trading results are strongest at the portfolio level, where the ARFIMA-based Long-Only strategy reaches an Information Ratio of 1.63 and a Sortino Ratio of 2.99, against 0.48 and 0.79 for buy-and-hold, with transaction costs included.
Load-bearing premise
The comparison assumes that the per-method hyperparameter tuning (batch size, layers, cells, dropout, regularization, and learning rate) is not what actually decides which differencing transform wins, since no fixed architecture, random seed, or sensitivity analysis is reported to rule tuning effects out.
Editorial extensions
If this is right
- Choosing a memory-preserving differencing order is a direct lever on forecast error: for every index, a fractional method beats log returns on RMSE, MAE, and MAPE.
- Fractionally differenced forecasts translate into tradeable signals, with the ARFIMA-based Long-Only portfolio strategy beating buy-and-hold on both Information Ratio (1.63 vs 0.48) and Sortino Ratio (2.99 vs 0.79) over 2021-2023.
- No single fractional method is universally best: the minimal stationary order from De Prado's method wins for some assets while the larger ARFIMA-estimated order wins for others, so the smallest stationary $d$ is not automatically optimal.
- Tempered fractional differencing, as implemented here, removes about as much memory as log returns and offers no advantage, rejecting the hypothesis that tempering helps.
- The outperformance survives transaction costs of 0.005%, supporting practical deployment of the strategy rather than an accuracy gain that only exists in the metrics.
Reading between the lines
- If the proposed mechanism is right, the advantage should scale with the strength of a series' long memory; a direct test is simulating ARFIMA series with known $d$ and checking that the LSTM's gain over log returns grows as $d$ approaches 0.5.
- Because hyperparameters were tuned separately for each method and no random seeds are reported, an essential cross-check is rerunning the comparison with a fixed architecture and multiple seeds to confirm that the transform, not the tuning, drives the ranking.
- The portfolio-level outperformance hints that the edge is more visible after diversification across assets; testing the same ordering of transforms on individual stocks, currencies, or cryptocurrencies would show whether the result generalizes.
- The failed tempered variant implies the exponential factor $e^{-\lambda}$ removes exactly the long-range autocovariance the LSTM exploits, a claim that could be tested by sweeping $\lambda$ on a single asset while holding $d$ fixed and observing whether forecast error rises monotonically with $\lambda$.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper compares four data transformation methods as inputs to LSTM networks for one-day-ahead forecasting of four stock indices (S&P 500, WIG20, DAX, Nikkei 225) over an out-of-sample period 2021-2023: logarithmic returns, De Prado's (2018) fractional differentiation, fractional differentiation using an ARFIMA(0,d,0)-estimated d, and tempered fractional differentiation using ARTFIMA(0,d,lambda,0) parameters. For each asset and method, the authors estimate d (and lambda), construct features from lagged transformed values and technical indicators, train an LSTM with per-method hyperparameter tuning, invert the forecasts to price levels, and compare RMSE/MAE/MAPE. They also construct Long-Short and Long-Only trading strategies from the forecasts, backtest them with transaction costs, and report risk-adjusted metrics (IR, SR, MD, etc.) for individual assets and an equally weighted portfolio. The central claim is that memory-preserving fractional differentiation improves forecasting accuracy and trading performance relative to log returns, with the ARFIMA-based method often performing best and tempered differentiation performing poorly.
Significance. If the claims hold, the paper provides a useful extension of De Prado's (2018) fractional differentiation framework by showing that d estimated by ARFIMA/ARTFIMA models can be plugged into the fixed-width-window weighting scheme, and that such inputs improve LSTM forecasts and trading strategies. The use of four major indices, a clearly described train/validation/test split, out-of-sample evaluation, and transaction-cost-adjusted backtests are strengths. The paper is also candid about the WIG20 anomaly and about the lack of a universally best d. However, the manuscript does not yet establish that the observed improvements are due to memory preservation rather than target smoothness or hyperparameter tuning artifacts, and it provides no statistical significance tests for the forecast or trading comparisons. These gaps are load-bearing for the main hypotheses H1, H2, and H4.
major comments (4)
- [§4.2, Table 4] The forecast accuracy comparison is performed on price-level forecasts obtained by inverting each method's transformed predictions (Section 4.1, step 10), but the four target series have very different autocorrelation structures: log returns are near white noise, while fractionally differenced log prices with d≈0.2–0.5 are highly persistent. A trivial no-change (persistence) forecast on the transformed series will produce much smaller price-level errors for the more persistent fractional series, even if the LSTM learns no genuine predictive signal. The paper reports no such persistence baseline, nor an AR(1) or random-walk benchmark applied to the same transformed series, so the RMSE/MAE advantage in Table 4 may reflect target smoothness rather than memory preservation. This issue also affects the trading-signal comparison, because a smoother target changes how often the threshold rule in Equations (46)–(47) triggers trades. Please add persistence and simple linear baselines on the same transformed series, or report error metrics on the transformed scale with appropriate scaling.
- [§4.1, steps 7–8] The LSTM hyperparameters (batch size, epochs, number of layers, number of cells, dropout, recurrent dropout, regularization, learning rate) are tuned separately for every asset and every differencing method. With no fixed architecture, no seed control, and no repeated runs, the performance differences in Tables 4–14 could be artifacts of the tuning process or random weight initialization rather than effects of the differencing method. The paper reports no standard deviations across runs, no sensitivity analysis, and no evidence that the tuning procedure converges to comparable-quality optima across methods. At minimum, please report the selected hyperparameters and seed values, and ideally rerun each configuration several times to show that the ranking is stable.
- [§4.3, Tables 13–14] The trading performance comparisons are based on single backtest paths over a three-year out-of-sample period, with no statistical significance testing. The portfolio Long-Only ARFIMA result (IR 1.63 vs 0.48 for Buy & Hold, SR 2.99 vs 0.79) looks impressive but could arise from luck given the small number of daily observations and the many configurations compared. Please add Diebold-Mariano or similar tests on the forecast errors, and use block bootstrap or other resampling methods to assess the variability of the trading metrics. Also report the number of trades triggered by each method, since the persistence of the target affects trade frequency and thus transaction-cost impact.
- [§3.2.1, Table 1; §4.2, Table 4] For WIG20, De Prado's method with d=0.12 produces the worst forecasts (RMSE 39.43 vs 33.30 for log returns, MAE 30.85 vs 24.32), directly contradicting the blanket statement in the abstract that fractional differentiation improves predictive performance. The text acknowledges this exception, but the conclusion that H1 is 'supported' relies on the other three indices and on the ARFIMA variant for WIG20. Please either soften the general claim to reflect the asset-specific nature of the results, or provide a substantive explanation of why a very small d value can hurt LSTM performance, supported by evidence rather than speculation.
minor comments (5)
- [Conclusions] The word 'rerurn' in the final paragraph of the conclusions should be 'return'; elsewhere 'ARFTIMA' appears in place of 'ARTFIMA' (e.g., in the introduction's overview of Section II).
- [§2.1] The LSTM equations use a symbol that appears as a garbled font; Equations (1)–(6) are unreadable in the current PDF. Please ensure all math is typeset correctly.
- [§2.1, text after Eq. (6)] The phrase 'elementwise production operator' should be 'elementwise product operator'.
- [Figures 12–21] The equity-line figures in the annex would be easier to interpret if the y-axis were labeled with the portfolio value or cumulative return, and if the legend distinguished line types in addition to colors for grayscale printing.
- [§3.2.1] The paper states that the ADF critical value is −2.86, but this value depends on the sample size and test specification; please report the exact test regression and critical value used for each index, or at least cite the source of the critical value.
Circularity Check
No significant circularity: differencing parameters are estimated on training data and LSTM forecasts are evaluated out-of-sample.
full rationale
The paper's derivation chain is not circular. The fractional differencing parameters are estimated before modeling: d_DePrado is chosen on the training portion by the ADF stationarity criterion (Section 3.2.1), while d_ARFIMA, d_ARTFIMA, and lambda_ARTFIMA are estimated in R on the training portion (Section 3.2.2). These parameters are then applied to produce transformed series used as LSTM inputs. The predictive evaluation is genuinely out-of-sample: Section 4.1 steps 7-10 describe separate training, hyperparameter tuning on validation data, one-day-ahead prediction on the untouched testing set, and inversion of the predictions back to price levels before computing RMSE, MAE, and MAPE. The comparison in Table 4 therefore does not reduce by construction to the fitted differencing parameters. The trading backtests in Section 4.3 are likewise based on out-of-sample LSTM forecasts and are benchmarked against Buy & Hold. The citation of Gajda and Walasek (2020) is from one of the present authors' earlier work, but it is used as inspiration and as a point of comparison, not as the evidence for the current conclusions; the conclusions rest on the reported out-of-sample results. The absence of a persistence or no-change baseline is a legitimate methodological concern about whether the accuracy gains are driven by target smoothness, but that is an external confound, not a circular reduction in which a prediction is equivalent to an input by definition.
Assumptions & free parameters
free parameters (17)
- d_DePrado (S&P 500) =
0.46
- d_DePrado (WIG20) =
0.12
- d_DePrado (DAX) =
0.22
- d_DePrado (Nikkei 225) =
0.28
- d_ARFIMA (S&P 500) =
0.4892
- d_ARFIMA (WIG20) =
0.4892
- d_ARFIMA (DAX) =
0.4895
- d_ARFIMA (Nikkei 225) =
0.4891
- d_ARTFIMA (S&P 500) =
0.9895
- lambda_ARTFIMA (S&P 500) =
0.0003
- d_ARTFIMA (WIG20) =
1.0187
- lambda_ARTFIMA (WIG20) =
0.0059
- d_ARTFIMA (DAX) =
1.0050
- lambda_ARTFIMA (DAX) =
0.0030
- d_ARTFIMA (Nikkei 225) =
0.9953
- lambda_ARTFIMA (Nikkei 225) =
0.0016
- Fixed-width window threshold tau =
not reported
assumptions (4)
- domain assumption The augmented Dickey-Fuller test at the 95% level is a valid criterion for choosing the minimal stationary differencing order.
- domain assumption ARFIMA(0,d,0) and ARTFIMA(0,d,lambda,0) provide reliable estimates of d and lambda for daily log index prices.
- ad hoc to paper Separate LSTM hyperparameter tuning per method does not confound the comparison of differencing methods.
- domain assumption Inverse transformations from differentiated predictions to price levels are implemented correctly for all four methods.
Cite this review
Pith. "Pith review of Comparative analysis of financial data differentiation techniques using LSTM neural network." pith.science (2026). https://pith.science/paper/C533ZMV3
@misc{pith2026250519243,
author = {Pith},
title = {Pith review of: Comparative analysis of financial data differentiation techniques using LSTM neural network},
year = {2026},
howpublished = {\url{https://pith.science/paper/C533ZMV3}},
note = {Machine review of arXiv:2505.19243}
}
read the original abstract
We compare traditional approach of computing logarithmic returns with the fractional differencing method and its tempered extension as methods of data preparation before their usage in advanced machine learning models. Differencing parameters are estimated using multiple techniques. The empirical investigation is conducted on data from four major stock indices covering the most recent 10-year period. The set of explanatory variables is additionally extended with technical indicators. The effectiveness of the differencing methods is evaluated using both forecast error metrics and risk-adjusted return trading performance metrics. The findings suggest that fractional differentiation methods provide a suitable data transformation technique, improving the predictive model forecasting performance. Furthermore, the generated predictions appeared to be effective in constructing profitable trading strategies for both individual assets and a portfolio of stock indices. These results underline the importance of appropriate data transformation techniques in financial time series forecasting, supporting the application of memory-preserving techniques.
Figures
Figures from the paper (9 more)
Reference graph
Works this paper leans on
-
[1]
Akyildirim, E., Cepni, O., Corbet, S., & Uddin, G. S. (2023). Forecasting mid-price movement of Bitcoin futures using machine learning. Annals of Operations Research, 330(1), 553-584. Ammer, M. A., & Aldhyani, T. H. (2022). Deep learning algorithm to predict cryptocurrency fluctuation prices: Increasing investment awareness. Electronics, 11(15),
work page 2023
-
[2]
Meerschaert, M. M., Sabzikar, F., & Chen, J. (2015). Tempered fractional calculus. Journal of computational physics, 293,
work page 2015
-
[12]
Transaction costs of 0.005% are included (Kryńska and Ślepaczuk, 2022)
Equity lines for 𝐿𝑜𝑛𝑔−𝑆ℎ𝑜𝑟𝑡 strategy, depending on different techniques of data differentiation for S&P 500 Equity lines represent a trading performance for different techniques of data differentiation in period from 01.01.2021 to 31.12.2023. Transaction costs of 0.005% are included (Kryńska and Ślepaczuk, 2022). Source: Own elaborations 64 Indicator 𝚫𝑿𝒕 ...
work page 2021
-
[13]
Dong, H., Bowers, H. M., & Latham, W. R. (2013). Evidence on the efficient market hypothesis from 44 global financial market indexes. Economics Research International, 2013(1), 238253. Erdas, M. L. (2019). Validity of weak-form market efficiency in Central and Eastern European countries (CEECs): Evidence from linear and nonlinear unit root tests. Review o...
work page 2013
-
[14]
M., Sabzikar, F., Phanikumar, M
Meerschaert, M. M., Sabzikar, F., Phanikumar, M. S., & Zeleke, A. (2014). Tempered fractional time series model for turbulence in geophysical flows. Journal of Statistical Mechanics: Theory and Experiment, 2014(9), P09023. Michańków, J., Sakowski, P., & Ślepaczuk, R. (2022). LSTM in algorithmic investment strategies on BTC and S&P500 index. Sensors, 22(3),
work page 2014
-
[15]
Transaction costs of 0.005% are included (Kryńska and Ślepaczuk, 2022)
Equity lines for 𝐿𝑜𝑛𝑔 𝑂𝑛𝑙𝑦 strategy, depending on different techniques of data differentiation for S&P 500 Equity lines represent a trading performance for different techniques of data differentiation in period from 01.01.2021 to 31.12.2023. Transaction costs of 0.005% are included (Kryńska and Ślepaczuk, 2022). Source: Own elaborations 65 Indicator 𝚫𝑿𝒕 𝜟...
work page 2021
-
[16]
Transaction costs of 0.005% are included (Kryńska and Ślepaczuk, 2022)
Equity lines for 𝐿𝑜𝑛𝑔−𝑆ℎ𝑜𝑟𝑡 strategy, depending on different techniques of data differentiation for WIG20 Equity lines represent a trading performance for different techniques of data differentiation in period from 01.01.2021 to 31.12.2023. Transaction costs of 0.005% are included (Kryńska and Ślepaczuk, 2022). Source: Own elaborations 66 Indicator 𝚫𝑿𝒕 𝜟𝒅...
work page 2021
-
[17]
Transaction costs of 0.005% are included (Kryńska and Ślepaczuk, 2022)
Equity lines for 𝐿𝑜𝑛𝑔 𝑂𝑛𝑙𝑦 strategy, depending on different techniques of data differentiation for WIG20 Equity lines represent a trading performance for different techniques of data differentiation in period from 01.01.2021 to 31.12.2023. Transaction costs of 0.005% are included (Kryńska and Ślepaczuk, 2022). Source: Own elaborations 67 Indicator 𝚫𝑿𝒕 𝜟𝒅𝑫...
work page 2021
Show all 21 references
-
[18]
Transaction costs of 0.005% are included (Kryńska and Ślepaczuk, 2022)
Equity lines for 𝐿𝑜𝑛𝑔−𝑆ℎ𝑜𝑟𝑡 strategy, depending on different techniques of data differentiation for DAX Equity lines represent a trading performance for different techniques of data differentiation in period from 01.01.2021 to 31.12.2023. Transaction costs of 0.005% are includ...
2021
-
[19]
Transaction costs of 0.005% are included (Kryńska and Ślepaczuk, 2022)
Equity lines for 𝐿𝑜𝑛𝑔 𝑂𝑛𝑙𝑦 strategy, depending on different techniques of data differentiation for DAX Equity lines represent a trading performance for different techniques of data differentiation in period from 01.01.2021 to 31.12.2023. Transaction costs of 0.005% are include...
2021
-
[20]
Transaction costs of 0.005% are included (Kryńska and Ślepaczuk, 2022)
Equity lines for 𝐿𝑜𝑛𝑔−𝑆ℎ𝑜𝑟𝑡 strategy, depending on different techniques of data differentiation for Nikkei 225 Equity lines represent a trading performance for different techniques of data differentiation in period from 01.01.2021 to 31.12.2023. Transaction costs of 0.005% are...
2021
-
[21]
Transaction costs of 0.005% are included (Kryńska and Ślepaczuk, 2022)
Equity lines for 𝐿𝑜𝑛𝑔 𝑂𝑛𝑙𝑦 strategy, depending on different techniques of data differentiation for Nikkei 225 Equity lines represent a trading performance for different techniques of data differentiation in period from 01.01.2021 to 31.12.2023. Transaction costs of 0.005% are ...
2021
-
[26]
(2021, January)
Shobana, G., & Umamaheswari, K. (2021, January). Forecasting by machine learning techniques and econometrics: A review. In 2021 6th international conference on inventive computation technologies (ICICT) (pp. 1010-1016). IEEE. Sze, V., Chen, Y. H., Yang, T. J., & Emer, J. S. (2...
2017
-
[50]
Harvey, A. C. (1990). Forecasting, structural time series models and the Kalman filter. Hochreiter, S. (1998). The vanishing gradient problem during learning recurrent neural nets and problem solutions. International Journal of Uncertainty, Fuzziness and Knowledge-Based System...
1990
-
[84]
Naseer, M., & Bin Tariq, D. Y. (2015). The efficient market hypothesis: A critical review of the literature. The IUP journal of financial risk management, 12(4), 48-63. Nelson, D. M., Pereira, A. C., & De Oliveira, R. A. (2017, May). Stock market's price movement prediction wi...
2015
-
[117]
Sewell, M. (2012). The efficient market hypothesis: Empirical evidence. International Journal of Statistics and Probability, 1(2), 164-178. Shah, D., Isah, H., & Zulkernine, F. (2019). Stock market analysis: A review and taxonomy of prediction techniques. International Journal...
2012
-
[158]
Yajima, Y. (1985). On estimation of long‐memory time series models. Australian Journal of Statistics, 27(3), 303-320. Yang, C., Zhai, J., & Tao, G. (2020). Deep learning for price movement prediction using convolutional neural network and long short‐term memory. Mathematical P...
1985 arXiv
-
[687]
Kabala, J., & Sabzikar, F. (2021). Statistical inference for ARTFIMA time series with stable innovations. arXiv preprint arXiv:2103.07717. Kashif, K., & Ślepaczuk, R. (2025). LSTM-ARIMA as a hybrid approach in algorithmic investment strategies. Knowledge-Based Systems. Kidd, D...
2021 arXiv
-
[917]
Michańków, J., Sakowski, P., & Ślepaczuk, R. (2024). Mean Absolute Directional Loss as a new loss function for machine learning problems in algorithmic investment strategies. Journal of Computational Science, 81, 102375. Mirete-Ferrer, P. M., Garcia-Garcia, A., Baixauli-Soler,...
2024
-
[2349]
A., Adewumi, A
Ariyo, A. A., Adewumi, A. O., & Ayo, C. K. (2014, March). Stock price prediction using the ARIMA model. In 2014 UKSim-AMSS 16th international conference on computer modelling and simulation (pp. 106-112). IEEE. Assaf, A. (2006). Dependence and mean reversion in stock prices: T...
2006 arXiv
-
[2717]
Ryś, P., & Ślepaczuk, R. (2019). Machine Learning Methods in Algorithmic Trading Strategy Optimization–Design and Time Efficiency. Central European Economic Journal, 5(52). Sabzikar, F., Kabala, J., & Burnecki, K. (2022). Tempered fractionally integrated process with stable no...
2019
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.