REVIEW 5 major objections 5 minor 36 references
Explainable-AI powered stock price prediction using time series transformers: A Case Study on BIST100
T0 review · 5 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read This paper claims that on BIST100 bank stock data, the decomposition-based linear model DLinear forecasts daily prices more accurately than LSTNet, Vanilla Transformer, and Time Series Transformer, and that SHAP and LIME make the…
desk verdict A competent BIST100 benchmark whose DLinear-wins claim is undermined by a missing validation set and missing naive baseline; fixable, but not acceptable as is. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is DLinear's trend\u2013seasonality decomposition: the input series is smoothed with moving averages to separate a trend component from a residual seasonal component, each component is passed through its own linear layer, and the two outputs are summed. This is what lets a lightweight linear model capture the dominant temporal structure in bank stock prices without attention, and the study argues that it explains why DLinear beats the attention-based baselines. The interpretability machinery consists of SHAP, which assigns each feature a game-theoretic Shapley contribution averaged over the dataset, and LIME, which fits a local sparse surrogate around a single prediction; these are used to expose which technical indicators drive the forecasts.
What would settle it
Re-run the identical experiment with min-max normalization fit only on the training split, a separate validation split for hyperparameter selection, and a fixed seeded DLinear configuration; if DLinear then no longer beats LSTNet, Vanilla Transformer, and TST on most series across all five metrics, the paper's main superiority claim is falsified.
Extended reading notes
Core claim
The central claim is that DLinear, a decomposition-based linear model, consistently outperforms the other three evaluated architectures across MSE, MAE, MAPE, RMSE, and $R^2$ on every stock and index in the dataset. The paper reports $R^2$ values from 0.984 to 0.995 for DLinear, with the strongest results on GARAN ($R^2=0.9955$, MAPE 2.34%) and the lowest percentage error on XU100 (MAPE 1.42%). It also claims that SHAP global explanations consistently rank short-lag RSI and MACD or volume features as the dominant drivers, while LIME explanations on the final day shift toward longer-horizon moving averages and volatility indicators. The study reads this global versus local divergence as evidence that the model is context-sensitive rather than contradictory.
Load-bearing premise
The load-bearing premise is that the evaluation is leak-free: min-max normalization statistics and hyperparameters such as sequence length are chosen without consulting the test period, so the reported test-set $R^2$ values and DLinear's margin are not inflated by information from the future.
Editorial extensions
If this is right
- DLinear gives a cheap, high-accuracy baseline for BIST100 bank forecasting, reaching near-99% $R^2$ at a fraction of the compute of attention models.
- On this dataset, complex attention architectures buy little accuracy, so practitioners can prefer the simpler model and reserve transformers for settings with longer or more nonlinear dependencies.
- SHAP's global emphasis on short-lag RSI and MACD suggests that momentum and volume indicators carry most forecasting signal for Turkish bank prices over this decade.
- LIME's local emphasis on moving averages, Bollinger Bands, and Ichimoku components means explanations can change sharply by date, so forecasts should be accompanied by both global and local attribution.
- The same 80/20 split with technical-indicator enrichment can be replicated for other BIST sectors or emerging markets, giving a direct benchmark for XAI-augmented forecasting.
Reading between the lines
- We infer that a testable extension beyond the paper is to apply the same four-model comparison to other emerging-market bank panels; the expectation from these results is that DLinear's linear decomposition retains its edge whenever prices are dominated by strong trends, and loses it in regimes with regime shifts or non-stationarity.
- The reported gap between SHAP and LIME suggests a practical design principle for investor-facing tools: show a global driver ranking and a local \u2018why this prediction\u2019 explanation together, because either alone gives an incomplete picture.
- Because the dataset ends in March 2025 and includes high-inflation episodes, a natural stress test is to retrain on data containing a sudden crisis or policy shock and check whether DLinear's decomposition absorbs the break or whether its $R^2$ drops below the transformer models.
- The paper's reliance on technical indicators only leaves room for adding macro and sentiment inputs; if those features carry independent signal, the RSI-dominant SHAP rankings would shift, changing the financial-literacy story from momentum-following to fundamental context.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This manuscript proposes an empirical framework that combines four time-series forecasting models—DLinear, LSTNet (also written LTSNet), Vanilla Transformer, and Time Series Transformer—with a set of technical indicators to predict daily closing prices of five Turkish banks and two BIST indices. The authors report performance metrics (MSE, MAE, MAPE, RMSE, R²) for each model and use SHAP and LIME to interpret the DLinear model's predictions. The central claim, stated in the Highlights and Section 5, is that DLinear consistently outperforms the other architectures across all metrics.
Significance. If the evaluation were sound, the paper would offer a useful case study of simple linear decomposition models versus transformer architectures in an emerging market, and a concrete demonstration of how XAI can be attached to a time-series forecaster. The authors are transparent about the limitations of their dataset (Section 6.1). However, the significance is undercut by three unresolved methodological questions: whether the test set was used for model selection, whether normalization leaks test information, and whether any naive baseline would achieve similar R² values. These concerns directly affect the paper's central quantitative claim.
major comments (5)
- [§3.2.4] No validation set is described. The paper defines only an 80/20 train–test split and says that sequence length and hyperparameters were "selected based on performance metrics such as MSE, RMSE, and MAPE" and that DLinear's "best results" were determined by configurations that "minimize error metrics." On the most natural reading, the same 20% test window was used both to choose configurations and to produce the reported test metrics. This makes the DLinear advantage in Section 5 a potential selection artifact rather than an out-of-sample result. The authors must introduce a proper validation split (or nested cross-validation) and report metrics from a single final evaluation on untouched data.
- [§3.2.4] The text states that "all variables are normalized to the [0, 1] range using min-max normalization prior to training" but does not state that the minimum and maximum values are computed exclusively on the training split. If the scaling parameters are computed on the full dataset, information from the test period propagates into the training inputs, and the reported R² values in Tables 3–6 are inflated. The authors must state the exact procedure and, if necessary, re-run the experiments with training-only scaling.
- [§4, Tables 3–6] The comparison contains no naive or statistical baseline, such as a persistence forecast or AR(1). Because the targets are trending price levels, a model that simply repeats the last observed value would also produce R² values in the 0.98–0.99 range. Without such a baseline, the claim in the Highlights and Section 5 that DLinear shows "superior forecasting capability" is not established; the authors should add at least a persistence and an ARIMA/AR baseline to the benchmark tables.
- [§3.2.4] Shuffling the training set once "before the training process begins" is incompatible with a causal time-series forecasting setup. If the model's input windows are constructed after shuffling, each window can contain observations that temporally follow the target, which is a form of lookahead leakage; if the windows are constructed before shuffling, the description is misleading. The authors need to clarify the exact order of windowing and shuffling and justify why shuffling is used for a temporal task.
- [§4, Tables 3–6] The reported numbers contain internal inconsistencies that undermine confidence in the results. For example, Table 3 lists GARAN's R² as 0.9955 and QNBTR's as 0.9847, but the text refers to "the lowest R² of 0.984%" for QNBTR; the paragraph on Table 4 claims GARAN has "the highest R² of 0.995", although Table 4 reports 0.9836 for GARAN; and the same paragraph attributes an MSE of 0.104 and RMSE of 0.3234 to ISCTR, which are actually the DLinear values from Table 3, not the LSTNet values. The model is also called LTSNet in Table 2 and LSTNet elsewhere. All of these need to be corrected and the tables re-verified.
minor comments (5)
- [Abstract and Table 2] The model name is written as "LTSNet" in the abstract and Table 2 but as "LSTNet" in Section 3.2.1 and Table 4; standardize the name throughout the manuscript.
- [Figures 4–10] The study claims to evaluate "transformer models," but the SHAP and LIME analyses are applied only to DLinear; clarify that the XAI part concerns only the DLinear model.
- [§4] Figure 3 is discussed before Figure 2 in the text; renumber either the figures or the references.
- [§3.2.4] The paper does not state the prediction horizon (single-step versus multi-step); specify whether the models output one day ahead or multiple days ahead.
- [Figure 6] Figure 6 mentions "MA_200" and "MA_300" as influential features, but Table 1 does not include these indicators; either add them to Table 1 or correct the figure caption.
Circularity Check
DLinear's reported superiority is a selection artifact: sequence length and hyperparameters are chosen on the same test metrics later reported as the model's out-of-sample performance.
-
fitted input called prediction
[Section 3.2.4 (Methodology) and Section 5 (Discussion); Tables 3-6]
"The dataset is divided into training and testing subsets based on predefined split ratios. For each dataset used in this study, a fixed train-test split ratio of 80%–20% is applied ... In this study, multiple values of sequence length are systematically tested for each model, and the most suitable value is selected based on performance metrics such as MSE, RMSE, and MAPE."
The methodology defines only an 80/20 train/test split and never introduces a validation set. Sequence length and, for DLinear, epochs, batch size, learning rate, and dropout are then chosen by minimizing error metrics such as MSE, RMSE, and MAPE. In the absence of any other evaluation partition, those tuning metrics are the same test-set metrics reported in Tables 3-6 and used in Section 5 to conclude that 'DLinear consistently outperforms its counterparts across all performance metrics.' The headline result is therefore not an out-of-sample prediction but the output of selecting the configuration and model that minimize the very figures later presented as evidence; the reported advantage is forced by the selection criterion.
full rationale
This is an empirical paper with no mathematical derivation chain, so there is no equation-level circularity and no load-bearing self-citation (the reference list contains no works by the present authors). The one substantive circularity concern is the evaluation protocol: the paper describes only a train/test split and then tunes sequence length and hyperparameters using MSE/RMSE/MAPE, with DLinear's final setup chosen as the one that minimizes error metrics. Since no validation partition is described, the natural reading is that the test set was used to select configurations, making the reported DLinear superiority a selection artifact rather than an independent forecast. The absence of a naive or random-walk baseline is a completeness and interpretability problem but not itself a circularity; it is noted only to explain why the absolute R² values are uncontextualised. On the stated protocol, the central comparative claim is partially circular, warranting a score of 6.
Assumptions & free parameters
free parameters (4)
- DLinear hyperparameters =
epochs=100, lr=1e-3, batch_size=32, seq_len=10, dropout=0.0
- Vanilla Transformer hyperparameters =
epochs=50, lr=1e-4, batch_size=64, seq_len=10, dropout=0.1
- TST hyperparameters =
epochs=50, lr=1e-4, batch_size=32, seq_len=5, dropout=0.1
- LTSNet hyperparameters =
epochs=100, lr=1e-5, batch_size=64, seq_len=5, dropout=0.2
assumptions (5)
- domain assumption Technical indicators (EMA, RSI, ATR, Bollinger, Ichimoku) computed from OHLCV data contain information useful for predicting future closing prices.
- domain assumption Min-max normalization is applied without lookahead leakage.
- domain assumption Shuffling the training set preserves the validity of the time series forecasting setup.
- domain assumption The 80/20 chronological split gives a representative test period.
- standard math R², MAPE, RMSE, and MAE are appropriate metrics for comparing forecast accuracy across models.
Cite this review
Pith. "Pith review of Explainable-AI powered stock price prediction using time series transformers: A Case Study on BIST100." pith.science (2026). https://pith.science/paper/TIONPCF7
@misc{pith2026250606345,
author = {Pith},
title = {Pith review of: Explainable-AI powered stock price prediction using time series transformers: A Case Study on BIST100},
year = {2026},
howpublished = {\url{https://pith.science/paper/TIONPCF7}},
note = {Machine review of arXiv:2506.06345}
}
read the original abstract
Financial literacy is increasingly dependent on the ability to interpret complex financial data and utilize advanced forecasting tools. In this context, this study proposes a novel approach that combines transformer-based time series models with explainable artificial intelligence (XAI) to enhance the interpretability and accuracy of stock price predictions. The analysis focuses on the daily stock prices of the five highest-volume banks listed in the BIST100 index, along with XBANK and XU100 indices, covering the period from January 2015 to March 2025. Models including DLinear, LTSNet, Vanilla Transformer, and Time Series Transformer are employed, with input features enriched by technical indicators. SHAP and LIME techniques are used to provide transparency into the influence of individual features on model outputs. The results demonstrate the strong predictive capabilities of transformer models and highlight the potential of interpretable machine learning to empower individuals in making informed investment decisions and actively engaging in financial markets.
Figures
Reference graph
Works this paper leans on
-
[1]
Armagan, I.U., 2023. Price prediction of the borsa istanbul banks index with traditional methods and artificial neural networks. Borsa Istanbul Review 23, S30–S39
work page 2023
-
[2]
Makine öğrenmesi ve derin öğrenme algoritmalarını kullanarak hisse senedi fiyat tahmini
Arslankaya, S., Toprak, Ş., 2021. Makine öğrenmesi ve derin öğrenme algoritmalarını kullanarak hisse senedi fiyat tahmini. International Journal of Engineering Research and Development 13, 178–192
work page 2021
-
[3]
Baveja, G.S., Verma, A., 2024. Impact of financial literacy on investment decisions and stock market participation using ex - treme learning machines. URL: https://arxiv.org/abs/2407.03498, arXiv:2407.03498
work page Pith review arXiv 2024
-
[4]
de Carvalho, M.P.P., 2023. The Impact of Artificial Intelligence on the Banking and Financial Sector’s Strategic Decision-Making. Master’s thesis. Universidade Catolica Portuguesa (Portugal)
work page 2023
-
[5]
Towards Responsible AI in Banking: Addressing Bias for Fair Decision-Making
Castelnovo, A., 2024. Towards responsible ai in banking: Addressing bias for fair decision-making. arXiv preprint arXiv:2401.08691
work page Pith review arXiv 2024
-
[6]
Explainable artificial in - telligence (xai) in finance: a systematic literature review
Černevičiene˙, J., Kabašinskas, A., 2024. Explainable artificial in - telligence (xai) in finance: a systematic literature review. Artificial Intelligence Review 57, 216
work page 2024
-
[7]
The role of artificial intelligence in financial analysis and forecasting: Using data and algorithms
Chernysh, O., Smishko, O., Koverninska, Y., Prokopenko, M., Pis - tunov, I., 2024. The role of artificial intelligence in financial analysis and forecasting: Using data and algorithms. Economic Affairs 69, 1493–1506
work page 2024
-
[8]
Choi, I., Kim, W.C., 2023. Enhancing financial literacy in south korea: Integrating ai and data visualization to understand financial instruments’ interdependencies. Societal Impacts 1, 100024
work page 2023
Show all 36 references
-
[9]
It meets finance: financial decision- making in the digital era, in: Handbook of financial decision making
D’Acunto, F., Rossi, A.G., 2023. It meets finance: financial decision- making in the digital era, in: Handbook of financial decision making. Edward Elgar Publishing, pp. 336–354
2023
-
[10]
Analysis of temporal pat- tern, causal interaction and predictive modeling of financial markets using nonlinear dynamics, econometric models and machine learning algorithms
Ghosh, I., Jana, R.K., Sanyal, M.K., 2019. Analysis of temporal pat- tern, causal interaction and predictive modeling of financial markets using nonlinear dynamics, econometric models and machine learning algorithms. Applied Soft Computing 82, 105553
2019
-
[11]
Hisse senedi fiyat tahmininde makine öğrenmesi ve yapay zeka kullanimi
KARACAN, S., KIRDAR, M., 2021. Hisse senedi fiyat tahmininde makine öğrenmesi ve yapay zeka kullanimi. Journal of International Social Research 14
2021
-
[12]
Big data – enabled sign prediction for borsa istanbul intraday equity prices
Kılıç, A., Güloğlu, B., Yalçın, A., Üstündağ, A., 2023. Big data – enabled sign prediction for borsa istanbul intraday equity prices. Borsa Istanbul Review 23, S38–S52
2023
-
[13]
Modeling long-and short-term temporal patterns with deep neural networks, in: The 41st international ACM SIGIR conference on research & development in information retrieval, pp
Lai, G., Chang, W.C., Yang, Y., Liu, H., 2018. Modeling long-and short-term temporal patterns with deep neural networks, in: The 41st international ACM SIGIR conference on research & development in information retrieval, pp. 95–104
2018
-
[14]
Global stock market prediction based on stock chart images using deep q-network
Lee, J., Kim, R., Koh, Y., Kang, J., 2019. Global stock market prediction based on stock chart images using deep q-network. IEEE Access 7, 167260–167277
2019
-
[15]
A portfolio recommenda- tion system based on machine learning and big data analytics
Leung, M.F., Jawaid, A., Ip, S.W., Kwok, C.H., Yan, S., Leung, M., Jawaid, A., Ip, S., Kwok, C., Yan, S., 2023. A portfolio recommenda- tion system based on machine learning and big data analytics. Data Science in Finance and Economics 3, 152–165
2023
-
[16]
A unified approach to interpreting model predictions
Lundberg, S.M., Lee, S.I., 2017. A unified approach to interpreting model predictions. Advances in neural information processing sys - tems 30
2017
-
[17]
Application of machine learning and data analysis in enhancing financial literacy
Mahmudov, A., 2024. Application of machine learning and data analysis in enhancing financial literacy. Bulletin news in New Science Society International Scientific Journal 1, 49–57
2024
-
[18]
Stock market prediction using deep learning algorithms
Mukherjee, S., Sadhukhan, B., Sarkar, N., Roy, D., De, S., 2023. Stock market prediction using deep learning algorithms. CAAI Transactions on Intelligence Technology 8, 82–94
2023
-
[19]
Ai in financial sector –a driver to financial literacy
Murugesan, R., Manohar, V., 2019. Ai in financial sector –a driver to financial literacy. Shanlax International Journal of Commerce 7, 66–70
2019
-
[20]
Financial attitude and investment decision making-moderating role of financial literacy
Niazi, M.K.S., Malik, Q.A., 2019. Financial attitude and investment decision making-moderating role of financial literacy. NUML Inter- national Journal of Business & Management 14, 102–115
2019
-
[21]
Ethical implication of artificial intelligence (ai) adoption in financial decision making
Owolabi, O.S., Uche, P.C., Adeniken, N.T., Ihejirika, C., Islam, R.B., Chhetri, B.J.T., Jung, B., 2024. Ethical implication of artificial intelligence (ai) adoption in financial decision making. Comput. Inf. Sci 17, 49–56
2024
-
[22]
Effect of artificial intelligence (ai) on financial decision -making: Mediating role of financial technologies (fin -tech)
Qatawneh, A.M., Lutfi, A., Al Barrak, T., 2024. Effect of artificial intelligence (ai) on financial decision -making: Mediating role of financial technologies (fin -tech). HighTech and Innovation Journal 5, 759–773
2024
-
[23]
Devel- opment of financial literacy through a self-advising stock investment model: an integration of machine learning and business intelligence tools to guide novice investors
Rahman, M.H., Tipu, M., Ahmed Habib, K., Ahmed, N., 2023. Devel- opment of financial literacy through a self-advising stock investment model: an integration of machine learning and business intelligence tools to guide novice investors. Available at SSRN 4669952
2023
-
[24]
Stock market prediction using machine learning
Reddy, V.K.S., Sai, K., 2018. Stock market prediction using machine learning. International Research Journal of Engineering and Technol- ogy (IRJET) 5, 1033–1035
2018
-
[25]
why should i trust you?
Ribeiro, M.T., Singh, S., Guestrin, C., 2016. " why should i trust you?" explaining the predictions of any classifier, in: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp. 1135–1144
2016
-
[26]
Derin öğrenme yöntemleri ile borsada fiyat tahmini
Şişmanoğlu, G., Koçer, F., Önde, M.A., Sahingoz, O.K., 2020. Derin öğrenme yöntemleri ile borsada fiyat tahmini. Bitlis Eren Üniversitesi Fen Bilimleri Dergisi 9, 434–445
2020
-
[27]
Thakkar, A., Chaudhari, K., 2021. Fusion in stock market prediction: A decade survey on the necessity, recent developments, and potential XAI Powered Stock Price Prediction First Author et al.: Preprint submitted to Elsevier Page 18 of 18 future directions. Information Fusion ...
2021
-
[28]
Attention is all you need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., Polosukhin, I., 2017. Attention is all you need. Advances in neural information processing systems 30
2017
-
[29]
Stock closing price prediction using machine learning techniques
Vijh, M., Chandola, D., Tikkiwal, V.A., Kumar, A., 2020. Stock closing price prediction using machine learning techniques. Procedia computer science 167, 599–606
2020
-
[30]
Wawer, M., Chudziak, J., 2025. Integrating traditional technical analysis with ai: A multi -agent llm-based approach to stock market forecasting, in: 17th International Conference on Agents and Artificial Intelligence, SciTePress
2025
-
[31]
Applications of explainable artificial intelligence in finance —a systematic review of finance, information systems, and computer science literature
Weber, P., Carl, K.V., Hinz, O., 2024. Applications of explainable artificial intelligence in finance —a systematic review of finance, information systems, and computer science literature. Management Review Quarterly 74, 867–907
2024
-
[32]
Is gpt4 a good trader? arXiv preprint arXiv:2309.10982
Wu, B., 2023. Is gpt4 a good trader? arXiv preprint arXiv:2309.10982
2023 arXiv
-
[33]
Davranişsal finans ve kamuyu aydin - latma perspektifinde şirketlere ilişkin bildirimler ve haberler: Liter - atür değerlendirmesi
Yılmaz, C., Öztürk, S., 2023. Davranişsal finans ve kamuyu aydin - latma perspektifinde şirketlere ilişkin bildirimler ve haberler: Liter - atür değerlendirmesi. Muhasebe ve Finans İncelemeleri Dergisi 6, 132–159
2023
-
[34]
Are transformers effective for time series forecasting?, in: Proceedings of the AAAI conference on artificial intelligence, pp
Zeng, A., Chen, M., Zhang, L., Xu, Q., 2023. Are transformers effective for time series forecasting?, in: Proceedings of the AAAI conference on artificial intelligence, pp. 11121–11128
2023
-
[35]
Zerveas, G., Jayaraman, S., Patel, D., Bhamidipaty, A., Eickhoff, C.,
-
[2021]
2114–2124
A transformer-based framework for multivariate time series representation learning, in: Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining, pp. 2114–2124
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.