REVIEW 5 major objections 5 minor 5 cited by
HATS: A Hierarchical Graph Attention Network for Stock Movement Prediction
T0 review · 5 major / 5 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read This paper claims that a hierarchical graph attention network which learns to weight corporate relations can improve stock movement prediction for both individual stocks and market indices, beating existing baselines on Sharpe ratio and…
desk verdict The empirical headline doesn't survive contact with the tables, but the core idea—learned per-relation weighting for stock prediction—is worth a careful look. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central mechanism is the two-layer hierarchical attention: a state attention layer computes weights over neighboring companies within each relation type, producing a summarized representation per relation, and a relation attention layer then weights these relation summaries based on the target company's current state, with the weighted summaries added to the node's own representation. The state- and relation-dependent weights allow the model to filter noisy relations and focus on informative ones, in contrast to static adjacency-matrix methods like GCN or the temporal graph convolution of TGC. This machinery carries the paper's claim that automatic relation selection improves prediction.
What would settle it
Train HATS on a graph whose relation type labels are randomly permuted, or whose edges are rewired while preserving degree; if the improvement in Sharpe ratio and F1 score over the baselines persists unchanged, then the gains come from the attention mechanism's extra capacity rather than from selectively aggregating meaningful relation types, and the paper's central claim would be falsified. A second check: if the learned relation attention weights show no correspondence to the per-relation predictive performance measured in Section 5.2, the selection mechanism is not doing the work.
Extended reading notes
Core claim
On its own terms, the paper establishes that stock movement prediction improves when a model is able to selectively aggregate information from different corporate relation types. It demonstrates that the choice of relational data changes prediction performance dramatically: some relations, such as parent-organization and subsidiary ties, help, while dense geographical relations such as country of origin degrade accuracy. The paper's contribution is HATS, a two-level attention module that summarizes neighbor information per relation and then weights the relation summaries, adding the result to each company's representation. On S&P 500 data, HATS outperforms existing methods, including a manually-selected-top-20-relations GCN, on F1 score, and achieves the highest average Sharpe ratio among all tested models. The same module is adapted to predict market index movements through graph pooling, outperforming baselines there as well.
Load-bearing premise
The entire result rests on the assumption that the Wikidata-derived corporate graph, using meta-paths of at most two hops and excluding companies with no relations, captures the relationships that actually drive stock prices.
Editorial extensions
If this is right
- Using all available relations without selection can degrade prediction; models that learn to weight relations adaptively achieve the best results.
- The same relational modeling module transfers from node classification (individual stock movement) to graph classification (market index movement) when combined with graph pooling.
- HATS removes the need for manual selection of relation types, since its attention weights learn which relations matter per market phase.
- The profitability gains, measured by average daily return and Sharpe ratio, are stronger for HATS than for any baseline, indicating that attention-based relation selection improves risk-adjusted returns.
Reading between the lines
- The finding that dense, semantically weak relations hurt performance suggests a testable preprocessing rule: filtering or down-weighting high-degree relation types could improve even non-attention baselines like GCN.
- If HATS's gains persist on graphs built from richer or alternative knowledge bases, or from text-extracted relations, the method would become a general-purpose relational modeling module for financial graphs.
- The learned relation attention weights could be used as interpretable indicators of which corporate connections matter at a given time, potentially serving as features in fundamental or risk analysis.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes HATS, a hierarchical graph attention network for stock movement prediction. Node representations are initialized from an LSTM/GRU feature extractor over price change rates; HATS then applies two levels of attention—state-level attention over neighbors within each relation type and relation-level attention over relation types—to produce updated node representations, which are used for individual stock classification (node classification) and market index movement prediction via mean pooling (graph classification). The authors construct a corporate graph from Wikidata, using direct relations and two-hop meta-paths among 431 S&P 500 companies, and evaluate over 12 phases (text says 8) comparing against MLP, CNN, LSTM, GCN, GCN-TOP20, and TGC. They report that HATS outperforms all baselines in F1, accuracy, average daily return, and Sharpe ratio, and they analyze which relation types are useful.
Significance. The contribution is potentially useful: it is among the first to explicitly model relation-type selection for stock prediction and to cast index prediction as graph classification, with code and data publicly released. The relation-level analysis (Table 1 and Figure 5) is a valuable empirical observation that not all corporate relations help prediction. However, the central claim of consistent superiority is not currently supported by the evidence as presented: the experimental reporting contains internal inconsistencies, an unverified headline performance number, a baseline constructed with test-set leakage, and no uncertainty quantification. With corrected analysis the work could be a solid contribution, but the quantitative claims in the current manuscript are not yet established.
major comments (5)
- [Section 5.1, Table 2] In Table 2, the F1 rows for Phase 1 and Phase 7 are identical to four decimal places for all seven models, as are the F1 rows for Phase 2 and Phase 8, even though the corresponding accuracy rows differ. Exact equality across all models for two different market windows is implausible and indicates a copying or data-processing error. Since Table 2 is the primary evidence for the F1 improvement claimed in the abstract, the table must be corrected and the source of the duplication explained.
- [Section 5.1, Figure 3, Tables 2-3] The text states 'we divided our entire dataset into 8 smaller datasets' and that 'each phase consists of 250 days of training, 50 days of evaluation, and 100 days of testing,' yet Tables 2 and 3 report 12 phases. With 1,174 trading days, eight non-overlapping 400-day phases are impossible; the degree of overlap or alternative splitting scheme is not described. The experimental timeline is therefore not reproducible as written, and the text/table mismatch must be resolved.
- [Section 5.2, Table 1] GCN-TOP20 is constructed by selecting the 20 best-performing relation types based on F1 scores on the Phase 4 test set (Table 1 is described as 'test set of Phase 4'). Using test-set labels to select the baseline's relation set leaks Phase 4 test information into that baseline's configuration, and also means GCN-TOP20 is not an 'existing method' as claimed. Relation selection should be performed on training/validation data only, or GCN-TOP20 should be re-framed as an oracle-style upper bound; as presented, the comparison is biased in GCN-TOP20's favor and cannot be used to support the claim that HATS outperforms all existing methods.
- [Section 5.1, Tables 2-3] The paper states all experiments were repeated five times and averaged, but no standard deviations, confidence intervals, or significance tests are reported for any metric. The average F1 advantage of HATS over GCN-TOP20 is 0.0069 (approximately 2.1%), and per-phase Sharpe ratios for HATS range from 0.41 to 4.39, so without variance information the reported margins may be within noise. Report per-run results with error bars and test whether HATS's advantages over LSTM, TGC, and GCN-TOP20 are statistically significant.
- [Abstract, Section 1, Table 3] The abstract and contribution list state that HATS's Sharpe ratio was 19.8% higher than existing baselines. This number does not match any comparison in Table 3: HATS's average Sharpe (1.9914) is about 73% higher than LSTM (1.1523), 99% higher than TGC (1.0026), and 108% higher than GCN-TOP20 (0.9589). The 3% F1 figure also does not exactly correspond to any shown comparison (HATS vs. GCN-TOP20 is 2.1%; vs. LSTM is 5.8%). The baseline and computation behind the headline numbers must be specified, or the numbers corrected.
minor comments (5)
- [Section 3.4] Equation numbering is duplicated: Eq. (3.9) is used for both the node-classification loss in Section 3.3 and the mean-pooling formula in Section 3.4; renumber the equations.
- [Section 5.4] The text refers to 'table 5' for the market index prediction results, but those results appear in Table 4; the appendix Table 5 contains relation definitions, so the cross-reference should be corrected.
- [Section 4.2] There is a duplicated word in 'which we we leave for future work'; this should read 'which we leave for future work.'
- [Table 1] Table 1 lists 'Country-Country of origin' twice with different F1 scores (0.2948 and 0.2851); one entry is presumably 'Country of origin-Country' and should be corrected.
- [Section 5.4] The sentence beginning 'With only five assets' starts with a lowercase 'With' after a period; this should be capitalized.
Circularity Check
No significant circularity: HATS is defined by explicit equations and evaluated against external baselines on held-out phases; the main concerns are statistical reporting, not derivation circularity.
full rationale
The claimed derivation chain is self-contained. HATS is defined by Eqs. (3.1)-(3.7) as a two-level attention mechanism over relation-specific neighbor sets, using node representations from an LSTM/GRU feature extraction module; the prediction layers are linear transforms (Eq. 3.8) and graph pooling is simple mean pooling (Eqs. 3.9-3.11). No equation defines the model output in terms of the target F1 or Sharpe metric, nor is any fitted parameter renamed as a prediction. The experimental comparison is against external baselines (MLP, CNN, LSTM, GCN, TGC) on held-out test phases, so the central 'outperforms baselines' claim is not forced by construction. The only self-citation, [19] (Self-Attention Graph Pooling, same research group), is a passing reference to pooling methods and is not used in the experiments, which explicitly use mean pooling; it is therefore not load-bearing. The GCN-TOP20 baseline is built by selecting the 20 best relation types from Phase 4 test-set F1 scores (Section 5.2), which is a methodological weakness (test-set relation selection for a baseline) but not circularity in HATS's derivation. The reported 19.8% Sharpe improvement does not match any comparison in Table 3, and Table 2 contains exact duplicate rows across phases; these are correctness and statistical reporting issues, not circular derivation. Accordingly, no circular step can be exhibited from the paper's own equations or citations, and the paper is assessed as having no significant circularity.
Assumptions & free parameters
free parameters (6)
- up/neutral/down label thresholds =
not specified
- lookback window =
50 days
- portfolio size for long/short =
15 stocks
- GCN-TOP20 selected relations =
20 relations with highest Phase 4 test F1
- relation embedding dimension d =
not specified
- train/eval/test phase lengths =
250/50/100 days
assumptions (5)
- domain assumption Stock prices are predictable to a meaningful degree from historical price changes and corporate graph structure.
- domain assumption Historical price change rates are a sufficient node feature representation.
- ad hoc to paper Wikidata meta-paths with at most two hops capture the economically meaningful relations among companies.
- domain assumption The 250/50/100-day phase division is representative of different market conditions.
- domain assumption A trading strategy ignoring transaction costs is a valid profitability measure.
invented entities (1)
-
None
Cite this review
Pith. "Pith review of HATS: A Hierarchical Graph Attention Network for Stock Movement Prediction." pith.science (2026). https://pith.science/paper/G3SVQX4Z
@misc{pith2026190807999,
author = {Pith},
title = {Pith review of: HATS: A Hierarchical Graph Attention Network for Stock Movement Prediction},
year = {2026},
howpublished = {\url{https://pith.science/paper/G3SVQX4Z}},
note = {Machine review of arXiv:1908.07999}
}
read the original abstract
Many researchers both in academia and industry have long been interested in the stock market. Numerous approaches were developed to accurately predict future trends in stock prices. Recently, there has been a growing interest in utilizing graph-structured data in computer science research communities. Methods that use relational data for stock market prediction have been recently proposed, but they are still in their infancy. First, the quality of collected information from different types of relations can vary considerably. No existing work has focused on the effect of using different types of relations on stock market prediction or finding an effective way to selectively aggregate information on different relation types. Furthermore, existing works have focused on only individual stock prediction which is similar to the node classification task. To address this, we propose a hierarchical attention network for stock prediction (HATS) which uses relational data for stock market prediction. Our HATS method selectively aggregates information on different relation types and adds the information to the representations of each company. Specifically, node representations are initialized with features extracted from a feature extraction module. HATS is used as a relational modeling module with initialized node representations. Then, node representations with the added information are fed into a task-specific layer. Our method is used for predicting not only individual stock prices but also market index movements, which is similar to the graph classification task. The experimental results show that performance can change depending on the relational data used. HATS which can automatically select information outperformed all the existing methods.
Figures
Figures from the paper (4 more)
Forward citations
Cited by 5 Pith papers
-
LLM-Enhanced Dynamic Financial Knowledge Graphs for Cross-Entity Signal Propagation and alpha discovery
In controlled simulations, community-aware propagation of LLM event signals on dynamic financial knowledge graphs recovers latent communities and prices incrementally beyond direct signals, though live alpha remains untested.
-
Pre-training Time Series Models with Stock Data Customization
Stock Specialized Pre-trained Transformer (SSPT) uses stock code classification, sector classification, and moving average prediction as pre-training tasks, and reports improved stock selection returns and Sharpe rati...
-
From Votes to Volatility Predicting the Stock Market on Election Day
Adding hand-coded candidate impact scores and a randomly assigned candidate context to StockMixer produces no robust improvement over the baseline on a single day of S&P 500 data.
-
Higher Order Transformers: Enhancing Stock Movement Prediction On Multimodal Time-Series Data
A factorized 'higher-order' transformer with kernelized linear attention and tweet plus price inputs reaches 72.94% accuracy and 0.516 MCC on StockNet, behind only NL-LSTM among the baselines compared.
-
Dynamic Graph Representation with Contrastive Learning for Financial Market Prediction: Integrating Temporal Evolution and Static Relations
A contrastive learning framework that blends dynamic stock graphs with static company relations improves next-day stock movement classification by roughly two accuracy points over four baselines.
Reference graph
Works this paper leans on
-
[1]
Comparison of arimaandartificialneuralnetworksmodelsforstockpriceprediction
Adebiyi, A.A., Adewumi, A.O., Ayo, C.K., 2014. Comparison of arimaandartificialneuralnetworksmodelsforstockpriceprediction. Journal of Applied Mathematics 2014
work page 2014
-
[2]
State-of-the-art in stock prediction techniques
Agrawal, J., Chourasia, V., Mittra, A., 2013. State-of-the-art in stock prediction techniques. International Journal of Advanced Research in Electrical, Electronics and Instrumentation Engineering 2, 1360– 1366
work page 2013
-
[3]
Bao, W., Yue, J., Rao, Y., 2017. A deep learning framework for fi- nancial time series using stacked autoencoders and long-short term memory. PloS one 12, e0180944
work page 2017
-
[4]
Twitter mood predicts the stock market
Bollen, J., Mao, H., Zeng, X., 2011. Twitter mood predicts the stock market. Journal of computational science 2, 1–8
work page 2011
-
[5]
Bollerslev, T., Marrone, J., Xu, L., Zhou, H., 2014. Stock return pre- dictability and variancerisk premia: statistical inference and interna- tional evidence. Journal of Financial and Quantitative Analysis 49, 633–661
work page 2014
-
[6]
Chen,J.,Ma,T.,Xiao,C.,2018a. FastGCN:Fastlearningwithgraph convolutional networks via importance sampling, in: International Conference on Learning Representations
-
[7]
Chen,Y.,Wei,Z.,Huang,X.,2018b. Incorporatingcorporationrela- tionship via graph convolutional neural networks for stock price pre- diction, in: Proceedings of the 27th ACM International Conference on Information and Knowledge Management, ACM. pp. 1655–1658
-
[8]
Journal of Financial Economics 61, 77–106
Dechow,P.M.,Hutton,A.P.,Meulbroek,L.,Sloan,R.G.,2001.Short- sellers, fundamental analysis, and stock returns. Journal of Financial Economics 61, 77–106
work page 2001
Show all 30 references
-
[9]
Computational learning techniques for intraday fx trading using pop- ular technical indicators
Dempster, M.A., Payne, T.W., Romahi, Y., Thompson, G.W., 2001. Computational learning techniques for intraday fx trading using pop- ular technical indicators. IEEE Transactions on neural networks 12, 744–754
2001
-
[10]
Deeplearningforevent- driven stock prediction, in: Twenty-Fourth International Joint Con- ference on Artificial Intelligence
Ding,X.,Zhang,Y.,Liu,T.,Duan,J.,2015. Deeplearningforevent- driven stock prediction, in: Twenty-Fourth International Joint Con- ference on Artificial Intelligence
2015
-
[11]
Knowledge-driven event embedding for stock prediction, in: Proceedings of COLING 2016, the 26th International Conference on Computational Linguis- tics: Technical Papers, pp
Ding, X., Zhang, Y., Liu, T., Duan, J., 2016. Knowledge-driven event embedding for stock prediction, in: Proceedings of COLING 2016, the 26th International Conference on Computational Linguis- tics: Technical Papers, pp. 2133–2142
2016
-
[12]
Dong, Y., Chawla, N.V., Swami, A., 2017. metapath2vec: Scalable representation learning for heterogeneous networks, in: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, ACM. pp. 135–144
2017
-
[13]
Tem- poral relational ranking for stock prediction
Feng, F., He, X., Wang, X., Luo, C., Liu, Y., Chua, T.S., 2019. Tem- poral relational ranking for stock prediction. ACM Transactions on Information Systems (TOIS) 37, 27
2019
-
[14]
Deep learning with long short-term memorynetworksforfinancialmarketpredictions
Fischer, T., Krauss, C., 2018. Deep learning with long short-term memorynetworksforfinancialmarketpredictions. EuropeanJournal of Operational Research 270, 654–669
2018
-
[15]
Gilmer, J., Schoenholz, S.S., Riley, P.F., Vinyals, O., Dahl, G.E.,
-
[16]
Inductive representation learning on large graphs, in: Advances in Neural Information Pro- cessing Systems, pp
Hamilton, W., Ying, Z., Leskovec, J., 2017. Inductive representation learning on large graphs, in: Advances in Neural Information Pro- cessing Systems, pp. 1024–1034
2017
-
[17]
Semi-supervised classification with graph convolutional networks
Kipf, T.N., Welling, M., 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907
2016 arXiv
-
[18]
Imagenet clas- sification with deep convolutional neural networks, in: Advances in neural information processing systems, pp
Krizhevsky, A., Sutskever, I., Hinton, G.E., 2012. Imagenet clas- sification with deep convolutional neural networks, in: Advances in neural information processing systems, pp. 1097–1105
2012
-
[19]
Self-attention graph pooling
Lee, J., Lee, I., Kang, J., 2019. Self-attention graph pooling. arXiv preprint arXiv:1904.08082
2019 arXiv
-
[20]
News impact on stock price return via sentiment analysis
Li, X., Xie, H., Chen, L., Wang, J., Deng, X., 2014. News impact on stock price return via sentiment analysis. Knowledge-Based Systems 69, 14–23
2014
-
[21]
The efficient market hypothesis and its critics
Malkiel, B.G., 2003. The efficient market hypothesis and its critics. Journal of economic perspectives 17, 59–82
2003
-
[22]
Predicting stock andstockpriceindexmovementusingtrenddeterministicdataprepa- ration and machine learning techniques
Patel, J., Shah, S., Thakkar, P., Kotecha, K., 2015. Predicting stock andstockpriceindexmovementusingtrenddeterministicdataprepa- ration and machine learning techniques. Expert Systems with Appli- cations 42, 259–268
2015
-
[23]
Stock return fore- casting: somenewevidence
Phan, D.H.B., Sharma, S.S., Narayan, P.K., 2015. Stock return fore- casting: somenewevidence. InternationalReviewofFinancialAnal- ysis 40, 38–51
2015
-
[24]
Recurrent neural net- work and a hybrid model for prediction of stock returns
Rather, A.M., Agarwal, A., Sastry, V., 2015. Recurrent neural net- work and a hybrid model for prediction of stock returns. Expert Sys- tems with Applications 42, 3234–3241
2015
-
[25]
Graph attention networks
Veli/uni010Dkovi/uni0107, P., Cucurull, G., Casanova, A., Romero, A., Lio, P., Bengio, Y., 2017. Graph attention networks. arXiv preprint arXiv:1710.10903
2017 arXiv
-
[26]
Wikidata: a free collaborative knowledge base
Vrande/uni010Di/uni0107, D., Krötzsch, M., 2014. Wikidata: a free collaborative knowledge base
2014
-
[27]
Graph convolutional neural networks for web- scale recommender systems, in: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp
Ying, R., He, R., Chen, K., Eksombatchai, P., Hamilton, W.L., Leskovec, J., 2018a. Graph convolutional neural networks for web- scale recommender systems, in: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 974–983
-
[28]
Hierarchicalgraphrepresentationlearningwithdifferentiable pooling,in: AdvancesinNeuralInformationProcessingSystems,pp
Ying, Z., You, J., Morris, C., Ren, X., Hamilton, W., Leskovec, J., 2018b. Hierarchicalgraphrepresentationlearningwithdifferentiable pooling,in: AdvancesinNeuralInformationProcessingSystems,pp. 4800–4810
-
[29]
replaces
Zhang, M., Chen, Y., 2018. Link prediction based on graph neural networks, in: Advances in Neural Information Processing Systems, pp. 5165–5175. Raehyun Kim et al.:Preprint submitted to Elsevier Page 13 of 15 HATS: A Hierarchical Graph Attention Network for Stock Movement Pred...
2018
-
[2017]
Neural message passing for quantum chemistry, in: Pro- ceedings of the 34th International Conference on Machine Learning- Volume 70, JMLR. org. pp. 1263–1272
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.