REVIEW 4 major objections 6 minor 1 cited by
Higher-order Structure Boosts Link Prediction on Temporal Graphs
T0 review · 4 major / 6 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read By treating short-lived group interactions as hyperedges, HTGN claims both higher dynamic link prediction accuracy and up to 50% lower memory use than pairwise temporal GNNs.
desk verdict Interesting architecture, but the experimental tables are unreliable and the theory doesn't hold; not ready for review. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is Algorithm 1, which collects incoming temporal edges into a snapshot and, whenever the snapshot reaches b edges, enumerates all maximal cliques with more than two nodes to define hyperedges, replacing any smaller hyperedges they contain. Each hyperedge then owns one memory unit instead of each node owning one, so the model's memory scales with the number of groups rather than the number of nodes. Hypergraph convolution (Bai et al., 2021) turns these hyperedge features into node embeddings, and an injective time-decay aggregation (Equation 3) merges old hyperedge features into new larger ones, which is how several hops of neighborhood information are compressed into a single representation.
What would settle it
Train HTGN and a strong pairwise baseline such as TGN or TNCN on a temporal network generated with no group interactions, using equal-sized embeddings; if HTGN still matches or beats the baseline, its edge is not coming from higher-order structure. Alternatively, run HTGN with snapshot sizes large enough that Theorem 1 predicts degraded hyperedge accuracy; if link prediction MRR does not drop, the hyperedge construction step is not driving the result.
Extended reading notes
Core claim
HTGN's central claim is that higher-order structure can be identified cheaply from temporal locality: when edges are accumulated into short snapshots, maximal cliques within a snapshot are likely to be genuine group interactions, so they can be used as hyperedges. These hyperedges are stored in a purpose-built memory module whose features are updated by message passing and aggregated with a time-decaying injective function, and node embeddings are produced by hypergraph convolution over the hyperedges. The paper demonstrates superior Mean Reciprocal Rank on dynamic link prediction across both homogeneous and bipartite temporal graphs, and proves in Theorem 2 that HTGN distinguishes pairs of temporal computation trees that pairwise message-passing TGNNs cannot, making it strictly more expressive.
Load-bearing premise
The method assumes that maximal cliques found in short snapshots of the most recent b edges correspond to genuine group interactions, so that hyperedges built from them carry signal rather than noise for link prediction.
Editorial extensions
If this is right
- Dynamic link prediction improves by about 5 percent MRR over the second-best method, averaged across the ten tested datasets.
- GPU memory consumption drops by 30–50 percent relative to memory-based pairwise baselines like TGN and TNCN.
- HTGN is strictly more expressive than pairwise message-passing temporal GNNs, meaning it can distinguish temporal computation trees those models cannot.
- The same hyperedge construction approach works for both homogeneous graphs (maximal cliques) and bipartite graphs (one partition becomes hyperedges).
- Memory use scales with the number of group structures rather than the number of nodes, avoiding the exponential expansion of multi-hop pairwise aggregation.
Reading between the lines
- Editorial inference: The snapshot mechanism could be replaced by a sliding time window to make hyperedge construction continuous rather than batch-based, which would make HTGN applicable to irregular streams without fixed batch sizes.
- Editorial inference: The memory compression idea may transfer to static graph learning, where pooling cliques into hyperedges could substitute for expensive multi-hop message passing on dense subgraphs.
- Editorial inference: The ablation result that common-neighbor information still helps suggests higher-order structure and pairwise closure signals are partly complementary; a hybrid model could push accuracy further.
- Editorial inference: A direct test of the expressiveness claim would be to compare HTGN with a pairwise TGNN of matched parameter count on datasets with and without known group structure, predicting the gap is large only when group structure exists.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes HTGN, a temporal graph neural network that constructs hyperedges from temporal event streams (maximal cliques in short snapshots for homogeneous graphs, bipartite projections with a time threshold for heterogeneous graphs), stores hyperedge features in a dynamic memory module, and applies hypergraph convolution to compute node embeddings for dynamic link prediction. The authors claim that HTGN achieves superior link prediction performance on ten real-world datasets while reducing GPU memory by up to 50%, and they provide two theoretical results: Theorem 1, which asserts that hyperedge-construction accuracy decreases with snapshot duration, and Theorem 2, which asserts that HTGN is strictly more expressive than pairwise message-passing temporal GNNs.
Significance. If the claims were substantiated, the work would be a meaningful contribution to temporal graph learning: it would be the first temporal GNN to demonstrate that exploiting higher-order structures can simultaneously improve accuracy and reduce memory cost. The idea of constructing hyperedges dynamically from event streams and allocating memory units to hyperedges rather than to individual nodes is interesting and practically motivated, and the paper makes its algorithms explicit. However, the empirical evidence is compromised by apparent duplication of baseline numbers across different datasets and by impossible dataset statistics, and the theoretical proofs contain load-bearing gaps. As presented, the central claims are not established, so the current significance is mostly in the proposal's potential rather than in its validated results.
major comments (4)
- [Section 6.2, Tables 1 and 2] The baseline rows for GraphMixer, TGAT, and DyRep in Table 2 reproduce exactly, to one decimal place, the values reported in Table 1 for UCI, Enron, and SocialEvo, even though the datasets in Table 2 (tgbl-wiki, Reddit, LastFM) are different. For example, GraphMixer is 17.6/20.4, 21.9/23.7, 35.5/35.3 in both tables, and TGAT is 20.4/23.5, 36.3/35.8, 40.4/41.6 in both tables. Such exact equality across disjoint datasets cannot arise from measurement, so the baseline results for heterogeneous graphs are not credible. Since HTGN's claimed rank of 1.3 and the average improvement of 5% are computed against these numbers, the central empirical claim of superior link prediction performance is unsupported.
- [Table 3] The dataset statistics in Table 3 contain impossible entries. The tgbl-comment row reports # Edges = 125,235 and # Unique Edges = 30,146,596, which is impossible because unique edges cannot exceed total edges. The tgbl-flight row reports 67,169,570 edges and 18,143 nodes but only 3,125 unique edges, which is implausible for a network of this size and is identical to Enron's unique edge count, suggesting a copy-and-paste error. These inconsistencies indicate that the experimental data pipeline is unreliable and need to be corrected before any performance claims can be evaluated.
- [Appendix A, proof of Theorem 1] The proof of Theorem 1 misapplies Lemma A.1 (the PAC-Bayes inequality from Germain et al.). The lemma states E_{h~Q}[ψ(h)] ≤ DKL(Q||P) + ln E_{h~P}[e^{ψ(h)}], which is an upper bound consisting of the KL divergence plus a log-partition term. In line (16), the proof instead claims E_Q[2^{-m}] ≤ DKL(Q||P) − E_P[m ln(e/2)], subtracting a positive quantity (since ln(e/2) > 0). This reverse direction is not justified by the lemma and invalidates the derivation. Consequently, Theorem 1 does not establish that shorter snapshots yield higher hyperedge-construction accuracy, so the heuristic in Algorithm 1 lacks the claimed theoretical support.
- [Appendix B, proof of Theorem 2] The proof of Theorem 2 is not rigorous. It claims that HTGN uses an 'injective aggregation function' to combine hyperedge features, but Eq. (3) defines the aggregation as a sum of MLP outputs weighted by an exponential decay, which is not injective in general. The example in Figure 5 is underspecified: the node features and timestamps are not given in a way that verifies the claim that MP-TGN cannot distinguish the two graphs, and the argument that every link used by MP-TGN is also used by HTGN assumes a specific message-passing order that is not formalized. Thus the strict-expressiveness result is not established.
minor comments (6)
- [Section 5.1, Eq. (3)] Equation (3) contains a typo: 'MLP(m[E]||)' has a dangling concatenation symbol and no second argument; it should likely be 'MLP(m[E])' or 'MLP(m[E] ∥ ...)' with the intended term specified.
- [Definition 4.3] In Definition 4.3, the union symbol is missing in 'SK a=1 Ca = V'; it should read '∪_{a=1}^K C_a = V'.
- [Section 6.1] The citation for negative sampling, Patania et al. (2017), appears unrelated to negative sampling in temporal link prediction; this reference should be replaced with the appropriate source.
- [Appendix H, Algorithm 2] In Algorithm 2, line 7, 'Find the node in |E(v)|' should read 'Find the node in E[v]' since E(v) is a set, not a numeric quantity.
- [Section 5.1, Eqs. (4)-(7)] The text refers to 'msgg()' while Eq. (5) defines 'msgd()'; the notation should be made consistent.
- [Figure 4] The y-axis label 'MRR change' is ambiguous: it is unclear whether the numbers represent percentage-point differences or relative improvements, and the caption should state the normalization.
Circularity Check
Definitional circularity in the HT-SBM justification of clique-based hyperedge construction; the empirical claims are separate but undercut by non-circular data-integrity problems.
-
self definitional
[Section 4.1, Definition 4.3 and Theorem 1]
"nodes within a hyperedge are more likely to interact collectively within a short time slot... This indicates that if we accumulate the dynamic links in a time interval to form a snapshot, the maximal cliques within the snapshot are likely to be real hyperedges. Next, we will formally illustrate this intuition. ... A hyperedge E ⊆ V of size k is said to exist at time t if every pair of nodes i, j∈ E is connected."
The formal model, HT-SBM, defines a hyperedge as any set of nodes whose every pair is connected, i.e., exactly the clique condition that Algorithm 1 enumerates. The 'accuracy' of the maximal-clique algorithm is therefore measured against a ground truth that is already the algorithm's output concept. Theorem 1 cannot provide independent evidence that 'maximal cliques within the snapshot are likely to be real hyperedges' because that claim is assumed by the definition of a hyperedge in the model. This step is load-bearing: Section 4.1 uses it to motivate Algorithm 1 and thus the entire HTGN design. The proof in Appendix A additionally applies a PAC-Bayes inequality with the wrong sign, but that is a correctness flaw rather than the circularity itself.
full rationale
The paper's central claimed contributions—superior dynamic link prediction and up to 50% memory reduction—are experimental or architectural outcomes, not quantities fitted to data and then renamed as predictions, so they are not circular in the rubric's sense. The one definitional circularity I can exhibit is the hyperedge-construction justification: HT-SBM defines a hyperedge as any fully connected set of nodes, so the maximal-clique algorithm's 'accuracy' is measured against a ground truth that already coincides with the algorithm's output concept. Theorem 1 therefore does not provide independent evidence that short-time cliques are genuine higher-order structures; it restates the modeling assumption. Theorem 2 has a definitional flavor ('The difference can be captured by HTGN'), but it is better classified as an under-specified proof rather than a circular reduction, because the paper does not show from its concrete embedding equations that the example TCTs map to different embeddings. I also note, outside the circularity score, that Table 2 duplicates Table 1 baseline values across disjoint heterogeneous datasets (the GraphMixer, TGAT, and DyRep rows are identical to the UCI, Enron, and SocialEvo columns), and Table 3 reports tgbl-comment as having 125,235 edges but 30,146,596 unique edges. These are data-integrity problems that undermine the empirical claims, but they are not circular reasoning. The score of 3 reflects one load-bearing self-definitional step while the core empirical method retains independent content.
Assumptions & free parameters
free parameters (5)
- snapshot size b (Algorithm 1) =
200
- time threshold t' for heterogeneous hyperedges (Algorithm 2) =
not reported in main text
- aggregation decay hyperparameters alpha and beta (Eq. 3) =
alpha=2, beta=1e-4
- number of hyperedge message passing layers =
2
- neighborhood hop count k and max neighbors =
k=2, max neighbors=20
assumptions (5)
- domain assumption Hypergraph temporal stochastic block model (HT-SBM) with community connection probabilities evolving as Lambda_t = Lambda_0 * pi(t)
- domain assumption Nodes in a true hyperedge interact collectively within a short time window
- standard math Expressiveness of TGNNs is defined by distinguishing temporal computation tree (TCT) pairs, following Souza et al. 2022
- standard math PAC-Bayes lemma (Lemma 17 of Germain et al. 2015) and maximal-clique accuracy bound (Theorem 3 of Wang & Kleinberg 2024)
- ad hoc to paper The heuristic Algorithm 1 recovers all true higher-order structures that matter for expressiveness
Cite this review
Pith. "Pith review of Higher-order Structure Boosts Link Prediction on Temporal Graphs." pith.science (2026). https://pith.science/paper/53TNOXFH
@misc{pith2026250515746,
author = {Pith},
title = {Pith review of: Higher-order Structure Boosts Link Prediction on Temporal Graphs},
year = {2026},
howpublished = {\url{https://pith.science/paper/53TNOXFH}},
note = {Machine review of arXiv:2505.15746}
}
read the original abstract
Temporal Graph Neural Networks (TGNNs) have gained growing attention for modeling and predicting structures in temporal graphs. However, existing TGNNs primarily focus on pairwise interactions while overlooking higher-order structures that are integral to link formation and evolution in real-world temporal graphs. Meanwhile, these models often suffer from efficiency bottlenecks, further limiting their expressive power. To tackle these challenges, we propose a Higher-order structure Temporal Graph Neural Network, which incorporates hypergraph representations into temporal graph learning. In particular, we develop an algorithm to identify the underlying higher-order structures, enhancing the model's ability to capture the group interactions. Furthermore, by aggregating multiple edge features into hyperedge representations, HTGN effectively reduces memory cost during training. We theoretically demonstrate the enhanced expressiveness of our approach and validate its effectiveness and efficiency through extensive experiments on various real-world temporal graphs. Experimental results show that HTGN achieves superior performance on dynamic link prediction while reducing memory costs by up to 50\% compared to existing methods.
Figures
Figures from the paper (4 more)
Forward citations
Cited by 1 Pith paper
-
Homophily Enhanced Graph Domain Adaptation
Graph domain adaptation fails more when source and target graphs have different local homophily profiles, and the proposed HGDA filters and aligns homophily, heterophily, and attribute signals to improve cross-graph n...
Reference graph
Works this paper leans on
-
[1]
Theorem 3 (Theorem 3 in (Wang & Kleinberg, 2024))
For every hyperedge E ∈ E, there does not exist a hyperedge E′ ∈ Esuch that E ⊂ E′. Theorem 3 (Theorem 3 in (Wang & Kleinberg, 2024)). Let H = (V, E) be a hypergraph that only satisfies Condition 1 in Theorem 1 with m = |E|. Denote by Acc(H) the accuracy of the maximal clique algorithm for reconstructing H. Then, min H p(H) ≤ 2−(⌈m/2⌉−1) ≪ 2−m. (14) Now w...
work page 2024
-
[2]
Case 2: e ⊆ Ca ∪ Cb. Nodes in e are divided between communities Ca and Cb, with ka nodes in Ca and kb nodes in Cb (ka + kb = k). The connection probability between nodes in Ca and Cb is Λt[a, b], and there are ka · kb such pairs. Therefore: Pr(e is fully connected | e ⊆ Ca ∪ Cb) = Y i∈Ca,j∈Cb Λt[a, b] = (Λt[a, b])ka·kb . This completes the proof. Next, we...
work page 2015
-
[5]
The colors represent node features
Two temporal graphs which HTGN can distinguish but MP-TGN can not. The colors represent node features. For MP-TGN, the embeddings of the corresponding nodes in the two figures are always the same (Souza et al., 2022). Hence, MP-TGN can not distinguish these two temporal graphs. However, from the perspective of higher-order structures, there are two hypere...
work page 2022
-
[8]
Wang, Y . and Kleinberg, J. From graphs to hypergraphs: Hypergraph projection and its remediation.arXiv preprint arXiv:2401.08519,
-
[10]
How powerful are graph neural networks? arXiv preprint arXiv:1810.00826,
Xu, K., Hu, W., Leskovec, J., and Jegelka, S. How powerful are graph neural networks? arXiv preprint arXiv:1810.00826,
-
[11]
Zhang, X., Wang, Y ., Wang, X., and Zhang, M
URL https: //openreview.net/forum?id=xHNzWHbklj. Zhang, X., Wang, Y ., Wang, X., and Zhang, M. Efficient neural common neighbor for temporal graph link predic- tion. arXiv preprint arXiv:2406.07926,
-
[14]
2 · (1 − e−λt)2K (16) where we define the constant Const = EΛt∼P PK e=1 PK f =1 Q i∈Ce,j∈Cf Λ0[Ce, Cf ]. B. Proof of Theorem 2 First, we provide a definition of the expressive power of the temporal graph neural networks as Souza et al. (2022). For a single node n in a temporal graph at time t, its message-passing procedure can be described as a temporal c...
work page 2022
-
[1984]
A survey on temporal knowledge graph: Rep- resentation learning and applications
Cai, L., Mao, X., Zhou, Y ., Long, Z., Wu, C., and Lan, M. A survey on temporal knowledge graph: Rep- resentation learning and applications. arXiv preprint arXiv:2403.04782,
Show all 15 references
-
[2017]
Tcl: Transformer- based dynamic graph modelling via contrastive learning
Wang, L., Chang, X., Li, S., Chu, Y ., Li, H., Zhang, W., He, X., Song, L., Zhou, J., and Yang, H. Tcl: Transformer- based dynamic graph modelling via contrastive learning. arXiv preprint arXiv:2105.07944,
-
[2018]
Networks and cycles: a persistent homology approach to complex networks
Petri, G., Scolamiero, M., Donato, I., and Vaccarino, F. Networks and cycles: a persistent homology approach to complex networks. In Proceedings of the european conference on complex systems 2012, pp. 93–99. Springer, 2013a. Petri, G., Scolamiero, M., Donato, I., and Vaccarino...
2012
-
[2020]
9 Higher-order Structure Boosts Link Prediction on Temporal Graphs Shirzadkhani, R., Ngo, T. G. B., Shamsi, K., Huang, S., Poursafaei, F., Azad, P., Rabbany, R., Coskunuzer, B., Rabusseau, G., and Akcora, C. G. Towards neural scaling laws for foundation models on temporal grap...
-
[2021]
Neural common neigh- bor with completion for link prediction
Wang, X., Yang, H., and Zhang, M. Neural common neigh- bor with completion for link prediction. arXiv preprint arXiv:2302.00890,
-
[2022]
Xu, D., Ruan, C., Korpeoglu, E., Kumar, S., and Achan, K
URL https:// arxiv.org/abs/2101.05974. Xu, D., Ruan, C., Korpeoglu, E., Kumar, S., and Achan, K. Inductive representation learning on temporal graphs,
-
[2023]
Kingma, D. P. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980,
-
[2024]
Learn- ing phrase representations using rnn encoder-decoder for statistical machine translation
Cho, K., Van Merri ¨enboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y . Learn- ing phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078,
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.