REVIEW 4 major objections 4 minor 32 references
HeRB: Heterophily-Resolved Structure Balancer for Graph Neural Networks
T0 review · 4 major / 4 minor · reviewed 2026-08-16 · deepseek-v4-flash
Pith's one-line read Structural-imbalance GNNs fail on heterophilic graphs because they ignore heterophily; HeRB first rewires edges by feature similarity, then transfers homophilic head-node knowledge to tail nodes, and reports superior results on eight…
desk verdict A sensible two-module idea that is not yet a paper: the central update equation is undefined, one theory subsection is a literal placeholder, and no code or appendix backs the empirical claims. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central machinery is the 'rectify first, then transfer' pipeline carried by two interacting objects. The heterophily-lessening augmenter computes normalized structure and feature similarity matrices $S_{\mathrm{str}}$ and $S_{\mathrm{fea}}$, adds edges satisfying $S_{\mathrm{fea}}(v_i,v_j) \geq \theta_{\mathrm{ete}}$, removes edges satisfying $S_{\mathrm{fea}}(v_i,v_j) \leq \theta_{\mathrm{homo}}$, and forms the intermediary adjacency $A'' = (A + A')/2$. The homophilic knowledge-transfer module then expands each tail node's neighborhood to second-order and homophilic head nodes via $\tilde{A} = \beta A'' + (1-\beta) A_{\mathrm{sim}}$, and learns a translation vector $r_{v_i}$ such that $z_{v_i} + r_{v_i} \approx z_{N^*_{v_i}}$, which is injected into message passing for tail nodes. Together they turn a heterophilic, degree-imbalanced graph into an approximately homophilic graph in which tail nodes receive knowledge borrowed from well-connected head nodes.
What would settle it
On any heterophilic benchmark with ground-truth labels, compute the edge homophily ratio $h(G)$ before and after the augmentation module using the paper's thresholds; if the augmented adjacency matrix $A'$ does not satisfy $h(A') > h(G)$, the module is not actually lessening heterophily and any accuracy gain must come from another mechanism. A sharper version rewires with true labels instead of feature similarity: if the oracle-rewired model clearly outperforms HeRB, the feature-similarity proxy is the limiting assumption.
Extended reading notes
Core claim
On the paper's own terms, the central discovery is that the poor performance of structural-imbalance remedies on heterophilic graphs is caused by transferring or aggregating heterophilic neighborhood information, and that correcting heterophily before balancing degrees fixes tail-node learning. Concretely, HeRB uses pretrained structure and feature encoders to compute similarity scores, adds edges between structurally close and feature-similar nodes, removes edges between structurally distant and feature-dissimilar nodes, and averages the result with the original adjacency to form an intermediary graph. For tail nodes, the model expands the neighborhood to second-order and homophilic head nodes and learns a translation vector $r_{v_i}$ with $z_{v_i} + r_{v_i} \approx z_{N^*_{v_i}}$, which is applied in message passing. The paper reports an average improvement of 4.1% in Macro-F1 and 3.0% in Micro-F1 over the best baselines on eight datasets, with the largest relative gains on strongly heterophilic graphs such as Cornell.
Load-bearing premise
The load-bearing premise is that feature similarity is a trustworthy proxy for label homophily: the augmenter adds edges only between feature-similar nodes and removes edges only between feature-dissimilar nodes, and the transfer step selects head nodes by the same similarity; on heterophilic graphs, same-class nodes can have dissimilar features, so the rewired graph can still contain inter-class edges and lose useful intra-class ones.
Editorial extensions
If this is right
- Structure-imbalance methods for heterophilic graphs should adopt a heterophily-rectification step before augmentation or knowledge transfer, rather than treating the observed topology as reliable.
- Tail nodes can be improved without additional labels by reusing homophilic neighborhood structure from head nodes through a learnable translation residual.
- Feature-similarity-gated edge rewiring is a viable way to raise the homophily ratio of a graph before standard message passing.
- The reported complexity of $\mathcal{O}(Nfd)$ for sparse graphs means the two-module pipeline can be applied as a preprocessing layer on large graphs, not only on small benchmarks.
- The ablation pattern implies that naive augmentation can hurt even homophilic graphs by injecting heterophilic noise, so edge rewiring should be similarity-conditioned.
Reading between the lines
- A direct test of the proxy assumption: replace the feature-similarity thresholds with true-label-based rewiring on the same benchmarks; the performance gap would quantify how much of HeRB's gain depends on $S_{\mathrm{fea}}$ being a faithful homophily signal.
- The translation-relationship formulation (node embedding plus a residual approximates the neighborhood embedding) is not specific to degree imbalance; the same mechanism could be applied to cold-start nodes, missing-neighbor graphs, or the inductive settings the paper names as future work.
- The manuscript leaves Section IV.D.2 as a placeholder reading 'Balabala.', so the formal theoretical support for the augmenter currently rests only on the Shannon-entropy sketch in IV.D.1; a complete derivation would be needed to fully ground the over-smoothing story.
- Because optimal thresholds $\theta_{\mathrm{ete}}$ and $\theta_{\mathrm{homo}}$ vary by dataset, one practical extension is to estimate them automatically from the graph's observed homophily ratio rather than tuning them per dataset.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes HeRB, a framework for node classification on graphs with degree imbalance and heterophily. It consists of two modules: a heterophily-lessening augmentation module that adds intra-class edges and removes inter-class edges based on structural and feature similarity, and a homophilic knowledge transfer mechanism that transfers neighborhood information from head nodes to tail nodes during message passing. The authors evaluate HeRB on two homophilic and six heterophilic benchmark datasets using GCN as a backbone, reporting improvements over several baselines, and provide ablation studies and sensitivity analyses.
Significance. If the proposed mechanism were correctly specified and theoretically supported, the paper would address a relevant and timely problem: the interaction between structural imbalance and heterophily in GNNs. The experimental results, if reproducible, suggest that the approach can yield substantial gains on heterophilic datasets. However, the paper has significant gaps in the formal presentation: the key tail-node update equation is not a valid algebraic identity, the theoretical analysis section contains a literal placeholder, and an appendix referenced for the augmenter's analysis is absent. These issues undermine the central claim because the homophilic knowledge transfer mechanism is not well-defined as written. The paper also ships no code or proofs, so the empirical results cannot be independently verified against the described method.
major comments (4)
- [§IV.C.1, Eq. (14)] The tail-node update rule is not a valid algebraic identity under the aggregation convention established in Eq. (13). Eq. (13) defines g(l)(A''Z_vi^(l)) = phi_g(A''Z_vi^(l)W), interpreting A''Z_vi as adjacency-weighted neighborhood aggregation. Eq. (14) claims that g(l)(\tilde A Z_vi^(l)) equals phi_g(\tilde A (Z_vi^(l) + Z_N*vi^(l) - Z_Nvi^(l)) W). This equality only holds if \tilde A (Z_N*vi^(l) - Z_Nvi^(l)) = 0 for every tail node, which is neither assumed nor enforced, and is generally false because Z_N* and Z_N are pooled embeddings of different neighbor sets. Consequently, the described propagation step for tail nodes is not a well-defined GNN update, and the results in Table II cannot be attributed to the proposed transfer mechanism as written.
- [§IV.D.2 and §IV.A.3] The theoretical analysis of the knowledge transfer mechanism is missing: Section IV.D.2 is literally the placeholder '•: Balabala.' In addition, Section IV.A.3 states that 'We provide a theoretical analysis of how the augmenter addresses the heterophily problem in Appendix C,' but the manuscript contains no Appendix C. These are not presentation issues; they are missing portions of the paper's central support and must be supplied before the claims can be evaluated.
- [§IV.D.1, Eq. (20)] The entropy argument for the augmenter is not rigorous. The quantities pi, ti, and ni are not properly defined, and the claimed expression E(H(\tilde G)) = -δ log δ + (1-δ) Σ_i -pi log((1-δ)pi) is not derived from the edge-perturbation process described in Section IV.A.3. Even if the entropy inequality were correct, the argument does not connect the feature-similarity-based edge selection to any bound on the number or proportion of inter-class edges. Thus, the augmenter's guarantee that heterophily is lessened is unproven.
- [§IV.A.3] The augmenter relies on the assumption that feature similarity S_fea is a trustworthy proxy for label homophily, adding edges only when S_fea(vi,vj) ≥ Thete and removing edges when S_fea(vi,vj) ≤ Thomo. In heterophilic graphs, nodes of the same class can have dissimilar features, and nodes of different classes can have similar features, so the rewiring may not achieve the intended reduction of inter-class edges. The paper provides no empirical or theoretical analysis of the label-homophily rate of the augmented graph, leaving a key premise of the method unvalidated.
minor comments (4)
- [Throughout] There are several typos: 'neighobors' in the Introduction, 'heteroohilic' in the caption of Table II, 'Cornrll' in the axis labels of Figure 5, and inconsistent spellings such as 'Mirco-F1' in figures versus 'Micro-F1' in tables.
- [§III.B, Eq. (1)] The notation in Eq. (1)-(3) is confusing: Thead is introduced as 'degree80%', but is then used as a threshold in Eq. (2) and (3). It would be clearer to define a scalar threshold T_head separately from the head-node set.
- [§IV.D.2] The placeholder subsection heading '•: Balabala.' should be removed or replaced with actual content before any resubmission.
- [References] The paper cites GRACE [15] as a structural-imbalance method, but the reference appears to be a graph contrastive learning method; please verify the citation and clarify the relationship.
Circularity Check
No circularity: HeRB's contributions are architectural and empirically validated, not derived by construction from fitted inputs or author self-citations.
full rationale
The paper's central claims are architectural and empirical: HeRB augments the adjacency matrix using structural and feature similarities, then transfers neighborhood translation knowledge from head nodes to tail nodes. No step in the derivation reduces a predicted quantity to a fitted input. The augmentation module uses thresholds on feature similarity, but these are hyperparameters, and the reported gains are measured against external baselines on standard datasets, not asserted from the thresholds themselves. The homophilic knowledge transfer is a concrete update rule (Eqs. 13 and 14) plus a head-node regularization loss (Eq. 15); it is not obtained by fitting tail-node labels and then reporting them as predictions. The self-citations to SiGAug [16] and SAug [17] appear only in related work or as baselines and are not load-bearing; the localizing strategy used in Eq. 12 is attributed to external work Tail-GNN [5], and no uniqueness theorem is imported from the authors' prior papers. The placeholder 'Balabala' in Section IV.D.2 and the missing Appendix C are completeness and correctness defects, not circular reductions; the entropy argument, even if unconvincing, does not make a claim equal to its input. Hyperparameter tuning via random search is standard model selection and is not disguised as a prediction. Overall, no step of the derivation is equivalent by construction to its inputs, so the circularity score is 0.
Assumptions & free parameters
free parameters (10)
- degree_percentile_threshold =
80th percentile
- Thete =
tuned per dataset, not fixed
- Thomo =
tuned per dataset, not fixed
- add% =
not reported
- remove% =
not reported
- alpha =
tuned per dataset
- beta =
tuned per dataset
- k =
tuned per dataset
- mu =
tuned per dataset
- lambda =
0.005
assumptions (4)
- domain assumption Nodes with similar feature vectors are likely to have the same label.
- domain assumption Head nodes have sufficient and homophilic neighborhoods after augmentation.
- domain assumption The approximate translation relation z_v + r_v is approximately z_N_v holds after augmentation.
- ad hoc to paper The augmented-graph entropy formula in Eq. (20) correctly measures message diversity.
Cite this review
Pith. "Pith review of HeRB: Heterophily-Resolved Structure Balancer for Graph Neural Networks." pith.science (2026). https://pith.science/paper/RWFHKD3C
@misc{pith2026250417276,
author = {Pith},
title = {Pith review of: HeRB: Heterophily-Resolved Structure Balancer for Graph Neural Networks},
year = {2026},
howpublished = {\url{https://pith.science/paper/RWFHKD3C}},
note = {Machine review of arXiv:2504.17276}
}
read the original abstract
Recent research has witnessed the remarkable progress of Graph Neural Networks (GNNs) in the realm of graph data representation. However, GNNs still encounter the challenge of structural imbalance. Prior solutions to this problem did not take graph heterophily into account, namely that connected nodes process distinct labels or features, thus resulting in a deficiency in effectiveness. Upon verifying the impact of heterophily on solving the structural imbalance problem, we propose to rectify the heterophily first and then transfer homophilic knowledge. To the end, we devise a method named HeRB (Heterophily-Resolved Structure Balancer) for GNNs. HeRB consists of two innovative components: 1) A heterophily-lessening augmentation module which serves to reduce inter-class edges and increase intra-class edges; 2) A homophilic knowledge transfer mechanism to convey homophilic information from head nodes to tail nodes. Experimental results demonstrate that HeRB achieves superior performance on two homophilic and six heterophilic benchmark datasets, and the ablation studies further validate the efficacy of two proposed components.
Figures
Reference graph
Works this paper leans on
-
[1]
Inductive representation learning on large graphs,
W. Hamilton, Z. Ying, and J. Leskovec, “Inductive representation learning on large graphs,” in Advances in Neural Information Processing Systems, vol. 30. Curran Associates, Inc., 2017
work page 2017
-
[2]
Semi-supervised classification with graph convolutional networks,
T. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” ArXiv, vol. abs/1609.02907, 2016
arXiv 2016
-
[3]
Graph attention networks,
P. Velickovic, G. Cucurull, A. Casanova, A. Romero, P. Lio, Y . Bengio et al., “Graph attention networks,” stat, vol. 1050, no. 20, pp. 10–48 550, 2017
2017
-
[4]
Towards locality-aware meta-learning of tail node embeddings on networks,
Z. Liu, W. Zhang, Y . Fang, X. Zhang, and S. C. Hoi, “Towards locality-aware meta-learning of tail node embeddings on networks,” in Proceedings of the 29th ACM International Conference on Information & Knowledge Management , 2020, pp. 975–984
work page 2020
-
[5]
Tail-gnn: Tail-node graph neural networks,
Z. Liu, T.-K. Nguyen, and Y . Fang, “Tail-gnn: Tail-node graph neural networks,” in Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining , 2021, pp. 1109–1119
2021
-
[6]
Blade: Biased neighborhood sampling based graph neural network for directed graphs,
S. Virinchi and A. Saladi, “Blade: Biased neighborhood sampling based graph neural network for directed graphs,” in Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining, 2023, pp. 42–50
work page 2023
-
[7]
Sailor: Structural augmentation based tail node representation learning,
J. Liao, J. Li, L. Chen, B. Wu, Y . Bian, and Z. Zheng, “Sailor: Structural augmentation based tail node representation learning,” in Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, 2023, pp. 1389–1399
work page 2023
-
[8]
Representation learning for scale-free networks,
R. Feng, Y . Yang, W. Hu, F. Wu, and Y . Zhang, “Representation learning for scale-free networks,” in Proceedings of the AAAI conference on artificial intelligence, vol. 32, no. 1, 2018
work page 2018
Show all 32 references
-
[9]
Cengcn: Centralized convolutional networks with vertex imbalance for scale-free graphs,
F. Xia, L. Wang, T. Tang, X. Chen, X. Kong, G. Oatley, and I. King, “Cengcn: Centralized convolutional networks with vertex imbalance for scale-free graphs,” IEEE Transactions on Knowledge and Data Engineering, vol. 35, no. 5, pp. 4555–4569, 2022
2022
-
[10]
Is homophily a necessity for graph neural networks?
Y . Ma, X. Liu, N. Shah, and J. Tang, “Is homophily a necessity for graph neural networks?” arXiv preprint arXiv:2106.06134 , 2021
2021 arXiv
-
[11]
Two sides of the same coin: Heterophily and oversmoothing in graph convolutional neural networks,
Y . Yan, M. Hashemi, K. Swersky, Y . Yang, and D. Koutra, “Two sides of the same coin: Heterophily and oversmoothing in graph convolutional neural networks,” in 2022 IEEE International Conference on Data Mining (ICDM). IEEE, 2022, pp. 1287–1292
2022
-
[12]
Net: Degree-specific graph neural networks for node and graph classification,
J. Wu, J. He, and J. Xu, “Net: Degree-specific graph neural networks for node and graph classification,” in Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining , 2019, pp. 406–415
2019
-
[13]
Investigating and mitigating degree-related biases in graph convoltuional networks,
X. Tang, H. Yao, Y . Sun, Y . Wang, J. Tang, C. Aggarwal, P. Mitra, and S. Wang, “Investigating and mitigating degree-related biases in graph convoltuional networks,” in Proceedings of the 29th ACM International Conference on Information & Knowledge Management, 2020, pp. 1435– 1444
2020
-
[14]
Cold brew: Distilling graph node representations with incomplete or missing neighborhoods,
W. Zheng, E. W. Huang, N. Rao, S. Katariya, Z. Wang, and K. Subbian, “Cold brew: Distilling graph node representations with incomplete or missing neighborhoods,” arXiv preprint arXiv:2111.04840 , 2021
2021 arXiv
-
[15]
Grace: Graph self-distillation and completion to mitigate degree-related biases,
H. Xu, L. Xiang, F. Huang, Y . Weng, R. Xu, X. Wang, and C. Zhou, “Grace: Graph self-distillation and completion to mitigate degree-related biases,” in Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining , 2023, pp. 2813–2824
2023
-
[16]
Balancing augmentation with edge utility filter for signed graph neural networks,
K.-J. Chen, J. Yaming, W. Mu, and Y . Qu, “Balancing augmentation with edge utility filter for signed graph neural networks,” IEEE Transactions on Network Science and Engineering , 2024
2024
-
[17]
Saug: Structural JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021 10 imbalance aware augmentation for graph neural networks,
K.-j. Chen, W. Mu, Z. Liu, and Z. Liu, “Saug: Structural JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021 10 imbalance aware augmentation for graph neural networks,” ACM Trans. Intell. Syst. Technol. , Jan. 2025, just Accepted. [Online]. Available: https://doi.org/10....
2021 doi
-
[18]
Beyond low-frequency infor- mation in graph convolutional networks,
D. Bo, X. Wang, C. Shi, and H. Shen, “Beyond low-frequency infor- mation in graph convolutional networks,” in Proceedings of the AAAI conference on artificial intelligence, vol. 35, no. 5, 2021, pp. 3950–3957
2021
-
[19]
Adagnn: Graph neural networks with adaptive frequency response filter,
Y . Dong, K. Ding, B. Jalaian, S. Ji, and J. Li, “Adagnn: Graph neural networks with adaptive frequency response filter,” in Proceedings of the 30th ACM international conference on information & knowledge management, 2021, pp. 392–401
2021
-
[20]
Pc-conv: Unifying homophily and het- erophily with two-fold filtering,
B. Li, E. Pan, and Z. Kang, “Pc-conv: Unifying homophily and het- erophily with two-fold filtering,” in Proceedings of the AAAI Conference on Artificial Intelligence , vol. 38, no. 12, 2024, pp. 13 437–13 445
2024
-
[21]
Beyond homophily in graph neural networks: Current limitations and effective designs,
J. Zhu, Y . Yan, L. Zhao, M. Heimann, L. Akoglu, and D. Koutra, “Beyond homophily in graph neural networks: Current limitations and effective designs,” Advances in neural information processing systems , vol. 33, pp. 7793–7804, 2020
2020
-
[22]
Adaptive universal general- ized pagerank graph neural network,
E. Chien, J. Peng, P. Li, and O. Milenkovic, “Adaptive universal general- ized pagerank graph neural network,” arXiv preprint arXiv:2006.07988, 2020
2006 arXiv
-
[23]
Beyond smooth- ing: Unsupervised graph representation learning with edge heterophily discriminating,
Y . Liu, Y . Zheng, D. Zhang, V . C. Lee, and S. Pan, “Beyond smooth- ing: Unsupervised graph representation learning with edge heterophily discriminating,” in Proceedings of the AAAI conference on artificial intelligence, vol. 37, no. 4, 2023, pp. 4516–4524
2023
-
[24]
On the bias of traceroute sampling: or, power-law degree distributions in regular graphs,
D. Achlioptas, A. Clauset, D. Kempe, and C. Moore, “On the bias of traceroute sampling: or, power-law degree distributions in regular graphs,” Journal of the ACM (JACM) , vol. 56, no. 4, pp. 1–28, 2009
2009
-
[25]
The pareto principle: its use and abuse,
R. Sanders, “The pareto principle: its use and abuse,” Journal of Services Marketing, vol. 1, no. 2, pp. 37–40, 1987
1987
-
[26]
Deeper insights into graph convolutional networks for semi-supervised learning,
Q. Li, Z. Han, and X.-M. Wu, “Deeper insights into graph convolutional networks for semi-supervised learning,” in Proceedings of the AAAI conference on artificial intelligence , vol. 32, no. 1, 2018
2018
-
[27]
On proximity and structural role-based embeddings in networks: Misconceptions, techniques, and applications,
R. A. Rossi, D. Jin, S. Kim, N. K. Ahmed, D. Koutra, and J. B. Lee, “On proximity and structural role-based embeddings in networks: Misconceptions, techniques, and applications,” ACM Transactions on Knowledge Discovery from Data (TKDD) , vol. 14, no. 5, pp. 1–37, 2020
2020
-
[28]
Simple and deep graph convolutional networks,
M. Chen, Z. Wei, Z. Huang, B. Ding, and Y . Li, “Simple and deep graph convolutional networks,” in International conference on machine learning. PMLR, 2020, pp. 1725–1735
2020
-
[29]
A mathematical theory of communication,
C. E. Shannon, “A mathematical theory of communication,” The Bell system technical journal , vol. 27, no. 3, pp. 379–423, 1948
1948
-
[30]
Revisiting semi-supervised learning with graph embeddings,
Z. Yang, W. Cohen, and R. Salakhudinov, “Revisiting semi-supervised learning with graph embeddings,” in International conference on ma- chine learning. PMLR, 2016, pp. 40–48
2016
-
[31]
Geom-gcn: Geo- metric graph convolutional networks,
H. Pei, B. Wei, K. C.-C. Chang, Y . Lei, and B. Yang, “Geom-gcn: Geo- metric graph convolutional networks,” arXiv preprint arXiv:2002.05287, 2020
2002 arXiv
-
[32]
Multilayer perceptron (mlp),
H. Taud and J.-F. Mas, “Multilayer perceptron (mlp),” Geomatic ap- proaches for modeling land change scenarios , pp. 451–455, 2018
2018
Reviewed August 16, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.