REVIEW 4 major objections 5 minor 43 references
Dual-Center Graph Clustering with Neighbor Distribution
T0 review · 4 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read The paper proposes Dual-Center Graph Clustering (DCGC), claiming that neighbor distributions—computed from a node's neighbors' cluster pseudo-labels—are a reliable supervision signal that consistently outperforms state-of-the-art…
desk verdict A genuinely new dual-center idea, but the core loss has a sign error that inverts the neighbor-distribution alignment and the baselines are unreliable; reject as written, worth revising. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the neighbor distribution vector $e_i = \frac{1}{|N_i|} \sum_{j \in N_i} y_j$, where $y_j$ is the one-hot K-means pseudo-label of neighbor $j$. It enters twice: in the contrastive weight $M(i,j) = |K_{ij} - \mathrm{Norm}(S(z_i,z_j))|$, which compares neighbor-distribution similarity with embedding similarity and up-weights pairs where they disagree, and as a second center $\pi_k$ obtained by averaging the $e_i$ of the cluster, which defines a soft assignment $F$ and a sharpened target $G$ alongside the feature-center assignment $Q$ and target $P$. The dual-center loss $L_d = \sum_i \sum_j (\lambda p_{ij}\log(p_{ij}/q_{ij}) + (1-\lambda)g_{ij}\log(g_{ij}/f_{ij}))$ forces the encoder to satisfy both centers, and the total objective $L = \beta L_c + (1-\beta)L_r + \gamma L_d$ couples representation learning with clustering.
What would settle it
Corrupt the K-means pseudo-labels on a heterophilic benchmark (for example, Wisconsin or Squirrel) by randomly flipping 30 percent of labels before computing neighbor distributions, then compare DCGC's accuracy against the same run with clean pseudo-labels; if accuracy drops by more than a few points, the claimed insensitivity to pseudo-label error fails.
Extended reading notes
Core claim
DCGC's central claim is that neighbor distribution, the average of the one-hot pseudo-labels of a node's neighbors, carries two useful properties for clustering: intra-class consistency (same-class nodes have similar neighbor distributions, even in heterophilic graphs) and reliability (neighbor distributions stay informative when individual pseudo-labels are wrong). The method converts these properties into a contrastive loss with a weight $M(i,j)=|K_{ij}-\mathrm{Norm}(S(z_i,z_j))|$ that up-weights pairs whose neighbor-distribution similarity disagrees with embedding similarity, and into a dual-center KL-divergence loss that aligns soft assignments with both a feature-center target $P$ and a neighbor-distribution-center target $G$. On ten benchmark graphs spanning homophilic, mixed, and heterophilic structure, the paper reports that DCGC consistently outperforms previous contrastive and goal-directed clustering methods across ACC, NMI, ARI, and F1, with the largest margins on heterophilic datasets.
Load-bearing premise
Everything rests on the claim that a neighbor distribution computed from the model's own K-means pseudo-labels stays reliable even when those pseudo-labels are wrong, so that it can safely supervise both hard-negative mining and the second clustering center.
Editorial extensions
If this is right
- If neighbor distributions are as reliable as the paper claims, contrastive graph clustering no longer needs to treat every negative pair equally; hard negatives can be identified without labels.
- The dual-center objective gives a principled way to inject structural information into the target distribution, so goal-directed clustering is not limited to the feature space.
- Heterophilic graphs, where feature-similar nodes often belong to different classes, stand to gain the most from neighbor-distribution supervision; the reported Wisconsin and Texas results are the largest gaps over baselines.
- Because the added cost over plain InfoNCE is only $O(BKd)$ time and $O(B^2)$ space, the same recipe can be attached to existing contrastive clustering pipelines without changing their memory footprint much.
Reading between the lines
- If neighbor distributions inherit mistakes from pseudo-labels, the same errors could reinforce themselves through the dual-center loss; a direct test is to measure how accuracy changes as pseudo-label noise is added during pre-training, something the paper does not report.
- The same neighbor-distribution signal could be used for unsupervised anomaly detection: nodes whose neighbor distribution strongly disagrees with their own feature-cluster assignment are natural boundary or outlier candidates.
- A learnable confidence threshold $\tau$ would let the method adapt to datasets with different homophily levels; the paper's fixed-threshold analysis already shows the optimal $\tau$ varies across datasets.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes Dual-Center Graph Clustering (DCGC), an unsupervised graph clustering method that combines an adaptive filterbank with two MLP encoders, a contrastive loss weighted by neighbor-distribution similarity for hard-negative mining, and a 'dual-center' KL-divergence loss that aligns soft feature assignments and neighbor-distribution assignments with sharpened target distributions. Experiments are reported on ten datasets with different homophily levels, and the paper claims consistent state-of-the-art performance, with the largest gains on heterophilic graphs.
Significance. If the mechanism worked as described, the idea of using neighbor distribution as a more reliable pseudo-label signal in graph clustering would be a useful contribution, especially for heterophilic graphs. The paper includes extensive ablation studies, multiple benchmark datasets, and visualizations, which indicate effort in validating components. However, the central loss equation as written with the reported hyperparameter implements the opposite of the stated objective, the baseline numbers are inconsistent with published results, and no code is provided. The empirical claims therefore cannot currently be relied upon.
major comments (4)
- [Section 3.4, Eq. (15), Section 4.5] With λ=10, the second term of L_d has coefficient (1−10)=−9, and because both p_ij/q_ij and g_ij/f_ij are KL divergences between probability vectors, minimizing the stated loss drives f_i away from g_i rather than aligning them. This contradicts the text in Section 3.4 ('encourage all samples to converge toward the neighbor distribution centers'). The same passage calls λ a learnable weight, while Section 4.5 fixes it to 10, so the formulation and the reported implementation are internally inconsistent. Since the alleged gains are attributed to dual-center optimization, this issue is load-bearing and must be resolved.
- [Table 2, CORA rows] The reported SDCN ACC is 35.60±2.83 and DFCN ACC is 36.33±0.49, which are far below the values reported in the original SDCN and DFCN papers (typically above 80 for CORA). Because the paper claims consistent outperformance against these baselines, the comparison is not meaningful unless the baseline reproduction is explained; no code or configuration is provided to verify the experimental setup.
- [Sections 1, 3.2, 3.4] The supervision signal is entirely self-generated: K-means on the model's own embeddings produces pseudo-labels, from which neighbor distributions e_i and centers π_k are computed, and then the model is optimized to match sharpened versions of those derived targets. The claimed reliability of neighbor distributions is supported only by the qualitative examples in Figure 1, not by a quantitative error-sensitivity analysis. This is a weak circularity issue for an unsupervised method, but it leaves the central assumption untested.
- [Algorithm 1 and Section 4.2] The algorithm computes feature centers and class neighbor distributions once (Step 9) and updates only the target distributions every T iterations (Step 13), yet Section 3.4 states that the neighbor distribution center is 'updated jointly with the network.' Additionally, the coefficient γ in Eq. (16) is never given and no sensitivity analysis for γ is reported, so the actual optimized objective is not fully specified. The missing code makes these ambiguities unresolvable.
minor comments (5)
- [Introduction, Contributions] The contribution bullet says 'Extensive experimental results on six datasets,' but Table 1 and the experiments cover ten datasets; this should be corrected.
- [Eq. (5)] The normalization notation for Z^{v2}_j is corrupted in the text; the formula should be clearly expressed as division by the norm.
- [Section 4.5] The paper states that DCGC is not sensitive to λ, but no experiment or figure for λ is shown; the claim needs supporting evidence if it is retained.
- [Figure 2] Figure 2 contains unresolved '??' placeholders and the caption has an incomplete 'Unshared Parameters' label; the figure should be cleaned up.
- [Section 4.7] The visualization analysis says dual-center optimization 'slightly increasing intra-cluster distance,' which seems to undercut the usual clustering goal; the authors should clarify what evidence Figure 3 provides and how this supports the method's superiority.
Circularity Check
Neighbor-distribution supervision is a closed self-training loop: the target G is, by Eq. (14), a deterministic sharpening of the model's own assignment F, so the dual-center branch injects no information beyond the model's outputs and the fixed adjacency; external ground-truth evaluation keeps the empirical claim only partially circular.
-
self definitional
[Section 3.2 (Eqs. 2–3) and Section 3.4 (Eqs. 13–15)]
"Here, we use the soft assignment qi as the label distribution, replacing the pseudo-label yi. This facilitates to derive the neighbor distribution ei of node i by Eq. (2), and the class neighbor distribution πk of cluster k by Eq. (3). Then, we compute a new set of soft assignments fij using neighbor distribution ... we introduce Eq. (14) to encourage all samples to converge toward the neighbor distribution centers ... the clustering loss compels the feature assignments Q and the neighbor distribution assignments F to align with the dual-target distributions."
By construction, the neighbor-distribution 'supervision' is a function of the model's own outputs: K-means on embeddings Z yields pseudo-labels Y; Eq. (2) gives neighbor distributions E as graph-smoothed Y; Eq. (3) gives centers π as class means of E; Eq. (13) gives assignments F from distances to π; and Eq. (14) defines the target G as a sharpening of F (g ∝ f², then normalized). Eq. (15) then trains the network to align F with its own sharpened image G, so the neighbor-distribution branch injects no information beyond Z and the fixed adjacency A. This is the pseudo-label self-training loop the paper itself criticizes ('pseudo-label as a supervision signal is unreliable'); the claimed reliability of the smoothed signal is asserted from Figure 1, not measured.
full rationale
Score 4: partial circularity. The neighbor-distribution center is not an external reference; its target G is, by Eq. (14), a deterministic sharpening of the model's own assignment F, and F is derived from pseudo-labels produced by K-means on the model's own embeddings (Eqs. 2–3, 13). Training the network to align F with G (Eq. 15) is therefore training the assignment toward a smoothed, sharpened version of itself — a DEC-style self-training loop that the paper frames as 'more reliable and robust clustering guidance' without external grounding. The central empirical claim (Tables 2–3) is nevertheless measured against ground-truth labels never used in training, so the reported superiority is not forced by construction; hence 4, not 6+. Self-citation is not load-bearing here: λ=10 is borrowed from [13] as a hyperparameter value, and no derivation rests on a result unique to the authors' prior work. Separate correctness flag (not circularity): Section 3.4 calls λ 'a learnable weight parameter' while Section 4.5 fixes λ=10; with λ=10, the second term of Eq. (15) has coefficient (1−λ)=−9, so minimizing Ld increases KL(g‖f), the opposite of the stated 'converge toward the neighbor distribution centers.' This internal inconsistency affects the described mechanism's validity but does not change the circularity assessment.
Assumptions & free parameters
free parameters (5)
- τ (confidence threshold) =
0.3 to 0.9 per dataset
- β (loss weight) =
0.2 or 0.3 per dataset
- γ (weight of Ld) =
not reported
- λ =
10
- t (filtering times) =
not reported
assumptions (6)
- domain assumption Neighbor distribution exhibits intra-class consistency and is insensitive to pseudo-label errors.
- domain assumption K-means on node embeddings yields meaningful pseudo-labels.
- standard math Student's t-distribution is an appropriate kernel for soft assignment.
- domain assumption Sharpening the target distribution (Eq. 12) improves cluster confidence.
- domain assumption Adaptive filterbank with learnable weights can handle both homophilic and heterophilic graphs.
- domain assumption Dual-target distributions provide complementary and reliable guidance.
invented entities (1)
-
Neighbor distribution center π_k
Cite this review
Pith. "Pith review of Dual-Center Graph Clustering with Neighbor Distribution." pith.science (2026). https://pith.science/paper/25YSLROG
@misc{pith2026250713765,
author = {Pith},
title = {Pith review of: Dual-Center Graph Clustering with Neighbor Distribution},
year = {2026},
howpublished = {\url{https://pith.science/paper/25YSLROG}},
note = {Machine review of arXiv:2507.13765}
}
read the original abstract
Graph clustering is crucial for unraveling intricate data structures, yet it presents significant challenges due to its unsupervised nature. Recently, goal-directed clustering techniques have yielded impressive results, with contrastive learning methods leveraging pseudo-label garnering considerable attention. Nonetheless, pseudo-label as a supervision signal is unreliable and existing goal-directed approaches utilize only features to construct a single-target distribution for single-center optimization, which lead to incomplete and less dependable guidance. In our work, we propose a novel Dual-Center Graph Clustering (DCGC) approach based on neighbor distribution properties, which includes representation learning with neighbor distribution and dual-center optimization. Specifically, we utilize neighbor distribution as a supervision signal to mine hard negative samples in contrastive learning, which is reliable and enhances the effectiveness of representation learning. Furthermore, neighbor distribution center is introduced alongside feature center to jointly construct a dual-target distribution for dual-center optimization. Extensive experiments and analysis demonstrate superior performance and effectiveness of our proposed method.
Figures
Figures from the paper (3 more)
Reference graph
Works this paper leans on
-
[1]
D. Bo, X. Wang, C. Shi, M. Zhu, E. Lu, and P. Cui. Structural deep clustering network. In Proceedings of the Web Conference, pages 1400– 1410, 2020
work page 2020
-
[2]
T. Chen, S. Kornblith, M. Norouzi, and G. E. Hinton. A simple frame- work for contrastive learning of visual representations. In Proceed- ings of the 37th International Conference on Machine Learning, volume 119, pages 1597–1607, 2020
work page 2020
-
[3]
G. Cui, J. Zhou, C. Yang, and Z. Liu. Adaptive graph encoder for at- tributed graph embedding. In Proceedings of the 26th International Conference on Knowledge Discovery and Data Mining, pages 976–985, 2020
work page 2020
-
[4]
Y . Dong, K. Ding, B. Jalaian, S. Ji, and J. Li. Adagnn: Graph neural networks with adaptive frequency response filter. In Proceedings of the 30th International Conference on Information and Knowledge Manage- ment, pages 392–401, 2021
work page 2021
-
[5]
T. Gao, X. Yao, and D. Chen. Simcse: Simple contrastive learning of sentence embeddings. arXiv preprint arXiv:2104.08821, 2021
arXiv 2021
-
[6]
K. Ghasedi Dizaji, A. Herandi, C. Deng, W. Cai, and H. Huang. Deep clustering via joint convolutional autoencoder embedding and relative entropy minimization. In Proceedings of the International Conference on Computer Vision, pages 5736–5745, 2017
work page 2017
-
[7]
L. Gong, S. Zhou, W. Tu, and X. Liu. Attributed graph clustering with dual redundancy reduction. In Proceedings of the 31st International Joint Conference on Artificial Intelligence, pages 3015–3021, 2022
work page 2022
-
[8]
A. Grover and J. Leskovec. node2vec: Scalable feature learning for net- works. In Proceedings of the 22nd International Conference on Knowl- edge Discovery and Data Mining, pages 855–864, 2016
work page 2016
Show all 43 references
-
[9]
J. A. Hartigan and M. A. Wong. Algorithm as 136: A k-means clustering algorithm. Journal of the Royal Statistical Society. Series C (Applied Statistics), 28(1):100–108, 1979
1979
-
[10]
T. N. Kipf and M. Welling. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907, 2016
2016 arXiv
-
[11]
T. N. Kipf and M. Welling. Variational graph auto-encoders. arXiv preprint arXiv:1611.07308, 2016
2016 arXiv
-
[12]
N. Lee, J. Lee, and C. Park. Augmentation-free self-supervised learning on graphs. In Proceedings of the 34th AAAI Conference on Artificial Intelligence, volume 36, pages 7372–7380, 2022
2022
-
[13]
Y . Liu, W. Tu, S. Zhou, X. Liu, L. Song, X. Yang, and E. Zhu. Deep graph clustering via dual correlation reduction. In Proceedings of the 36th AAAI Conference on Artificial Intelligence , volume 36, pages 7603–7611, 2022
2022
-
[14]
Y . Liu, X. Yang, S. Zhou, X. Liu, Z. Wang, K. Liang, W. Tu, L. Li, J. Duan, and C. Chen. Hard sample aware network for contrastive deep graph clustering. In Proceedings of the 35th AAAI Conference on Arti- ficial Intelligence, volume 37, pages 8914–8922, 2023
2023
-
[15]
S. Luan, C. Hua, Q. Lu, J. Zhu, M. Zhao, S. Zhang, X. Chang, and D. Precup. Revisiting heterophily for graph neural networks. In Pro- ceedings of the 35th International Conference on Neural Information Processing Systems, volume 35, pages 1362–1375, 2022
2022
-
[16]
Y . Ma, X. Liu, T. Zhao, Y . Liu, J. Tang, and N. Shah. A unified view on graph neural networks as graph signal denoising. In Proceedings of the 30th International Conference on Information and Knowledge Management, pages 1202–1211, 2021
2021
-
[17]
A. v. d. Oord, Y . Li, and O. Vinyals. Representation learning with con- trastive predictive coding. arXiv preprint arXiv:1807.03748, 2018
2018 arXiv
-
[18]
S. Pan, R. Hu, G. Long, J. Jiang, L. Yao, and C. Zhang. Adversarially regularized graph autoencoder for graph embedding. arXiv preprint arXiv:1802.04407, 2018
2018 arXiv
-
[19]
S. Pan, R. Hu, S.-f. Fung, G. Long, J. Jiang, and C. Zhang. Learning graph embedding with adversarial training methods. IEEE transactions on cybernetics, 50(6):2475–2487, 2019
2019
-
[20]
H. Pei, B. Wei, K. C.-C. Chang, Y . Lei, and B. Yang. Geom-gcn: Geo- metric graph convolutional networks.arXiv preprint arXiv:2002.05287, 2020
2002 arXiv
-
[21]
Perozzi, R
B. Perozzi, R. Al-Rfou, and S. Skiena. Deepwalk: Online learning of social representations. In Proceedings of the 20th International Confer- ence on Knowledge Discovery and Data Mining, pages 701–710, 2014
2014
-
[22]
L. F. R. Ribeiro, P. H. P. Saverese, and D. R. Figueiredo. struc2vec: Learning node representations from structural identity. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Dis- covery and Data Mining, pages 385–394, 2017
2017
-
[23]
Rozemberczki, C
B. Rozemberczki, C. Allen, and R. Sarkar. Multi-scale attributed node embedding. Journal of Complex Networks, 9(2):cnab014, 2021
2021
-
[24]
P. Sen, G. Namata, M. Bilgic, L. Getoor, B. Galligher, and T. Eliassi- Rad. Collective classification in network data. AI magazine, 29(3): 93–93, 2008
2008
-
[25]
Shchur, M
O. Shchur, M. Mumme, A. Bojchevski, and S. Günnemann. Pitfalls of graph neural network evaluation. In NeurIPS Workshop, 2018
2018
-
[26]
X. Shen, D. Sun, S. Pan, X. Zhou, and L. T. Yang. Neighbor con- trastive learning on learnable graph augmentation. In Proceedings of the AAAI conference on artificial intelligence, volume 37, pages 9782– 9791, 2023
2023
-
[27]
F. Tian, B. Gao, Q. Cui, E. Chen, and T.-Y . Liu. Learning deep repre- sentations for graph clustering. In Proceedings of the 28th AAAI Con- ference on Artificial Intelligence, volume 28, pages 101–105, 2014
2014
-
[28]
W. Tu, S. Zhou, X. Liu, X. Guo, Z. Cai, E. Zhu, and J. Cheng. Deep fusion clustering network. In Proceedings of the 33rd AAAI Conference on Artificial Intelligence, volume 35, pages 9978–9987, 2021
2021
-
[29]
Van der Maaten and G
L. Van der Maaten and G. Hinton. Visualizing data using t-sne. Journal of Machine Learning Research, 9(11), 2008
2008
-
[30]
Velickovic, W
P. Velickovic, W. Fedus, W. L. Hamilton, P. Liò, Y . Bengio, and R. D. Hjelm. Deep graph infomax. In Proceedings of the 7th International Conference on Learning Representations, 2019
2019
-
[31]
C. Wang, S. Pan, R. Hu, G. Long, J. Jiang, and C. Zhang. Attributed graph clustering: A deep attentional embedding approach. arXiv preprint arXiv:1906.06532, 2019
1906 arXiv
-
[32]
L. Wu, H. Lin, Z. Gao, C. Tan, S. Li, et al. Graphmixup: Improving class-imbalanced node classification on graphs by self-supervised con- text prediction. arXiv preprint arXiv:2106.11133, 2021
2021 arXiv
-
[33]
J. Xia, L. Wu, G. Wang, J. Chen, and S. Z. Li. Progcl: Rethinking hard negative mining in graph contrastive learning. arXiv preprint arXiv:2110.02027, 2021
2021 arXiv
-
[34]
J. Xie, R. Girshick, and A. Farhadi. Unsupervised deep embedding for clustering analysis. In Proceedings of the 33nd International Confer- ence on Machine Learning, pages 478–487, 2016
2016
-
[35]
L. Yang, M. Li, L. Liu, B. Niu, C. Wang, X. Cao, and Y . Guo. Di- verse message passing for attribute with heterophily. In Proceedings of the 35th International Conference on Neural Information Processing Systems, pages 4751–4763, 2021
2021
-
[36]
X. Yang, Y . Wang, Y . Liu, Y . Wen, L. Meng, S. Zhou, X. Liu, and E. Zhu. Mixed graph contrastive network for semi-supervised node classification. ACM Transactions on Knowledge Discovery from Data, 2022
2022
-
[37]
X. Yang, Y . Liu, S. Zhou, S. Wang, W. Tu, Q. Zheng, X. Liu, L. Fang, and E. Zhu. Cluster-guided contrastive graph clustering network. In Proceedings of the 35th AAAI Conference on Artificial Intelligence, vol- ume 37, pages 10834–10842, 2023
2023
-
[38]
X. Yang, E. Min, K. Liang, Y . Liu, S. Wang, S. Zhou, H. Wu, X. Liu, and E. Zhu. Graphlearner: Graph node clustering with fully learnable augmentation. In Proceedings of the 32nd ACM International Confer- ence on Multimedia, pages 5517–5526, 2024
2024
-
[39]
Y . You, T. Chen, Y . Sui, T. Chen, Z. Wang, and Y . Shen. Graph con- trastive learning with augmentations. In Proceedings of the 33rd Inter- national Conference on Neural Information Processing Systems , vol- ume 33, pages 5812–5823, 2020
2020
-
[40]
Zhang, L
J. Zhang, L. Li, S. Wang, J. Liu, Y . Liu, X. Liu, and E. Zhu. Multiple kernel clustering with dual noise minimization. In Proceedings of the 30th ACM International Conference on Multimedia, pages 3440–3450, 2022
2022
-
[41]
H. Zhao, X. Yang, Z. Wang, E. Yang, and C. Deng. Graph debiased con- trastive learning with joint representation clustering. In Proceedings of the 30th International Joint Conference on Artificial Intelligence, pages 3434–3440, 2021
2021
-
[42]
S. Zhou, X. Liu, M. Li, E. Zhu, L. Liu, C. Zhang, and J. Yin. Multiple kernel clustering with neighbor-kernel subspace segmentation. IEEE Transactions on Neural Networks and Learning Systems , 31(4):1351– 1362, 2020
2020
-
[43]
Y . Zhu, Y . Xu, F. Yu, Q. Liu, S. Wu, and L. Wang. Deep graph contrastive representation learning. arXiv preprint arXiv:2006.04131, 2020
2006 arXiv
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.