REVIEW 4 major objections 5 minor 37 references
Functional connectomes of neural networks
T0 review · 4 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read This paper claims that a neural network's functional connectome—the correlation graph of hidden-neuron activations—carries topological signatures that distinguish how the network was regularized and which input class it is processing.
desk verdict A scalable topological summary for neural-network functional connectomes with a real runtime win, but the empirical validation leans on clustering purity without significance tests or a raw-activation control. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
Persistent graph homology, a threshold-free topological summary that records births of connected components and deaths of cycles as an edge-weight threshold rises; for a complete weighted graph it reduces to the sorted maximum-spanning-tree edge weights (births) and the sorted non-MST edge weights (deaths). The paper's mechanism is the closed-form Wasserstein distance on these sorted vectors, $W_{p,B}(G^{(1)},G^{(2)})=\lVert\mathbf{b}_{G^{(1)}}-\mathbf{b}_{G^{(2)}}\rVert_p$ and analogously for deaths, which makes the Wasserstein barycenter a coordinate-wise average and enables Lloyd-style centroid clustering in $O(n\log n)$ time.
What would settle it
Permute the class labels of the functional dataset across many trials and recompute Top's clustering purity; if purity stays well above chance, the class separation reflects input statistics rather than the claimed class-specific activation structure. Alternatively, run the same clustering on raw activation vectors; if they match Top's purity, no topological signal is needed.
Extended reading notes
Core claim
The central claim is that topological signals measured by persistent homology on neural-network functional connectomes characterize neural network function. A functional connectome is the complete graph on hidden neurons with edge weights given by the absolute Pearson correlation of their activation vectors over a functional dataset. Persistent graph homology tracks connected components and cycles across all correlation thresholds, and the paper presents closed-form Wasserstein distance, barycenter, variance, and gradient statistics for these summaries. Empirically, clustering these summaries separates regularization strategies (batch norm, dropout, L2, vanilla) with high purity and separates per-class connectomes at levels far above chance, with exact computation for thousands of nodes in about a second.
Load-bearing premise
The load-bearing premise is that unsupervised cluster purity against predefined classes is evidence that the topology captures meaningful functional mechanisms; if the clusters are separable by trivial activation statistics or by the particular functional dataset chosen, the interpretability claim does not follow.
Editorial extensions
If this is right
- Regularization strategy leaves a detectable topological fingerprint: clustering connectomes from batch norm, dropout, L2, and vanilla training separates the four strategies with high purity, and each pairwise comparison against vanilla reaches purity near 1.0 in most datasets.
- Different input classes are processed through distinct functional mechanisms: per-class functional connectomes cluster with purity 0.5–0.6 across ten classes, far above the 0.1 random baseline.
- Exact topology is computable at scale: Top computes exact Wasserstein distances for connectomes with thousands of nodes and millions of edges in roughly one second, while conventional persistent-homology baselines stall at a few hundred nodes.
- Closed-form Wasserstein statistics provide a gradient-based tool: because barycenter, variance, and distance gradients are analytic, the representation can plug into centroid clustering and, potentially, other gradient-optimized machine learning objectives.
- The method works beyond toy settings: it remains effective on the convolutional CIFAR-10 network by restricting analysis to the final fully-connected layers.
Reading between the lines
- Beyond the paper: the sorted birth and death vectors are a compressed, threshold-free fingerprint of a network's activation geometry; a natural test is whether these fingerprints track generalization, calibration, or adversarial robustness across training runs and seeds.
- Beyond the paper: because the Wasserstein barycenter and variance are closed-form, one could build topological analogues of PCA or regression on connectomes, or monitor how topology evolves during training, none of which the paper demonstrates.
- Beyond the paper: the purity-based validation does not rule out that simple activation statistics (e.g., mean or variance of activations) drive the clusters; a permutation test or a baseline on raw activation vectors would test whether topology adds signal beyond those statistics.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper proposes a framework for characterizing neural network function by constructing functional connectomes (absolute Pearson correlations between neuron activations) and summarizing their topology with persistent graph homology. The authors derive closed-form expressions for Wasserstein distances, barycenters, variances, and gradients of birth/death values, and use centroid-based clustering (Top) to group networks by regularization strategy (Study 1) and by input class (Study 2). Experiments on MNIST, Fashion-MNIST, and CIFAR-10 compare Top with six baselines and include a runtime study. The paper claims that topological signals effectively characterize neural network functions and that Top offers scalable exact computation.
Significance. If the central claim holds, the paper offers a threshold-free and scalable representation of network behavior, which would be a useful addition to interpretability tools. The strengths include a clean definition of functional connectomes, exact near-linear-time computation, no fitted parameters in the representation, public code, and a runtime comparison showing orders-of-magnitude speedup over conventional persistence diagram methods. However, the empirical validation does not yet establish that the topological decomposition itself, rather than low-order activation statistics or the clustering algorithm, is responsible for the reported separability; the paper also overstates the performance of Top relative to baselines. These issues are fixable with additional controls and corrected claims.
major comments (4)
- [Section 3, Cluster analysis and Study 2] The comparison of purity scores (0.46–0.57) as "significantly better than the 0.1 score expected if clustering was made randomly" is statistically invalid because k-means with K=10 always produces purity greater than 1/K on label-random data, and the reported values are not tested against a permutation null. The Potential Impact section advertises permutation tests, but none is performed. Please add permutation or label-shuffling tests and report p-values or null distributions for the purity scores.
- [Section 3, Tables 1 and 2] The statement "In most settings, the proposed Top method outperforms other baselines" is not supported by the tables. For example, in Table 2, Fashion-MNIST Vanilla SWK achieves 0.64 vs Top 0.53; Fashion-MNIST Batch Norm SWK 0.60 vs Top 0.49; MNIST Batch Norm WD 0.50 vs Top 0.46; and in Table 1, MNIST All SWK 0.85 vs Top 0.78 and CIFAR-10 All WD 0.98/SWK 0.96 vs Top 0.88. The paper should either provide a statistical comparison or reframe the contribution as scalability, not clustering accuracy.
- [Section 2 and Section 3, Cluster analysis] The clustering signal could be carried by trivial activation statistics or by the global distribution of pairwise correlations rather than by the topological birth/death decomposition, but no control on raw activation vectors is provided. The Adj baseline uses the same correlations and is much worse than Top, which is encouraging, but a k-means baseline on raw per-neuron activation vectors (or on the full correlation vector) is needed to support the claim that the "deeper understanding of underlying mechanisms" comes from topology. Please add such a control.
- [Section 3, Method comparison and Tables 1-2] Many cells in Tables 1 and 2 are reported without standard deviations (e.g., Table 1: WD 0.75, SWK 0.85; Table 2: several entries), and no significance tests are used to compare methods across the 20 trials. Since the tables are the primary evidence for the clustering claims, the missing uncertainty quantification makes it impossible to assess whether the observed differences are reliable.
minor comments (5)
- [Section 2, Persistence Statistics] The claim that the exact p-Wasserstein distance equals the Lp distance between sorted birth/death vectors is cited to prior work but not derived; a brief proof sketch or an explicit statement of the equal-cardinality and no-diagonal conditions would make the paper more self-contained.
- [Section 2, Eq. (5) and surrounding text] The notation W_p,B appears in text but the equation uses W_p,B(G(1),G(2)) with a semicolon in one place; unify the notation throughout.
- [Section 2, Functions of Neural Networks] The sentence "As is common in machine learning, since we know a computable formula..." is awkward and should be rewritten for clarity.
- [References] In the reference to Xiao et al., the author name is typeset as "V ollgraf"; this should be "Volgraf". Also, the in-text citation to "Songdechakraiwut et al. 2023" in the persistent graph homology paragraph should be cross-checked against the reference list to ensure the intended source is unambiguous.
- [Section 3, Figure 2] The figure caption says "Persistence diagrams and statistics for each strategy" but the figure itself is not included in the submitted text; ensure the figure is legible and the shaded regions are clearly labeled as Wasserstein standard deviation.
Circularity Check
No significant circularity: the framework is an unsupervised empirical application of an externally published topological statistic; no fitted parameter is relabeled as a prediction.
full rationale
The paper's derivation chain is not circular. The functional connectome is explicitly defined as an absolute Pearson-correlation matrix of neuron activation vectors (equations for rho_jk and G_jk), and the persistent-graph-homology representation is the sorted list of MST edge weights (births) and non-MST edge weights (deaths), with Wasserstein statistics given as closed-form L2 distances on those sorted vectors. Every quantity is computed from the trained network's activations on the functional dataset; no parameter is fitted to class labels, regularization labels, or purity targets. The clustering results in Tables 1 and 2 are empirical observations that could have been low and are not forced by the construction; for example, Top does not uniformly beat the Adj baseline. The main theoretical formulas are imported from the authors' prior publications (Songdechakraiwut and Chung 2023; Songdechakraiwut et al. 2022, 2023), but these are externally published, parameter-free mathematical results whose assumptions do not include the paper's empirical claims, so the self-citations are independent support rather than circular load-bearing. The absence of permutation tests and the possibility that low-order activation statistics drive the separation are validity or robustness concerns, not definitions or fitted-input reductions, and therefore do not constitute circularity.
Assumptions & free parameters
free parameters (2)
- Number of clusters K =
4 (Study 1), 10 (Study 2)
- Wasserstein exponent p =
2
assumptions (4)
- domain assumption Exact Wasserstein distance between persistent graph homology summaries equals Lp distance between sorted birth and death value vectors (Songdechakraiwut and Chung 2023).
- domain assumption Functional synergy between neurons is captured by absolute Pearson correlation of activation vectors.
- domain assumption The trained networks are well-generalized, so functional connectomes reflect general mechanisms rather than memorization.
- domain assumption All connectomes in a comparison have the same number of neurons, so birth and death sets have equal cardinality and sorted matching is valid.
Cite this review
Pith. "Pith review of Functional connectomes of neural networks." pith.science (2026). https://pith.science/paper/YBNT7BK6
@misc{pith2026241215279,
author = {Pith},
title = {Pith review of: Functional connectomes of neural networks},
year = {2026},
howpublished = {\url{https://pith.science/paper/YBNT7BK6}},
note = {Machine review of arXiv:2412.15279}
}
read the original abstract
The human brain is a complex system, and understanding its mechanisms has been a long-standing challenge in neuroscience. The study of the functional connectome, which maps the functional connections between different brain regions, has provided valuable insights through various advanced analysis techniques developed over the years. Similarly, neural networks, inspired by the brain's architecture, have achieved notable success in diverse applications but are often noted for their lack of interpretability. In this paper, we propose a novel approach that bridges neural networks and human brain functions by leveraging brain-inspired techniques. Our approach, grounded in the insights from the functional connectome, offers scalable ways to characterize topology of large neural networks using stable statistical and machine learning techniques. Our empirical analysis demonstrates its capability to enhance the interpretability of neural networks, providing a deeper understanding of their underlying mechanisms.
Figures
Reference graph
Works this paper leans on
-
[1]
, " * write output.state after.block = add.period write newline
ENTRY address archivePrefix author booktitle chapter edition editor eid eprint howpublished institution isbn journal key month note number organization pages publisher school series title type volume year label extra.label sort.label short.list INTEGERS output.state before.all mid.sentence after.sentence after.block FUNCTION init.state.consts #0 'before.a...
-
[2]
write newline
" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 global.max substring 't := if while FUNCTION word.in bbl.in capitalize " " * FUNCT...
-
[3]
Adams, H.; Emerson, T.; Kirby, M.; Neville, R.; Peterson, C.; Shipman, P.; Chepushtanova, S.; Hanson, E.; Motta, F.; and Ziegelmeier, L. 2017. Persistence images: a stable vector representation of persistent homology. Journal of Machine Learning Research, 18(8): 1--35
work page 2017
-
[4]
Biagetti, M.; Cole, A.; and Shiu, G. 2021. The persistence of large scale structures. Part I. Primordial non-Gaussianity . Journal of Cosmology and Astroparticle Physics, 2021(04): 061
work page 2021
-
[5]
Bullmore, E.; and Sporns, O. 2009. Complex brain networks: graph theoretical analysis of structural and functional systems. Nature Reviews Neuroscience, 10(3): 186--198
2009
-
[6]
Carriere, M.; Cuturi, M.; and Oudot, S. 2017. Sliced Wasserstein kernel for persistence diagrams. In International Conference on Machine Learning (ICML), 664--673
work page 2017
-
[7]
Edelsbrunner, H.; and Harer, J. L. 2022. Computational Topology: An Introduction. American Mathematical Society
work page 2022
-
[8]
Forgy, E. W. 1965. Cluster analysis of multivariate data: efficiency versus interpretability of classifications. Biometrics, 21: 768--769
work page 1965
Show all 37 references
-
[9]
Fornito, A.; Zalesky, A.; and Bullmore, E. 2016. Fundamentals of Brain Network Analysis. Academic press
2016
-
[10]
He, K.; Zhang, X.; Ren, S.; and Sun, J. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 770--778
2016
-
[11]
J.; K \"o tter, R.; Breakspear, M.; and Sporns, O
Honey, C. J.; K \"o tter, R.; Breakspear, M.; and Sporns, O. 2007. Network structure of cerebral cortex shapes functional connectivity on multiple time scales. Proceedings of the National Academy of Sciences, 104(24): 10240--10245
2007
-
[12]
J.; Sporns, O.; Cammoun, L.; Gigandet, X.; Thiran, J.-P.; Meuli, R.; and Hagmann, P
Honey, C. J.; Sporns, O.; Cammoun, L.; Gigandet, X.; Thiran, J.-P.; Meuli, R.; and Hagmann, P. 2009. Predicting human resting-state functional connectivity from structural connectivity. Proceedings of the National Academy of Sciences, 106(6): 2035--2040
2009
-
[13]
R.; Schwartz, J
Kandel, E. R.; Schwartz, J. H.; Jessell, T. M.; Siegelbaum, S.; Hudspeth, A. J.; Mack, S.; et al. 2000. Principles of Neural Science, volume 4. McGraw-hill New York
2000
-
[14]
Krizhevsky, A.; Hinton, G.; et al. 2009. Learning multiple layers of features from tiny images
2009
-
[15]
Kwon, Y.-K.; and Cho, K.-H. 2007. Analysis of feedback loops and robustness in network evolution based on Boolean models. BMC Bioinformatics, 8
2007
-
[16]
LeCun, Y.; Bottou, L.; Bengio, Y.; and Haffner, P. 1998. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11): 2278--2324
1998
-
[17]
K.; Kim, B.-N.; and Lee, D
Lee, H.; Kang, H.; Chung, M. K.; Kim, B.-N.; and Lee, D. S. 2012. Persistent brain network homology from the perspective of dendrogram. IEEE Transactions on Medical Imaging, 31(12): 2267--2277
2012
-
[18]
D.; Raghavan, P.; and Schütze, H
Manning, C. D.; Raghavan, P.; and Schütze, H. 2008. Introduction to Information Retrieval. Cambridge University Press
2008
-
[19]
Naitzat, G.; Zhitnikov, A.; and Lim, L.-H. 2020. Topology of deep neural networks. Journal of Machine Learning Research, 21(184): 1--40
2020
-
[20]
A.; Tillmann, U.; Grindrod, P.; and Harrington, H
Otter, N.; Porter, M. A.; Tillmann, U.; Grindrod, P.; and Harrington, H. A. 2017. A roadmap for the computation of persistent homology. EPJ Data Science, 6: 1--38
2017
-
[21]
Reininghaus, J.; Huber, S.; Bauer, U.; and Kwitt, R. 2015. A stable multi-scale kernel for topological machine learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 4741--4748
2015
-
[22]
Rieck, B.; Togninalli, M.; Bock, C.; Moor, M.; Horn, M.; Gumbsch, T.; and Borgwardt, K. 2019. Neural persistence: a complexity measure for deep neural networks using algebraic topology. In International Conference on Learning Representations (ICLR)
2019
-
[23]
Simonyan, K.; and Zisserman, A. 2015. Very deep convolutional networks for large-scale image recognition. In International Conference on Learning Representations (ICLR)
2015
-
[24]
E.; Giusti, C.; Kahn, A.; Vettel, J
Sizemore, A. E.; Giusti, C.; Kahn, A.; Vettel, J. M.; Betzel, R. F.; and Bassett, D. S. 2018. Cliques and cavities in the human connectome. Journal of Computational Neuroscience, 44: 115--145
2018
-
[25]
Skraba, P.; and Turner, K. 2023. Wasserstein stability for persistence diagrams. arXiv preprint arXiv:2006.16824
2023 arXiv
-
[26]
Songdechakraiwut, T.; and Chung, M. K. 2020. Dynamic topological data analysis for functional brain signals. In IEEE International Symposium on Biomedical Imaging, 1--4
2020
-
[27]
Songdechakraiwut, T.; and Chung, M. K. 2023. Topological learning for brain networks. The Annals of Applied Statistics, 17(1): 403
2023
-
[28]
M.; Banks, M
Songdechakraiwut, T.; Krause, B. M.; Banks, M. I.; Nourski, K. V.; and Van Veen, B. D. 2023. Wasserstein distance-preserving vector space of persistent homology. In International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 277--286
2023
-
[29]
M.; Banks, M
Songdechakraiwut, T.; Krause, B. M.; Banks, M. I.; Nourski, K. V.; and Veen, B. D. V. 2022. Fast topological clustering with Wasserstein distance. In International Conference on Learning Representations (ICLR)
2022
-
[30]
Songdechakraiwut, T.; Shen, L.; and Chung, M. 2021. Topological learning and its application to multimodal brain network integration. In International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 166--176
2021
-
[31]
Sporns, O. 2016. Networks of the Brain. MIT press
2016
-
[32]
Tewarie, P.; van Dellen, E.; Hillebrand, A.; and Stam, C. J. 2015. The minimum spanning tree: an unbiased method for brain network analysis. NeuroImage, 104: 177--188
2015
-
[33]
N.; Kaiser, L
Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A. N.; Kaiser, L. u.; and Polosukhin, I. 2017. Attention is all you need. In Advances in Neural Information Processing Systems, volume 30
2017
-
[34]
Watanabe, S.; and Yamana, H. 2022. Topological measurement of deep neural networks using persistent homology. Annals of Mathematics and Artificial Intelligence, 90(1): 75--92
2022
-
[35]
Xia, K.; and Wei, G.-W. 2014. Persistent homology analysis of protein structure, flexibility, and folding. International Journal for Numerical Methods in Biomedical Engineering, 30(8): 814--844
2014
-
[36]
Xiao, H.; Rasul, K.; and Vollgraf, R. 2017. Fashion- MNIST : a novel image dataset for benchmarking machine learning algorithms. arXiv preprint arXiv:1708.07747
2017 arXiv
-
[37]
Zhang, B.; Dong, Z.; Zhang, J.; and Lin, H. 2023. Functional network: a novel framework for interpretability of deep neural networks. Neurocomputing, 519: 94--103
2023
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.