Pith. sign in

REVIEW 4 major objections 3 minor 13 references

Graph Embedding Using Infomax for ASD Classification and Brain Functional Difference Detection

T0 review · 4 major / 3 minor · reviewed 2026-08-14 · deepseek-v4-flash

Pith's one-line read Adding an unsupervised Infomax loss to a graph neural network improves ASD classification from fMRI and reveals separable brain-region representations between autism and healthy controls.

desk verdict A clearly written fMRI-GNN paper whose 'Infomax' regularizer turns out to be a supervised contrastive loss because negatives come from the opposite class, so the main classification gain and region-separability result are confounded. read the letter →

arxiv 1908.04769 v2 pith:HHDWCA4S submitted 2019-08-09 eess.IV cs.CVcs.LGstat.ML

classification eess.IVcs.CVcs.LGstat.ML
keywords ASDclassificationfMRIgraphneuralnetworkInfomaxmutualinformationembeddingbrainfunctionaldifferencesbiomarkerdetection
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper sets out to show that adding an unsupervised mutual-information term, Infomax, to a graph neural network improves both tasks it is trained for: classifying autism spectrum disorder from fMRI and exposing functional differences between ASD and healthy control brains. The reported result is that on a two-layer (16,16) GraphSAGE architecture, the Infomax-augmented loss raises the classification F-score from 0.57 to 0.68 while the classification-only model overfits. The same trained embeddings separate the two groups in 31 brain regions, including prefrontal and cingulate cortex, with Silhouette scores above 0.1. A sympathetic reader would take the central claim to be that graph-level mutual information acts as a regularizer on noisy fMRI embeddings and makes group-level regional differences visible without explicit region labels.

What carries the argument

The mechanism is a three-part pipeline: a GraphSAGE encoder with mean-pooling propagation maps each brain graph to node embeddings; DHP hierarchical pooling summarizes them into a graph-level readout; and a bilinear discriminator scores pairs of node embeddings and the summary, with a loss that maximizes mutual information between local and global representations. The training objective combines binary cross-entropy classification loss with the Infomax term, so node embeddings must serve both classification and representation quality. The Infomax term encourages nodes within the same graph to share common signals while pushing embeddings of negative graphs apart.

What would settle it

Re-run the (16,16) comparison with layer width and regularization chosen on a validation split (or pre-specified), then test on held-out subjects; if the classification-only model reaches the same F-score as the Infomax model, the claimed regularizing benefit collapses. Also, on an independent ASD dataset, check whether the same 31 regions remain separable with Silhouette score above 0.1.

Watch

Extended reading notes

Core claim

The central discovery claimed is that a graph embedding trained with an added Infomax loss regularizes the noisy fMRI representation and makes ASD and healthy-control differences visible at the node level. Specifically, the paper reports that the (16,16) GraphSAGE model with classification loss only gives an F-score of 0.57 and overfits, while the same architecture with the combined loss gives 0.68. The paper also finds that 31 brain regions, including prefrontal and cingulate cortex, have node embeddings with Silhouette score above 0.1, indicating linear separability of the two groups. These separable regions are presented as functional differences between ASD and HC that align with prior literature and could serve as new biomarkers.

Load-bearing premise

The central comparison assumes that the choice of layer width and regularization strength, described only as 'adjusted correspondingly to get the best performance,' was made without using the held-out test folds; if test performance guided those choices, the Infomax improvement is not a valid generalization result.

Editorial extensions

If this is right

  • Adding the Infomax loss to a graph neural network can act as a regularizer, preventing overfitting when the encoder becomes deeper or wider.
  • The learned node embeddings can be used to locate brain regions with functional differences between ASD and healthy controls without requiring region-level labels.
  • The detected regions, such as prefrontal and cingulate cortex, align with existing ASD biomarker literature and may suggest new biomarkers when applied to other datasets.
  • Training a graph embedding with a combined classification and mutual-information loss is a viable strategy for other noisy, high-dimensional graph classification problems.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A testable extension is that the benefit of Infomax should grow with encoder capacity and data noise; comparing the (8,8) and (16,16) results already hints at this, and larger, noisier fMRI cohorts would put it to the test.
  • The same pipeline could be applied to other neurodevelopmental or psychiatric conditions, with negative samples drawn from the opposite diagnostic group as the paper does.
  • The biomarker-detection claim would be stronger if the 31 separable regions were compared against multiple established fMRI contrast maps rather than a single GLM baseline.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 3 minor

Summary. The manuscript proposes a graph neural network pipeline for classifying autism spectrum disorder (ASD) versus healthy controls (HC) from task-fMRI parcellated into 148 ROIs, and for detecting regional functional differences between the groups. The encoder is a supervised GraphSAGE network with dense hierarchical pooling; in addition to the classification cross-entropy L1, the model optimizes an Infomax term L2 that is intended to maximize mutual information between node embeddings and a graph summary. Experiments on 75 ASD and 43 HC children report F-scores for L1-only and joint L models under three architectures, and the authors identify 31 ROIs with Silhouette score above 0.1 as showing separable ASD/HC representations, comparing these with GLM z-statistics. The central claims are that adding Infomax improves classification as a regularizer and that the learned node embeddings reveal region-level ASD/HC functional differences.

Significance. If the claims held, the contribution would be a practical demonstration that a local-global mutual-information regularizer improves robustness of GNN-based ASD classification and yields a candidate biomarker-discovery tool from whole-brain fMRI graphs. The pipeline is modular and uses established components (GraphSAGE, differentiable pooling, Deep Graph Infomax), which is a strength for reproducibility of the architecture. The paper is also explicit about its negative-sampling choice, which makes the deviation from DGI auditable. However, the central comparison is currently confounded by label information in the negative sampling and by the absence of statistical testing, so the significance of the reported improvement is not yet established.

major comments (4)
  1. [Section 2.4 and Eq. (4)] The negative graph is sampled from the opposite class: the text states 'We randomly sample an instance from the opposite class as the negative sample (X', A').' With the loss written in Eq. (4), the discriminator is trained to push node embeddings of the opposite class away from the summary of the current class. This makes L2 a supervised contrastive term, not the unsupervised Infomax objective of Deep Graph Infomax (Ref. 3), where negatives are produced by a corruption function on the same graph. Consequently, Table 1's comparison between L and L1 models conflates the effect of the MI regularizer with an additional supervised signal derived from class labels. This is load-bearing for the paper's first central claim.
  2. [Section 2.5, Eq. (4)] As printed, the negative-sample term is E[1 - log D(h'_i, s)], rather than E[log(1 - D(h'_i, s))]. Maximizing 1 - log D does not correspond to the standard binary cross-entropy or MINE objective and can even encourage D to increase for negative pairs. If this is a typographical error, it must be corrected; as written, Eq. (4) is not a valid MI loss.
  3. [Section 3.2, Table 1] No significance testing is reported, and the claimed benefit of L2 rests on a single architecture: for (8,8), L(8,8) with F-score 0.69±0.05 is not better than L1(8,8) with 0.70±0.06, and for (16), the difference is 0.66 vs 0.63 with overlapping standard deviations. The text also states that 'regularization parameters are adjusted correspondingly to get the best performance' without specifying whether this tuning was done on the held-out folds. If it was, the F-score improvement is not a valid generalization result. A paired test across folds and a nested or pre-registered validation procedure are needed to support the claim that Infomax improves classification.
  4. [Section 3.2, region-level analysis] The region-level detection is circular and threshold-based. The embeddings used for t-SNE and Silhouette analysis are produced by a model whose objective explicitly separates the two classes at the node level; therefore, observing group separability in these embeddings does not independently confirm functional differences. Additionally, the threshold Silhouette > 0.1 and the visual selection of t-SNE panels are arbitrary, and no multiple-comparison correction is applied over 148 ROIs. The comparison with GLM is qualitative. The region-level claim therefore needs either a held-out embedding protocol or an independent statistical test.
minor comments (3)
  1. [Section 3.1] The graph augmentation is described only as 'described in our previous work'; the authors should state the augmentation factor and explain how augmented graphs were split (by subject or by graph) to avoid data leakage between training and test folds.
  2. [Figure 2] The t-SNE panels in Fig. 2(a) do not include axis labels or scales, and because t-SNE distances are not quantitatively meaningful, the visual impression alone is not sufficient evidence of separability; please clarify how the four displayed regions were selected from the 148 ROIs.
  3. [Section 2.1] The notation V = (v_1, ..., v_N)^T in R^{N x D} conflates the vertex set with the node attribute matrix; using X for the attribute matrix would make the encoder input in Eq. (1) consistent with the text.

Circularity Check

1 steps flagged · score 6.0 of 10

Opposite-class negative sampling makes the 'Infomax' term a supervised contrastive loss, so the classification gain and separable-region detection are in part built from the labels.

  1. self definitional [Sec. 2.4, Eq. (4); Sec. 3.2 (Table 1 and Silhouette analysis)]
    "Sec. 2.4: 'We randomly sample an instance from the opposite class as the negative sample (X′, A′).' Eq. (4): L = L1 + 1/2N(Σ E(X,A)[log D(h_i,s)] + E(X′,A′)[1 − log D(h′_i,s)]). Sec. 3.2: 'Only with L did we find linearly separable nodal representations of ASD and HC for certain regions.'"

    The 'Infomax' term L2 is defined by sampling negatives from the opposite class, so it is a supervised contrastive objective rather than the unsupervised DGI objective cited as Ref. [3]. The paper then attributes the Table 1 F-score gain (0.57±0.11 vs 0.68±0.08) and the node-separability finding to 'Infomax graph embedding' as an unsupervised regularizer. By construction, however, L2 already injects the class labels into the representation: it trains the discriminator to push opposite-class node embeddings away from the graph summary and pull same-class embeddings together. The later Silhouette-based identification of separable ROIs is therefore in part reading back the optimization target, not an independent functional-difference discovery.

full rationale

The only significant circularity is the construction of L2. Section 2.4 states that negatives are sampled from the opposite class, and Eq. (4) defines L2 as a discriminator over those pairs. This makes the claimed 'unsupervised Infomax' term label-dependent, so the L-vs-L1 comparison in Table 1 cannot isolate unsupervised MI regularization; it is partly a supervised contrastive effect. The node embeddings used for the Silhouette-based 'functional difference' detection were trained with this same label-dependent loss, so reporting separable regions is, in part, reporting the training objective back. The paper is otherwise self-contained: the encoder, GraphSAGE, DHP, and DGI are external methods, the classification loss is standard cross-entropy, and the GLM/Neurosynth comparisons are external validations. No load-bearing self-citation chain is present; Ref. [1] is used for data augmentation but is not the source of the central claim. The hyperparameter-selection ambiguity in Sec. 3.2 is a correctness risk rather than circularity. Because not every ROI becomes separable, the Silhouette result retains some empirical content, and the reported F-scores are measured rather than derived, so the circularity is partial rather than total.

Assumptions & free parameters 5 free parameters · 3 assumptions · 0 invented entities

The central empirical claims sit on a small set of modeling choices: the ROI-to-graph representation, the augmented sample construction, and the threshold for separability. None of these is derived; they are stated or deferred to prior references. No invented physical or theoretical entities are added.

free parameters (5)
  • GNN architecture and hidden width F = (8,8), (16,16), or (16) compared
    Authors tuned F to 8/16 and report different outcomes; the Infomax benefit is architecture-dependent.
  • Pooling ratio r = 0.5
    Set in Sec. 3.2 without ablation.
  • Silhouette score threshold = 0.1
    Used in Sec. 3.2 to select 31 separable regions; no null model justifies it.
  • Regularization parameters of the loss = not reported
    Described only as 'adjusted correspondingly to get the best performance' in Sec. 3.2.
  • Graph augmentation factor = 75 ASD to 750 graphs, 43 HC to 860 graphs
    Augmentation from [1] multiplies samples; effective subject-level sample size is not reported.
assumptions (3)
  • domain assumption ROI parcellation plus correlation-based adjacency captures ASD-relevant functional organization.
    The whole graph representation assumes the Destrieux atlas and time-series correlation preserve enough signal for classification and difference detection.
  • domain assumption Graph augmentation in [1] produces valid samples without distorting subject-level generalization.
    The paper relies on this augmentation for a 16x sample expansion but provides no details or validation of independence.
  • ad hoc to paper t-SNE projections and Silhouette scores are valid detectors of true group differences in embedding space.
    The threshold 0.1 is introduced ad hoc in Sec. 3.2; no null distribution is provided.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Graph Embedding Using Infomax for ASD Classification and Brain Functional Difference Detection." pith.science (2026). https://pith.science/paper/HHDWCA4S

@misc{pith2026190804769,
  author       = {Pith},
  title        = {Pith review of: Graph Embedding Using Infomax for ASD Classification and Brain Functional Difference Detection},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/HHDWCA4S}},
  note         = {Machine review of arXiv:1908.04769}
}
read the original abstract

Significant progress has been made using fMRI to characterize the brain changes that occur in ASD, a complex neuro-developmental disorder. However, due to the high dimensionality and low signal-to-noise ratio of fMRI, embedding informative and robust brain regional fMRI representations for both graph-level classification and region-level functional difference detection tasks between ASD and healthy control (HC) groups is difficult. Here, we model the whole brain fMRI as a graph, which preserves geometrical and temporal information and use a Graph Neural Network (GNN) to learn from the graph-structured fMRI data. We investigate the potential of including mutual information (MI) loss (Infomax), which is an unsupervised term encouraging large MI of each nodal representation and its corresponding graph-level summarized representation to learn a better graph embedding. Specifically, this work developed a pipeline including a GNN encoder, a classifier and a discriminator, which forces the encoded nodal representations to both benefit classification and reveal the common nodal patterns in a graph. We simultaneously optimize graph-level classification loss and Infomax. We demonstrated that Infomax graph embedding improves classification performance as a regularization term. Furthermore, we found separable nodal representations of ASD and HC groups in prefrontal cortex, cingulate cortex, visual regions, and other social, emotional and execution related brain regions. In contrast with GNN with classification loss only, the proposed pipeline can facilitate training more robust ASD classification models. Moreover, the separable nodal representations can detect the functional differences between the two groups and contribute to revealing new ASD biomarkers.

Figures

Figures reproduced from arXiv: 1908.04769 by the authors.

Figure 1
Figure 1. The flowchart of our proposed ASD classification and graph embedding architecture. The top row of the [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. Analysis of functional differences between ASD and HC. (a) shows the embedded representations of 4 brain [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

13 extracted references · 11 canonical work pages

  1. [1]

    Graph neural network for interpreting task-fmri biomarkers,

    Li, X. et al., “Graph neural network for interpreting task-fmri biomarkers,” MICCAI (2019). 4

  2. [2]

    Mine: mutual information neural estimation,

    Belghazi, M. I. et al., “Mine: mutual information neural estimation,” ICML (2018)

  3. [3]

    Deep graph infomax,

    Veliˇ ckovi´ c, P. et al., “Deep graph infomax,”ICLR (2019)

  4. [4]

    Inductive representation learning on large graphs,

    Hamilton, W. L., Ying, R., and Leskovec, J., “Inductive representation learning on large graphs,” in [ NIPS], (2017)

  5. [5]

    Hierarchical graph representation learning with differentiable pooling,

    Ying, Z. et al., “Hierarchical graph representation learning with differentiable pooling,” in [ NeurIPS], 4805– 4815 (2018)

  6. [6]

    Learning deep representations by mutual information estimation and maximization,

    Hjelm, R. D. et al., “Learning deep representations by mutual information estimation and maximization,” arXiv preprint arXiv:1808.06670 (2018)

  7. [7]

    Neural signatures of autism,

    Kaiser, M. D. et al., “Neural signatures of autism,” PNAS (2010)

  8. [8]

    Brain responses to biological motion predict treatment outcome in young children with autism,

    Yang, D. et al., “Brain responses to biological motion predict treatment outcome in young children with autism,” Translational psychiatry 6(11), e948 (2016)

Show all 13 references
  1. [9]

    Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature,

    Destrieux, C. et al., “Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature,” Neuroimage 53(1), 1–15 (2010)

  2. [10]

    Visualizing data using t-sne,

    Maaten, L. v. d. and Hinton, G., “Visualizing data using t-sne,” Journal of machine learning re- search 9(Nov), 2579–2605 (2008)

  3. [11]

    Silhouettes: a graphical aid to the interpretation and validation of cluster analysis,

    Rousseeuw, P. J., “Silhouettes: a graphical aid to the interpretation and validation of cluster analysis,” Journal of computational and applied mathematics 20, 53–65 (1987)

  4. [12]

    et al., “FSL,” NeuroImage (2012)

    Jenkinson, M. et al., “FSL,” NeuroImage (2012)

  5. [13]

    Large-scale automated synthesis of human functional neuroimaging data,

    Yarkoni, T. et al., “Large-scale automated synthesis of human functional neuroimaging data,” Nature meth- ods 8(8), 665 (2011). 5

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.