REVIEW 3 major objections 5 minor 25 references
CondPSE: A Polynomial-Filtered Structural Encoder with Conditional Modulation for Graphs
T0 review · 3 major / 5 minor · reviewed 2026-08-01 · deepseek-v4-flash
Pith's one-line read This paper shows that a learned structural encoder's strong discrimination of synthetic hard graphs does not automatically transfer to better downstream molecular prediction.
desk verdict A useful, honest negative result about learned PSE transfer, but inherited baselines soften the head-to-head conclusion. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing component is the polynomial graph filter bank: K learnable polynomial filters applied to i.i.d. Gaussian node probes, where each filter is a normalized mixture of adjacency-propagation powers A^i Z. This creates multiple structural-response branches, and each subsequent conditioning block applies FiLM modulation using cross-filter pairwise comparisons, a shared ResGatedGCN local pass, and graph-level statistics. The filter bank converts random probes into topology-sensitive encodings without any eigendecomposition.
What would settle it
Reproduce the full evaluation by running GPSE and CondPSE under identical random seeds, data splits, and CV protocol on CSL, EXP, ZINC, MolHIV, MolPCBA, and PCQM4Mv2-subset, and check whether CondPSE's synthetic gains persist and whether any molecular ordering changes; if CondPSE then clearly surpasses GPSE on a molecular task, the paper's central conclusion would need to be revised.
Extended reading notes
Core claim
The central discovery is an empirical separation between benchmark-level structural expressivity and downstream transfer for frozen learned PSE encoders: CondPSE, built from a polynomial filter bank and conditional modulation, can almost perfectly discriminate CSL and EXP graphs that 1-WL-bounded message passing cannot, yet those gains do not produce a downstream advantage over GPSE on molecular property prediction. The paper establishes this by freezing the encoder after pretraining and evaluating it under the same downstream protocols as GPSE, then dissecting the result with ablations and a backbone sweep.
Load-bearing premise
The headline comparisons rely on reusing GPSE, LapPE, and RWSE results from the GPSE paper or its public implementation under the assumption that they were generated under CondPSE's exact seed, split, and cross-validation protocol; if that assumption fails, the relative improvements and the 'no better than GPSE' conclusion could shift.
Editorial extensions
If this is right
- Synthetic structural-discrimination benchmarks like CSL and EXP are not, on their own, reliable predictors of a frozen PSE encoder's downstream value; future encoder evaluations should report transfer results on multiple real-world tasks.
- The same frozen encoding yields different relative performance across downstream backbones (e.g., CondPSE beats GPSE on GCN/GatedGCN/Transformer but loses on GIN/GINE on ZINC), so conclusions about encoder quality should be drawn from a backbone sweep, not a single architecture.
- Because the polynomial filter bank accounts for most of the CSL/EXP gain, future PSE encoders may benefit from explicit multi-depth propagation responses rather than stacked message passing only.
- Molecular transfer being close between CondPSE and GPSE suggests the bottleneck for frozen learned PSE encoders may lie in pretraining-target alignment and downstream integration rather than in structural expressivity.
- The paper's results caution against equating higher expressivity with better generalization: overly fine structural distinctions could reduce the downstream model's ability to generalize within property-similar graph classes.
Reading between the lines
- The paper leaves unexplored whether fine-tuning (rather than freezing) CondPSE would let its strong structural signal translate into molecular gains; a natural extension is to run the downstream backbones with CondPSE weights trainable.
- Because the downstream encodings are generated from a single fixed probe realization, the results could be probe-seed dependent; a testable extension is to average over multiple probe realizations when generating encodings and check variance.
- The argument that expressivity can hurt generalization points to a measurable prediction: CondPSE encodings should produce larger intra-class variance than GPSE encodings on property-similar molecular graphs; a reader could compute this variance directly from the stored encodings.
- The filter-bank design could be reused as a differentiable component inside a downstream GNN rather than as a frozen input encoder; the paper does not test that configuration.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces CondPSE, a learned positional/structural encoding (PSE) encoder that applies a bank of K learnable polynomial graph filters to Gaussian node probes and refines the resulting branches with FiLM-style conditioning using cross-filter, local message-passing, and global graph-level signals. CondPSE is pretrained on OGBG-MolPCBA using the same node-level and graph-level pretraining targets as GPSE, then frozen and used as input encoding for downstream GNNs. On synthetic isomorphism benchmarks, CondPSE raises CSL accuracy from 42.9% (GPSE-reported) to 97.3% and EXP from 68.3% to 99.9%. On molecular benchmarks (ZINC, MolHIV, MolPCBA, PCQM4Mv2-subset) with a GraphGPS backbone, CondPSE performs comparably to GPSE without consistently surpassing it. A ZINC backbone sweep shows mixed relative performance. The authors conclude that stronger benchmark-level structural discrimination does not automatically translate into better downstream graph-level transfer.
Significance. If the central result holds, the paper makes a valuable diagnostic contribution: a frozen learned PSE encoder can separate structures that 1-WL-bounded message passing cannot (CSL/EXP), yet this expressivity does not by itself yield a downstream molecular advantage. This challenges the implicit assumption that stronger synthetic structural discrimination should transfer to real-world tasks. The paper is transparent about its limitations, provides full encoder and training configuration tables, and reports multi-seed results with error bars. The ablation study cleanly isolates the contribution of the polynomial filter bank, and the authors explicitly disavow a definitive superiority claim on the backbone sweep. These strengths make the paper a useful reference for the PSE community.
major comments (3)
- [A.3, Tables 1–3] All non-CondPSE baselines (No PE, GPSE, LapPE, RWSE) are inherited from the GPSE paper or its public implementation rather than rerun under the paper's exact seed/CV protocol. The headline comparisons — 'raises CSL accuracy from 42.9% to 97.3%' and 'performs comparably to GPSE without surpassing it' — both depend on these externally sourced numbers. Because CondPSE is evaluated with its own seed draws, a small shift in the GPSE baseline (e.g., CSL 42.9±7.9 under another seed protocol) could alter the claimed gains. The paper should rerun the baselines under identical folds, seeds, and downstream configurations, or at minimum provide cross-seed variance and paired comparisons where feasible.
- [A.2, Tables 2–3] CondPSE is pretrained on OGBG-MolPCBA alone, whereas GPSE is pretrained on a much larger and more diverse corpus (the GPSE paper uses a multi-dataset pretraining set). The paper does not control for this difference in pretraining data scale/diversity. The molecular transfer results could therefore reflect not only the encoder architecture but also the amount and composition of pretraining data. To support the claim that 'stronger CSL/EXP performance does not translate to downstream advantage,' CondPSE should be pretrained on the same pretraining corpus as GPSE, or the comparison should explicitly account for this confound.
- [Tables 2–3] The molecular differences between GPSE and CondPSE are not subjected to any significance test, and several are well within one standard deviation: ZINC MAE 0.0648±0.0030 vs 0.0649±0.0035; PCQM4Mv2-subset MAE 0.1196±0.0004 vs 0.1207±0.0006. The claim that CondPSE is 'without surpassing' GPSE is essentially an acceptance of the null hypothesis. With 10 seeds (and 4 seeds in the sweep), paired tests such as Wilcoxon signed-rank or a bootstrap over seeds are straightforward and would substantiate or qualify the conclusion. Without such tests, the central negative finding is not statistically grounded.
minor comments (5)
- [3.1] The term 'NormalSE' is used without explicit definition at first mention. Clarify that it denotes standard i.i.d. Gaussian node probes, and please keep the terminology consistent ('NormalSE' vs. 'Gaussian probes').
- [Table 1] The 'w/o filter bank' ablation is not described. Specify exactly what replaces the polynomial filter bank in this variant (e.g., a single linear transformation of A^0 Z, randomly initialized untrained filters, or a different propagation scheme) and report the parameter count if it differs.
- [Table 3] The statement 'several gaps are within reported variation' would benefit from concrete numbers. Indicate which differences are beyond one standard deviation and, ideally, add error bars or a significance test for the backbone sweep as well.
- [Abstract] The phrasing 'raises CSL accuracy from 42.9% to 97.3% relative to GPSE' could be read as a direct head-to-head experiment. Because the 42.9% value is inherited, consider rephrasing to 'compared to the GPSE-reported value' or 'exceeds the GPSE-reported accuracy.'
- [5] The expressivity-generalization trade-off discussion is explicitly untested here, which is appropriate. The references [14,15] are cited as supporting theory; ensure they are publicly available and correctly described, especially [15], which is dated 2026.
Circularity Check
No significant circularity: CondPSE's pretraining targets are external, downstream labels are unused during pretraining, and the headline transfer comparison rests on independent benchmark numbers rather than a self-referential derivation.
full rationale
Walking the paper's derivation chain: CondPSE is defined by Eq. (1)-(5) as a polynomial-filtered, FiLM-modulated encoder over Gaussian probes; these equations do not reference downstream labels or evaluation metrics. Pretraining (Section A.2) reconstructs established external targets (ElectrostaticPE, LapPE, RWSE, HKdiagSE, EigVals, CycleGE) on OGBG-MolPCBA, with no downstream property labels used. The CSL/EXP results are presented as a benchmark of whether a frozen learned encoder can recover structural signals that are known to discriminate these graph classes; the paper explicitly discloses that RWSE is among the pretraining targets and that RWSE already attains 100.0 on CSL (Table 1 and Section 4.1). This is an honest representation-quality evaluation, not a circular prediction: GPSE is pretrained on the same targets yet scores 42.9 on CSL, so the CondPSE result has independent content attributable to the architecture, not to the target set. The molecular transfer claim compares CondPSE against baseline numbers inherited from the GPSE paper/public implementation (Section A.3); this is a reproducibility and comparability risk (seed protocol differences), but it is not circularity because the baselines are externally produced, not derived from CondPSE itself, and no parameter is fitted to make the conclusion follow. The Discussion's caveats ('we do not directly measure target-label alignment, so this remains a hypothesis') are explicit uncertainty, not circular reasoning. There is no self-citation chain, no imported uniqueness theorem, and no ansatz smuggled in via citation that reduces a claim to its own input.
Assumptions & free parameters
free parameters (5)
- Filter bank size K and polynomial degree d =
K=4, d=15
- Conditioning blocks B =
B=6
- Model/probe/output dimensions D =
256
- Downstream adapter dimension d_pe =
128 (CSL), 64 (EXP), 32 (ZINC/MolHIV), 48 (MolPCBA), 64 (PCQM4Mv2-subset)
- Training schedules (epochs, LR, batch size, dropout) =
e.g., 120 pretrain epochs, LR 5e-4, batch 512; downstream varies
assumptions (5)
- standard math Message-passing GNNs are bounded by the 1-WL graph isomorphism test.
- domain assumption Random Gaussian node probes propagated through the adjacency matrix carry enough structural information to reconstruct the selected PSE targets.
- domain assumption The chosen hand-crafted PSE targets are valid supervision for structural discrimination on CSL/EXP.
- domain assumption Frozen encoder plus light downstream adapter plus concatenation (Eq. 5) is a fair and general protocol for comparing learned PSE encoders.
- ad hoc to paper GPSE/LapPE/RWSE baseline numbers from public reports are comparable to CondPSE numbers produced under 'corresponding public GPSE evaluation settings'.
Cite this review
Pith. "Pith review of CondPSE: A Polynomial-Filtered Structural Encoder with Conditional Modulation for Graphs." pith.science (2026). https://pith.science/paper/DNYMBCTA
@misc{pith2026260725169,
author = {Pith},
title = {Pith review of: CondPSE: A Polynomial-Filtered Structural Encoder with Conditional Modulation for Graphs},
year = {2026},
howpublished = {\url{https://pith.science/paper/DNYMBCTA}},
note = {Machine review of arXiv:2607.25169}
}
read the original abstract
Message-passing graph neural networks are bounded by the 1-WL test and can miss topological structure that distinguishes non-isomorphic graphs. Positional and structural encodings (PSE) inject such topology-derived signals, and learned PSE encoders such as GPSE pretrain a single encoder to produce these signals from random node probes, which can then be frozen and reused as inputs across downstream graph models. We present CondPSE, a learned PSE encoder that applies a learnable polynomial graph filter bank to standard Gaussian node probes and refines the resulting structural-response branches through FiLM-style modulation conditioned on cross-filter, local message-passing, and graph-level signals. CondPSE is pretrained to reconstruct node-level positional/structural targets and graph-level invariants, and is then frozen for use as a downstream input encoding. On synthetic structural-discrimination benchmarks, CondPSE separates graph structures that 1-WL-bounded message passing cannot: it raises CSL accuracy from 42.9% to 97.3% and EXP accuracy from 68.3% to 99.9% relative to GPSE, and ablations show that the polynomial filter bank accounts for most of this gain. On real molecular property prediction, the picture is more limited. With a hybrid local-message-passing/global-attention backbone, CondPSE performs comparably to GPSE without surpassing it, and a ZINC backbone sweep shows no consistent ordering between the two encoders. We report these results and discuss why strong synthetic structural discrimination does not, on its own, yield a downstream advantage for frozen learned PSE encoders, including the role of downstream integration and possible mismatch between structural pretraining targets and molecular property labels.
Reference graph
Works this paper leans on
-
[1]
Ralph Abboud, Ismail Ilkan Ceylan, Martin Grohe, and Thomas Lukasiewicz
-
[2]
Xavier Bresson and Thomas Laurent. 2017. Residual Gated Graph ConvNets. arXiv preprint arXiv:1711.07553(2017)
arXiv 2017
-
[3]
Semih Cantürk, Renming Liu, Olivier Lapointe-Gagné, Vincent Létourneau, Guy Wolf, Dominique Beaini, and Ladislav Rampášek. 2024. Graph Positional and Structural Encoder. InProceedings of the 41st International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 235). PMLR, 5533–5566
2024
-
[4]
Eli Chien, Jianhao Peng, Pan Li, and Olgica Milenkovic. 2021. Adaptive Universal Generalized PageRank Graph Neural Network. InInternational Conference on Learning Representations
2021
-
[5]
Michaël Defferrard, Xavier Bresson, and Pierre Vandergheynst. 2016. Convo- lutional Neural Networks on Graphs with Fast Localized Spectral Filtering. In Advances in Neural Information Processing Systems, Vol. 29. 3844–3852
2016
-
[6]
Joshi, Anh Tuan Luu, Thomas Laurent, Yoshua Bengio, and Xavier Bresson
Vijay Prakash Dwivedi, Chaitanya K. Joshi, Anh Tuan Luu, Thomas Laurent, Yoshua Bengio, and Xavier Bresson. 2023. Benchmarking Graph Neural Networks. Journal of Machine Learning Research24, 43 (2023), 1–48
2023
-
[7]
Vijay Prakash Dwivedi, Anh Tuan Luu, Thomas Laurent, Yoshua Bengio, and Xavier Bresson. 2022. Graph Neural Networks with Learnable Structural and Po- sitional Representations. InInternational Conference on Learning Representations
2022
-
[8]
Weihua Hu, Matthias Fey, Hongyu Ren, Maho Nakata, Yuxiao Dong, and Jure Leskovec. 2021. OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphs. InProceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks
2021
Show all 25 references
-
[9]
Weihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong, Hongyu Ren, Bowen Liu, Michele Catasta, and Jure Leskovec. 2020. Open Graph Benchmark: Datasets for Machine Learning on Graphs. InAdvances in Neural Information Processing Systems, Vol. 33. 22118–22133
2020
-
[10]
Weihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik, Percy Liang, Vijay Pande, and Jure Leskovec. 2020. Strategies for Pre-training Graph Neural Networks. In International Conference on Learning Representations
2020
-
[11]
Hutchinson
Michael F. Hutchinson. 1990. A stochastic estimator of the trace of the influence matrix for Laplacian smoothing splines.Communications in Statistics: Simulation and Computation19, 2 (1990), 433–450
1990
-
[12]
Kipf and Max Welling
Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. InInternational Conference on Learning Repre- sentations
2017
-
[13]
Hamilton, Vincent Létourneau, and Prudencio Tossou
Devin Kreuzer, Dominique Beaini, William L. Hamilton, Vincent Létourneau, and Prudencio Tossou. 2021. Rethinking Graph Transformers with Spectral Attention. InAdvances in Neural Information Processing Systems, Vol. 34. 21618–21629
2021
-
[14]
Shouheng Li, Floris Geerts, Dongwoo Kim, and Qing Wang. 2025. Towards Bridg- ing Generalization and Expressivity of Graph Neural Networks. InInternational Conference on Learning Representations
2025
-
[15]
Lutzeyer
Sohir Maskey, Raffaele Paolino, Fabian Jogl, Gitta Kutyniok, and Johannes F. Lutzeyer. 2026. Graph Representational Learning: When Does More Expressivity Hurt Generalization?. InInternational Conference on Learning Representations
2026
-
[16]
Hamilton, Jan E
Christopher Morris, Martin Ritzert, Matthias Fey, William L. Hamilton, Jan E. Lenssen, Gaurav Rattan, and Martin Grohe. 2019. Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networks. InProceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 4602–4609
2019
-
[17]
Murphy, Balasubramaniam Srinivasan, Vinayak Rao, and Bruno Ribeiro
Ryan L. Murphy, Balasubramaniam Srinivasan, Vinayak Rao, and Bruno Ribeiro
-
[18]
Ethan Perez, Florian Strub, Harm de Vries, Vincent Dumoulin, and Aaron Courville. 2018. FiLM: Visual Reasoning with a General Conditioning Layer. InProceedings of the AAAI Conference on Artificial Intelligence, Vol. 32. 3942– 3951
2018
-
[19]
Ladislav Rampášek, Michael Galkin, Vijay Prakash Dwivedi, Anh Tuan Luu, Guy Wolf, and Dominique Beaini. 2022. Recipe for a General, Powerful, Scalable Graph Transformer. InAdvances in Neural Information Processing Systems, Vol. 35. 14501–14515
2022
-
[20]
Ryoma Sato, Makoto Yamada, and Hisashi Kashima. 2021. Random Features Strengthen Graph Neural Networks. InProceedings of the 2021 SIAM International Conference on Data Mining. 333–341
2021
-
[21]
Shashanka Ubaru, Jie Chen, and Yousef Saad. 2017. Fast estimation of tr(f(A)) via stochastic Lanczos quadrature.SIAM J. Matrix Anal. Appl.38, 4 (2017), 1075–1099
2017
-
[22]
Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. 2019. How Powerful are Graph Neural Networks?. InInternational Conference on Learning Representa- tions
2019
-
[23]
Chengxuan Ying, Tianle Cai, Shengjie Luo, Shuxin Zheng, Guolin Ke, Di He, Yanming Shen, and Tie-Yan Liu. 2021. Do Transformers Really Perform Badly for Graph Representation?. InAdvances in Neural Information Processing Systems, Vol. 34. 28877–28888. KDD 2026 Workshop GMLLM, Au...
2021
-
[2019]
InProceedings of the 36th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol
Relational Pooling for Graph Representations. InProceedings of the 36th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 97). PMLR, 4663–4673
-
[2021]
InProceedings of the Thirtieth International Joint Conference on Artificial Intelligence
The Surprising Power of Graph Neural Networks with Random Node Initialization. InProceedings of the Thirtieth International Joint Conference on Artificial Intelligence. 2112–2118
Reviewed August 1, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.