REVIEW 2 major objections 6 minor 37 references
A collaborative constrained graph diffusion model for the generation of realistic synthetic molecules
T0 review · 2 major / 6 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read A constrained graph diffusion model achieves 100% valid molecule generation by swapping bonds instead of adding noise.
desk verdict A genuinely constrained diffusion method with a real benchmarking caveat: the formula is drawn from the training set, which inflates the distribution-matching claims. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is valence-preserving double edge swapping: at each diffusion step the model deletes two existing bonds $(i,j)$ and $(k,l)$ and creates bonds $(i,k)$ and $(j,l)$, so each atom loses one bond and gains one, keeping the degree sequence, valence, and molecular formula unchanged. Iterating this swap drives the molecular graph toward the Molloy-Reed distribution, the maximum-entropy distribution over graphs with a fixed degree sequence. The denoiser is a small graph neural network with enhanced graph-isomorphism message-passing layers that scores all feasible quadruplets of bonds for the swap to revert, while a second time network estimates the normalized diffusion time of the current graph. During sampling, the estimated time replaces the true step counter, and the final molecule is chosen as the trajectory graph predicted to lie closest to time zero. Because the double edge swap guarantees validity by construction, the neural networks spend their capacity on structural patterns rather than on chemical rules.
What would settle it
Re-run the GuacaMol and 36-property comparisons with CoCoGraph sampling molecular formulas from a learned or uniform prior rather than from the database, leaving the baselines unchanged; if heavy atom count, molecular weight, exact mass, and valence electron distributions fall to parity with DiGress, the realism claim rests on formula inheritance rather than on the constrained diffusion itself.
Extended reading notes
Core claim
The central discovery is that chemical validity can be moved out of the model's parameters and into the diffusion dynamics. CoCoGraph never adds or removes atoms and never changes any atom's degree, because each noising step deletes two bonds AB and CD and forms AC and BD, so every intermediate and final graph has the same molecular formula and valence sequence as a real seed. The denoiser therefore only has to choose which double edge swap to undo, and a second time model predicts how far a graph is from a clean state so that sampling can stop at the trajectory point closest to a valid molecule. On the GuacaMol benchmark the paper reports 100% validity, 99.9% uniqueness, 98.5% novelty, and KL divergence scores of 96.0 for the BASE model and 96.7 for the fingerprint-enhanced FPS model, versus 92.6 for DiGress and 47.3 for JTVAE. Across 36 cheminformatics properties, CoCoGraph has a smaller Jensen-Shannon distance than DiGress on 23 properties and than JTVAE on 33 properties; the smaller BASE model still outperforms both comparators on most properties.
Load-bearing premise
The load-bearing premise is that sampling begins by drawing a molecular formula directly from the real database and the constrained diffusion never changes it; if formulas were sampled from the model's own prior instead, the reported realism advantage on size-related properties could shrink substantially.
Editorial extensions
If this is right
- Every molecule output by the model satisfies valence constraints, so no rejection sampling or validity repair step is needed.
- With 534K parameters the BASE model attains a GuacaMol KL divergence of 96.0, roughly halving DiGress's typical KL divergence value, implying that benchmark-level realism can be bought with a much smaller architecture.
- The distributional improvements extend beyond the ten GuacaMol descriptors to 36 properties, with the largest gains in topological, electronic, and drug-likeness descriptors.
- The same model can produce a database of roughly 7.6 million novel, unique, valid molecules, and expert chemists identify the real molecule only 62% overall, and at chance level for acyclic and predominantly aliphatic molecules.
- Because the molecular formula and valence sequence are fixed throughout generation, the method can be combined with a separate formula sampler when the formula itself is part of the design space.
Reading between the lines
- Editorial inference: because sampling starts from a molecular formula drawn from the real database and the diffusion never changes it, size-related descriptors such as heavy atom count, molecular weight, exact mass, and valence electron count are matched by construction; comparing against baselines conditioned on the same formula would isolate how much of the realism gain comes from the diffusion
- Editorial inference: the rule of choosing the trajectory graph with the smallest predicted time acts as a learned self-consistency check; ablating this selection rule and comparing property distributions would reveal whether the time model mainly helps choose among denoising trajectories or also improves per-step predictions.
- Editorial inference: because each swap preserves the degree sequence, the model can only rearrange bonds within a fixed valence pattern; structures requiring unusual valences or formula changes are out of reach unless a separate formula generator feeds it. A natural test is whether the 8.2 million molecule database covers chemical space beyond scaffolds that already share those formulas in the tra
- Editorial inference: the $O(n^4)$ cost per diffusion step and the 5-to-70-atom cutoff limit the current implementation to small and medium molecules; scaling to larger systems will require sparse or approximate selection among candidate bond quadruplets.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces CoCoGraph, a discrete graph diffusion model for molecules in which the noising and denoising processes use double edge swaps that preserve the molecular formula and degree sequence, guaranteeing chemical validity by construction. A second 'time model' is trained to predict the denoising progress and is used during sampling to condition the diffusion model and to select the most plausible graph along the trajectory. On the GuacaMol benchmark, the authors report 100% validity, high uniqueness and novelty, and a KL divergence score above DiGress and JTVAE. They also evaluate 36 physicochemical properties, report better Jensen-Shannon distances on 23 of 36 properties versus DiGress and 33 of 36 versus JTVAE (FPS model), and present a Turing-like test in which 102 experts identify real versus generated molecules with 62% accuracy. Code, model weights, and a database of 8.2 million generated molecules are made available.
Significance. The double-edge-swap constrained diffusion is a clean and credible mechanism for guaranteed-valid generation with a fixed molecular formula, and the collaborative time model is an interesting inference-time innovation. If the distributional claims survive a properly matched benchmark, the model could be a useful lightweight alternative for formula-conditional molecule generation. The open-sourced code, weights, and large generated database are valuable assets for the community. However, the main benchmark and property-distribution claims are currently overstated because the sampling protocol injects the empirical molecular-formula distribution directly into the generated molecules, making the comparison to unconstrained baselines not apples-to-apples.
major comments (2)
- [Methods, 'Sampling of new molecules'; Discussion] The sampling protocol states that 'a molecular formula is selected directly from the database,' and the double-edge-swap diffusion preserves the molecular formula and degree sequence throughout the trajectory. Every generated molecule therefore inherits its formula from the empirical training distribution, and any property that is a deterministic function of the formula (molecular weight, exact mass, heavy atom count, number of valence electrons, N-O count, and several chi/VSA descriptors) has a marginal that matches the training set by construction, independent of what the model learned. The largest reported improvements over DiGress occur on exactly these descriptors (e.g., Fig. 3a heavy atom count JS 0.016 vs 0.081; Fig. 3b valence electrons 0.017 vs 0.074). Thus the claims of 'beating the state-of-the-art' on GuacaMol (Table 1) and of producing distributions 'more closely matching real molecules' (Abstract) are not supported for unconstrained generation; they hold only for the conditional task of generating an isomer for a database-supplied formula. The Discussion flags the fixed formula as a limitation, but the benchmark conclusions are not qualified accordingly. The authors should either re-run the evaluation with molecular formulas drawn from a learned or population prior, or explicitly re-frame the contribution as formula-conditional generation and compare against formula-conditioned baselines.
- [Table ED1; Fig. 3k] The aggregate 36-property comparison is inflated by the same confound. Even setting aside formula-determined descriptors, Table ED1 shows that CoCoGraph is worse than DiGress on several structural descriptors (N-H/OH count 0.186 vs 0.026; H-bond donors 0.187 vs 0.025; aromatic rings 0.089 vs 0.020; max absolute partial charge 0.110 vs 0.075). The 23/36 and 33/36 win counts over DiGress and JTVAE should therefore be re-computed separately for formula-determined and structure-determined properties. A fair comparison also requires that comparators be conditioned on the same molecular-formula distribution (for example, by providing the formula as input or by sampling formulas from the same database), so that the comparison isolates the models' ability to generate plausible structures rather than their ability to reproduce the training formula distribution.
minor comments (6)
- [Abstract and main text] The phrase '8.2M million' (Abstract) and '8.2 millions' (Discussion) is redundant; use '8.2 million' consistently.
- [Main text] There are several typos: 'juntion tree VAE' should be 'junction tree VAE'; 'Kullback-Liebler' should be 'Kullback-Leibler'; 'constrains' should be 'constraints'; 'the number fo atoms' in the Fig. 4c caption should be 'the number of atoms'.
- [Methods, 'Molecular data processing' v. 'Model training'] The dataset size is inconsistent: 'Molecular data processing' reports that after filtering 'approximately 1.67 million molecules remained', but 'Model training' begins with 'Our training dataset consisted of 2.25 million molecules'. Please clarify which number was used for training.
- [Table 3 and 'Node-level features'] Table 3 lists 'Hydrogen neighbors' as a node feature, but the 'Node-level features' text enumerates only element type, cycle participation, non-hydrogen neighbors, and bridge count. Add the hydrogen-neighbor feature to the text or remove it from the table.
- [Fig. 5 and architecture text] The text says EnhancedGINE layers produce 124-dimensional node embeddings, while Fig. 5b shows a '1x62' tensor after the global mean pool in the time model. Please clarify the dimensions so the figure and text agree.
- [Fig. ED2 caption] The caption refers to 'CocoGraph' and 'CocoGraph FPS' while the rest of the paper uses 'CoCoGraph'; please standardize the spelling.
Circularity Check
CoCoGraph samples each molecular formula directly from the training database and the double-edge-swap diffusion preserves it, so molecular-weight, heavy-atom, and atom-count distributions match real molecules by construction; the reported GuacaMol and 36-property advantage over DiGress and JTVAE is therefore partly forced by input copying.
-
self definitional
[Main text, 'A collaborative constrained diffusion model...' paragraph; Methods, 'Sampling of new molecules']
"First, we use a discrete process that involves double edge swapping and constrains each atom to always have the correct valence, maintaining other chemical properties such as molecular weight, number of atoms, number of bonds, and molecular formula. ... Initially, a molecular formula is selected directly from the database."
The molecular formula is drawn from the training database and the double-edge-swap diffusion provably preserves the formula and degree sequence, so formula-determined properties (molecular weight, exact mass, heavy atom count, valence-electron count, N/O count) inherit the database marginals by construction rather than being learned. The GuacaMol KL score and the 36-property JS tables include these exact size/composition descriptors (e.g., MW JS 0.014 vs 0.078 for DiGress; heavy atoms JS 0.016 vs 0.081; valence electrons 0.017 vs 0.074), so the headline distributional advantage over DiGress and JTVAE partially reduces to copying the empirical formula distribution.
full rationale
The core validity guarantee and the graph-structure generation are independent achievements: 100% validity follows from the designed double-edge-swap constraint, and structural/topological matching (Bertz, aromatic rings, QED, Balaban) is genuinely learned, so not all comparisons are circular. However, the paper's broadest distributional claims—'beats the state-of-the-art on the most comprehensive existing benchmark' and 'distributions more closely matching real molecules'—are substantially inflated on size/composition descriptors because the sampling protocol fixes each generated molecule's formula to an empirical formula from the database. The paper itself concedes this design limitation in the Discussion. There is no load-bearing self-citation chain; the circularity is a construction/input-copying issue rather than a citation issue. Score 6 reflects partial circularity: several reported benchmark properties reduce by construction, while substantial independent content remains.
Assumptions & free parameters
free parameters (3)
- Diffusion step count =
about 25% of bonds
- Sampling selection threshold =
95%, decremented by 5%
- Loss weighting coefficients =
not reported
assumptions (3)
- domain assumption Preserving each atom's degree (total bond order) under double edge swaps is sufficient to guarantee chemical validity.
- domain assumption A molecular formula may be taken directly from the training database and treated as a fixed input for generation.
- standard math Repeated double edge swaps converge to the Molloy-Reed maximum-entropy distribution over graphs with fixed degree sequence.
Cite this review
Pith. "Pith review of A collaborative constrained graph diffusion model for the generation of realistic synthetic molecules." pith.science (2026). https://pith.science/paper/3XLAAQG5
@misc{pith2026250516365,
author = {Pith},
title = {Pith review of: A collaborative constrained graph diffusion model for the generation of realistic synthetic molecules},
year = {2026},
howpublished = {\url{https://pith.science/paper/3XLAAQG5}},
note = {Machine review of arXiv:2505.16365}
}
read the original abstract
Developing new molecular compounds is crucial to address pressing challenges, from health to environmental sustainability. However, exploring the molecular space to discover new molecules is difficult due to the vastness of the space. Here we introduce CoCoGraph, a collaborative and constrained graph diffusion model capable of generating molecules that are guaranteed to be chemically valid. Thanks to the constraints built into the model and to the collaborative mechanism, CoCoGraph outperforms state-of-the-art approaches on standard benchmarks while requiring up to an order of magnitude fewer parameters. Analysis of 36 chemical properties also demonstrates that CoCoGraph generates molecules with distributions more closely matching real molecules than current models. Leveraging the model's efficiency, we created a database of 8.2M million synthetically generated molecules and conducted a Turing-like test with organic chemistry experts to further assess the plausibility of the generated molecules, and potential biases and limitations of CoCoGraph.
Figures
Figures from the paper (3 more)
Reference graph
Works this paper leans on
-
[2]
Menon, D. & Ranganathan, R. A generative approach to materials discovery, design, and optimization. ACS Omega7, 25958–25973, 10.1021/acsomega.2c03264 (2022)
-
[3]
Alkhatib, I. I. I., Albà, C. G., Darwish, A. S., Llovell, F . & Vega, L. F . Searching for sustainable refrigerants by bridging molecular modeling with machine learning. Ind. & Eng. Chem. Res. 61, 7414–7429, 10.1021/ acs.iecr.2c00719 (2022)
work page 2022
- [4]
-
[5]
Ackloo, S. et al. Cache (critical assessment of computational hit-finding experiments): A public–private partnership benchmarking initiative to enable the development of computational methods for hit-finding (2022)
work page 2022
-
[6]
Polishchuk, P . G., Madzhidov, T . I. & Varnek, A. Estimation of the size of drug-like chemical space based on gdb-17 data. J. Comput. Mol. Des.27, 675–679, 10.1007/s10822-013-9672-4 (2013)
- [7]
-
[8]
Butler, K. T ., Davies, D. W ., Cartwright, H., Isayev, O. & Walsh, A. Machine learning for molecular and materials science. Nature559, 547–555, 10.1038/s41586-018-0337-2 (2018)
-
[9]
Reinvent 2.0: An ai tool for de novo drug design
Blaschke, T .et al. Reinvent 2.0: An ai tool for de novo drug design. J. Chem. Inf. Model. 60, 5918–5922, 10.1021/acs.jcim.0c00915 (2020). 10.Bilodeau, C., Jin, W ., Jaakkola, T ., Barzilay , R. & Jensen, K. F . Generative models for molecular discovery: Recent advances and challenges. Wiley Interdiscip. Rev. Comput. Mol. Sci. 12, e1608, 10.1002/WCMS. 160...
Show all 37 references
-
[11]
& Jaakkola, T
Jin, W ., Barzilay , R. & Jaakkola, T . Junction tree variational autoencoder for molecular graph generation (2019). 1802.04364
2019 arXiv
-
[12]
Cao, N. D. & Kipf, T . Molgan: An implicit generative model for small molecular graphs (2022). 1805.11973. 13.Mercado, R. et al. Graph networks for molecular design (2020). 10.26434/chemrxiv.12843137.v1
2022 arXiv
-
[14]
& Schuurmans, D
Dai, H., Nazi, A., Li, Y., Dai, B. & Schuurmans, D. Scalable deep generative modeling for sparse graphs (2020). 2006.15502. 15.Liao, R. et al. Efficient graph generation with graph recurrent attention networks (2020). 1910.00760
2020 arXiv
-
[16]
You, J., Ying, R., Ren, X., Hamilton, W . L. & Leskovec, J. Graphrnn: Generating realistic graphs with deep auto-regressive models (2018). 1802.08773
2018 arXiv
-
[17]
& Hwang, S
Lee, S., Jo, J. & Hwang, S. J. Exploring chemical space with score-based out-of-distribution generation (2023). 2206.07632
2023 arXiv
-
[18]
A., Maheswaranathan, N
Sohl-Dickstein, J., Weiss, E. A., Maheswaranathan, N. & Ganguli, S. Deep unsupervised learning using nonequilibrium thermodynamics (2015). 1503.03585. 19/28 19.Ho, J., Jain, A. & Abbeel, P . Denoising diffusion probabilistic models (2020). 2006.11239
2015 arXiv
-
[20]
Song, Y. et al. Score-based generative modeling through stochastic differential equations (2021). 2011. 13456
2021
-
[21]
Yang, L. et al. Diffusion models: A comprehensive survey of methods and applications. ACM Comput. Surv. 56, 10.1145/3626235 (2023). 22.Ramesh, A. et al. Zero-shot text-to-image generation (2021). 2102.12092
2023 arXiv
-
[23]
& Chen, M
Ramesh, A., Dhariwal, P ., Nichol, A., Chu, C. & Chen, M. Hierarchical text-conditional image generation with clip latents (2022). 2204.06125
2022 arXiv
-
[24]
D., Ho, J., Tarlow, D
Austin, J., Johnson, D. D., Ho, J., Tarlow, D. & van den Berg, R. Structured denoising diffusion models in discrete state-spaces. ArXivabs/2107.03006(2021)
2021 arXiv
-
[25]
G., Vignac, C
Hoogeboom, E., Satorras, V . G., Vignac, C. & Welling, M. Equivariant diffusion for molecule generation in 3d (2022). 2203.17003
2022 arXiv
-
[26]
& Hwang, S
Jo, J., Lee, S. & Hwang, S. J. Score-based generative modeling of graphs via the system of stochastic differential equations (2022). 2202.02514
2022 arXiv
-
[27]
K., Martinkus, K., Perraudin, N
Haefeli, K. K., Martinkus, K., Perraudin, N. & Wattenhofer, R. Diffusion models for graphs benefit from discrete state spaces (2023). 2210.01549
2023 arXiv
-
[28]
& Frossard, P
Qin, Y., Vignac, C. & Frossard, P . Sparse training of discrete diffusion models for graph generation (2024). 2311.02142. 29.Vignac, C. et al. Digress: Discrete denoising diffusion for graph generation (2023). 2209.14734
2024 arXiv
-
[30]
Huang, H., Sun, L., Du, B. & Lv, W . Conditional diffusion based on discrete graph structures for molecular graph generation (2023). 2301.00427
2023 arXiv
-
[31]
Yang, L. et al. Graphusion: Latent diffusion for graph generation. IEEE Transactions on Knowl. Data Eng. 36, 6358–6369, 10.1109/TKDE.2024.3389783 (2024)
2024
-
[32]
& Liu, S
Du, Y ., Fu, T ., Sun, J. & Liu, S. Molgensurvey: A systematic survey in machine learning models for molecule design (2022). 2203.14500
2022 arXiv
-
[33]
& Sneppen, K
Maslov, S. & Sneppen, K. Specificity and stability in topology of protein networks. Science 296, 910–913, https://doi.org/10.1126/science.1065103 (2002)
2002 doi
- [34]
-
[35]
R., Mezei, T
Kharel, S. R., Mezei, T . R., Chung, S., Erd˝os, P . L. & Toroczkai, Z. Degree-preserving network growth. Nat. Phys.18, 100–106 (2022)
2022
-
[36]
& Frossard, P
Madeira, M., Vignac, C., Thanou, D. & Frossard, P . Generative modelling of structurally constrained graphs (2024). 2406.17341
2024 arXiv
-
[37]
D., Mathieu, E
Fishman, N., Klarner, L., Bortoli, V . D., Mathieu, E. & Hutchinson, M. Diffusion models for constrained domains (2024). 2304.05364
2024 arXiv
-
[38]
& de Bortoli, V
Fishman, N., Klarner, L., Mathieu, E., Hutchinson, M. & de Bortoli, V . Metropolis sampling for constrained diffusion models (2023). 2307.05439
2023 arXiv
-
[39]
& Reed, B
Molloy, M. & Reed, B. A critical point for random graphs with a given degree sequence. Random Struct. & Algorithms6, 161–180, https://doi.org/10.1002/rsa.3240060204 (1995)
1995 doi
-
[40]
Brown, N., Fiscato, M., Segler, M. H. & Vaucher, A. C. Guacamol: Benchmarking models for de novo molecular design. J. Chem. Inf. Model.59, 1096–1108, 10.1021/acs.jcim.8b00839 (2019). 20/28 41.Landrum, G. et al. RDKit: Open-source cheminformatics. https://www.rdkit.org (Zenodo, 2025)
2019 doi
-
[42]
Artificial intelligence needs a scientific method-driven reset
Nunes Amaral, L. Artificial intelligence needs a scientific method-driven reset. Nat. Phys. 20, 523–524, 10.1038/s41567-024-02403-5 (2024). 43.Ren, P . et al. A survey of deep active learning (2021). 2009.00236
2024 arXiv
-
[44]
& Klimov, O
Schulman, J., Wolski, F ., Dhariwal, P ., Radford, A. & Klimov, O. Proximal policy optimization algorithms (2017). 1707.06347
2017 arXiv
-
[45]
& Coley, C
Bohde, M., Manjrekar, M., Wang, R., Ji, S. & Coley, C. W . Diffms: Diffusion generation of molecules conditioned on mass spectra (2025). 2502.09571. 46.Hu, W . et al. Strategies for pre-training graph neural networks (2020). 1905.12265
2025 arXiv
-
[47]
Morgan, H. L. The generation of a unique machine description for chemical structures—A technique developed at Chemical Abstracts Service. J. Chem. Documentation 5, 107–113, 10.1021/c160017a018 (1965). Acknowledgements This research was supported by project PID2022-142600NB-I00...
1965 doi
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.