REVIEW 3 major objections 5 minor 13 references
IMPRESSION -- Prediction of NMR Parameters for 3-dimensional chemical structures using Machine Learning with near quantum chemical accuracy
T0 review · 3 major / 5 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read A machine-learning model trained on quantum-chemical NMR data can predict 1H shifts, 13C shifts, and 1JCH couplings at DFT-level accuracy in milliseconds.
desk verdict IMPRESSION is a genuinely fast ML replacement for DFT NMR prediction, but the 'independent' test set overlaps the training set (four identical CSD refcodes), so the headline MAEs need recomputation. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The machinery is kernel ridge regression over atomic chemical environments, using the FCHL representation, which describes a nucleus by the two- and three-body geometry of the atoms around it. The target value for an environment is a regularized weighted sum of kernel similarities to all training environments; for $^{1}J_{\mathrm{CH}}$, the similarity is the product of the carbon-environment and hydrogen-environment kernels. Training environments were chosen by adaptive sampling: repeatedly predict the full candidate pool with several models, add the structures with the highest cross-validation variance, and recompute the DFT references for them. The same variance calculation, evaluated before a prediction is made, serves as the confidence filter that identifies environments outside the training coverage. All reference values come from DFT at the $\omega$B97X-D/6-311g(d,p) level with gauge-invariant atomic orbitals and uncontracted basis functions, including all four spin–spin coupling contributions.
What would settle it
Take a molecule containing sp-hybridized atoms or a strongly anisotropic pi environment, within the same element set, and check whether its IMPRESSION predictions pass the variance cutoffs while differing from high-level DFT by more than 10 ppm for 13C or more than 5 Hz for 1JCH; one clean low-variance, high-error case would refute the claim that the variance filter identifies all unreliable predictions.
Extended reading notes
Core claim
The central claim is that a kernel machine trained on DFT-computed NMR parameters is a faithful surrogate for the DFT method itself: given the same three-dimensional structure, IMPRESSION reproduces the reference calculations for $\delta^{1}$H, $\delta^{13}$C, and $^{1}J_{\mathrm{CH}}$ with test-set mean absolute errors of 0.23 ppm, 2.45 ppm, and 0.87 Hz, and root-mean-square errors of 0.35 ppm, 3.88 ppm, and 1.39 Hz. After applying a per-parameter variance filter, the model's agreement with experimental measurements on independent validation sets is essentially the same as the underlying DFT method's for proton shifts and one-bond couplings, and close for carbon shifts. The paper also shows that IMPRESSION reproduces DFT's ability to distinguish the correct diastereomer of a polycyclic alkaloid among 14 candidates from its $^{1}J_{\mathrm{CH}}$ values, and to assign diastereotopic protons, which demonstrates that the three-dimensional sensitivity needed for stereochemical problems survives the machine-learning approximation.
Load-bearing premise
The accuracy claim rests on the 882 training structures—drawn by adaptive sampling from a large database of crystal structures of molecules containing only carbon, hydrogen, nitrogen, oxygen, and fluorine—being representative enough of the chemical environments users will encounter that poorly covered cases are rare and that cross-validation variance flags them; the paper's outlier analysis shows sp-hybridized atoms and atoms near pi systems are where this boundary shows.
Editorial extensions
If this is right
- Structure elucidation workflows that currently wait hours to days per candidate molecule can screen many conformers, diastereomers, or candidate structures in seconds, because the NMR prediction itself is no longer the bottleneck.
- The variance filter gives each predicted value a usable confidence tag, so automated pipelines can send only uncertain predictions back to full DFT rather than recomputing everything.
- Because the machine learns from the underlying DFT, any improvement in that DFT reference—better functionals, basis sets, or solvent models—should transfer directly to the machine's accuracy.
- The learning curves indicate that increasing the training set roughly tenfold would approximately halve the current error, so the reported accuracy is not a ceiling.
- Molecular-mechanics geometries, if paired with retrained models, could remove the expensive DFT geometry step as well, at the cost of a 30–50% increase in errors for some parameters.
Reading between the lines
- Although the paper tests only carbon, hydrogen, nitrogen, oxygen, and fluorine chemistry, nothing in the kernel-ridge-regression mechanism is element-specific; training the same pipeline on DFT data for heteronuclei such as 15N, 19F, or 31P should work, provided a similarly diverse training superset can be assembled.
- The variance-based confidence estimate could be used as a prior in Bayesian structure assignment: instead of simply capping errors, a likelihood could be built from the per-environment variance, a natural extension of the paper's geometric-mean error scoring.
- The paper's own largest errors—up to 63 ppm for carbon shifts and 24.6 Hz for couplings—cluster around sp-hybridized atoms and atoms near pi systems, so a small deliberately diverse benchmark of such molecules would test whether the variance filter flags coverage failures reliably in practice.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript presents IMPRESSION, a kernel ridge regression (KRR) model with FCHL representations for predicting 1H and 13C chemical shifts and 1JCH scalar couplings from 3D molecular structures. Training labels are DFT values computed at the omega-b97xd/6-311g(d,p) level for 882 adaptively sampled C,H,N,O,F-containing CSD structures; the test set is 410 structures from the CSD-500 set. The authors report test-set MAEs of 0.23 ppm (delta-1H), 2.45 ppm (delta-13C), and 0.87 Hz (1JCH), and a variance-based pre-prediction filter that further improves these values. They also compare against experimental datasets and demonstrate that IMPRESSION can discriminate strychnine diastereomers nearly as well as the underlying DFT method, in a fraction of the computational time.
Significance. If the held-out accuracy numbers survive a clean train/test split, this is a timely and useful contribution: it shows that a kernel-based ML model can reproduce DFT-quality NMR parameters for a nontrivial portion of organic chemical space at negligible computational cost, and the variance filter is a practical way to flag unreliable predictions. The paper includes genuinely useful elements: adaptive sampling to build the training set, a learning-curve analysis, explicit Gaussian input files, and a stereoisomer discrimination test that goes beyond simple error metrics. The experimental comparisons, while not fully independent because of the fitted offset discussed below, are a strength of the paper. The central claim is clear and, subject to the dataset-integrity issue, well supported by the reported numbers.
major comments (3)
- [S1.4, S8, 2.1] The claimed independent test set is contaminated. Section 2.1 states that the 410 CSD-500 structures are an independent test set, but the SI training and test CSD lists in Section S8 both contain the exact refcodes AXADAF, IYASUW, LAFHEH and LILDEP. In addition, Section S1.4 states that the initial 100 training structures were chosen at random from the CSD-500 test set. Although those 100 were discarded after the first active-learning round, they were used to train the models that selected subsequent structures, so the training procedure itself was informed by test-set molecules. Because KRR is a memory-based method, train/test overlap can artificially inflate the reported MAE and RMSE values. The authors must compute the set intersection programmatically, remove every overlapping molecule (including graph-isomorphic duplicates under different refcodes), and recompute all unfiltered and variance-filtered test metrics. If the numbers change materially, the abstract's 'near quantum chemical accuracy' claim must be restated with corrected figures.
- [2.2] The variance-filter cutoffs (0.1 ppm, 5 ppm, 1 Hz) were selected using the test set itself: the text says 'We therefore identified variance cut-offs for IMPRESSION predictions that provide a good compromise between accuracy and excluded values for the test set.' This makes the filtered test-set MAE/RMSE values optimistically biased, because the filter thresholds were tuned to minimize error on the same data used for evaluation. The unfiltered test metrics are the primary evidence and should be reported as such; the filter cutoffs should be selected on a held-out portion of the training set or by nested cross-validation, and the filtered test metrics should be presented as exploratory rather than as the headline accuracy.
- [S1.3, 2.3] The 1JCH test and training labels are not pure DFT values. Section S1.3 states that a 10.91 Hz offset, derived from a comparison of DFT predictions to the 608 experimental couplings in Section 2.3, was applied to the DFT values in both the training and test datasets. Thus the reported 0.87 Hz MAE for 1JCH measures agreement with offset-corrected DFT, not with the raw quantum-chemical method. Moreover, the subsequent experimental comparison for 1JCH is not an independent test of the ML model, because the same experimental data were used to fit the offset. The authors should report the unfiltered raw-DFT test metrics as well, or clearly label the 1JCH results as 'DFT plus fitted offset' throughout the abstract and conclusions.
minor comments (5)
- [S1.1] Several citations in the SI are missing or rendered as question marks, e.g., 'Kernel Ridge Regression?' and 'Coulomb Matrix ?'. These placeholders should be replaced with proper references before resubmission.
- [2.2] The terms MAE, RMSE, and MaxE are used throughout but only MAE is defined; please define all three the first time they appear.
- [2.2] The typo 'comprimise' appears in the sentence introducing the variance cutoffs; it should be 'compromise'.
- [3] The conclusion says 'it's underlying DFT method'; this should be 'its underlying DFT method'.
- [S4, S6] The SI tables and figures for diastereotopic proton assignment and outlier structures would benefit from a short sentence in each caption stating which level of theory the 'DFT' column refers to (omega-b97xd/6-311g(d,p) after the linear-scaling/offset correction).
Circularity Check
The claimed independent test set is contaminated: four exact CSD refcodes appear in both the training and testing lists, and the adaptive-sampling seed was drawn from the CSD-500 test set; variance-filter thresholds were also tuned on the test set.
-
fitted input called prediction
[SI S1.4 (Adaptive sampling) and SI S8 (CSD structure lists)]
"An initial set of 100 structures were chosen at random from the CSD-500 test set already obtained from the work by Emsley et al."
The paper claims the test set is independent: 'The test set, against which the quality of the IMPRESSION predictions is independently tested, was comprised of a further 410 chemical structures ... harvested from the CSD-500 dataset.' However, the adaptive-sampling seed was drawn from that same CSD-500 test set, and the training and testing name lists in Section S8 contain identical refcodes (AXADAF, IYASUW, LAFHEH, LILDEP). Since KRR/FCHL is an interpolation method, a molecule whose environments were used in fitting will produce near-training-label predictions, so the reported held-out MAE/RMSE values (0.23 ppm, 2.45 ppm, 0.87 Hz) are partly in-sample, not a clean out-of-sample estimate of the central 'near DFT accuracy' claim.
-
fitted input called prediction
[Section 2.2 (Performance relative to DFT)]
"We therefore identified variance cut-offs for IMPRESSION predictions that provide a good comprimise between accuracy and excluded values for the test set, which were found to be 1Hz for 1JCH, 0.1ppm for δ 1H and 5ppm for δ 13C."
The variance-filter thresholds are selected by optimizing performance on the same test set that is then used to report the filtered accuracy (MAE = 0.23 ppm / 2.17 ppm / 0.81 Hz). This is a test-set fit: the filtered numbers are not a fixed a-priori filter but an in-sample tuned result. The unfiltered metrics are not affected, so this is a partial circularity that inflates the headline filtered accuracy.
1 more flagged steps
-
fitted input called prediction
[SI S1.3 (Correction of DFT NMR parameter predictions for comparison to experiment) and Section 2.3]
"As a result, the offset (10.91Hz) was applied to the DFT values in both the training and test datasets."
The 10.91 Hz offset is the average DFT-minus-experiment error measured on the Venkata experimental set, and the same Venkata set is used in Section 2.3 as the experimental validation for 1JCH. Applying this fitted offset to both training and test DFT labels guarantees that any model trained on those labels inherits the calibration, so the reported near-match between variance-filtered IMPRESSION and DFT on that experimental set (MAE 2.01 Hz vs 1.83 Hz) is partly a consequence of the fitted offset rather than an independent prediction. The core ML-vs-DFT reproduction claim is not affected.
full rationale
The paper's main idea — train a kernel machine on DFT-computed NMR parameters and test whether it reproduces DFT on new structures — is not circular in its design: the training labels are DFT values, the models are standard KRR/FCHL, and a genuinely disjoint held-out set would provide independent evidence. No load-bearing self-citation or uniqueness-import argument appears; citations to the QML toolkit and prior Bratholm papers are supporting software/methods references, not the source of the prediction claim. The circularity that does exist is concrete dataset construction and evaluation leakage. First, the 'independent' test set is not fully disjoint from training: the adaptive-sampling seed was chosen from the CSD-500 test set, and the supplied CSD lists contain four exact overlapping refcodes (AXADAF, IYASUW, LAFHEH, LILDEP). Because KRR/FCHL predictions interpolate from training environments, including these molecules in the test set makes a portion of the reported held-out error in-sample. Second, the variance-filter thresholds are explicitly chosen to optimize accuracy on the test set and then evaluated on that same test set, making the filtered metrics partially tuned rather than predictive. Third, the 1JCH experimental comparison inherits a 10.91 Hz offset fitted to the same experimental dataset later used for validation, so the IMPRESSION-vs-experiment agreement is partly calibrated. These issues do not make the entire derivation equivalent to its inputs — the unfiltered learning curves, external DP4 and Venkata validations, and strychnine discrimination provide independent content — but they do mean the headline quantitative claims need recomputation on a truly disjoint test set with fixed filters and independently derived offsets. A score of 6 reflects this partial circularity: several reported 'held-out' or 'filtered' predictions reduce, at least in part, to training or tuning on the evaluation data.
Assumptions & free parameters
free parameters (5)
- Kernel width sigma (Laplacian kernel) =
not reported
- l2 regularization lambda =
not reported
- Atomic environment cutoff radius =
not reported
- 1JCH DFT-to-experiment offset =
10.91 Hz
- Variance filter cutoffs =
0.1 ppm (1H), 5 ppm (13C), 1 Hz (1JCH)
assumptions (5)
- standard math Kernel ridge regression with a Laplacian (or FCHL) kernel provides a valid similarity measure for atomic environments.
- domain assumption FCHL representations encode the chemical environment of each nucleus well enough for NMR parameter prediction.
- domain assumption DFT at the omegaB97XD/6-311G(d,p) level with GIAO and the 'mixed' option yields NMR parameters accurate enough to serve as training targets and reference values.
- domain assumption The 882 adaptively sampled CSD structures (C,H,N,O,F only) are representative of the chemical space of target molecules.
- domain assumption Using a single conformer per molecule for DFT and IMPRESSION comparisons is sufficient to demonstrate relative accuracy.
Cite this review
Pith. "Pith review of IMPRESSION -- Prediction of NMR Parameters for 3-dimensional chemical structures using Machine Learning with near quantum chemical accuracy." pith.science (2026). https://pith.science/paper/UL5RYU3F
@misc{pith2026190808501,
author = {Pith},
title = {Pith review of: IMPRESSION -- Prediction of NMR Parameters for 3-dimensional chemical structures using Machine Learning with near quantum chemical accuracy},
year = {2026},
howpublished = {\url{https://pith.science/paper/UL5RYU3F}},
note = {Machine review of arXiv:1908.08501}
}
read the original abstract
The IMPRESSION (Intelligent Machine PREdiction of Shift and Scalar Information Of Nuclei) machine learning system provides an efficient and accurate route to the prediction of NMR parameters from 3-dimensional chemical structures. Here we demonstrate that machine learning predictions, trained on quantum chemical computed values for NMR parameters, are essentially as accurate but computationally much more efficient (tens of milliseconds per molecule) than quantum chemical calculations (hours/days per molecule). Training the machine learning systems on quantum chemical, rather than experimental, data circumvents the need for existence of large, structurally diverse, error-free experimental databases and makes IMPRESSION applicable to solving 3-dimensional problems such as molecular conformation and isomerism
Reference graph
Works this paper leans on
-
[5]
53 T. E. Oliphant, A guide to NumPy , Trelgol Publishing USA, 2006, vol
work page 2006
-
[9]
32 R. Laskowski, P. Blaha and F. Tran, CHESHIRE Chemical Shift Repository, 2019 (accessed October 2nd, 2019). 33 H. S. Seung, M. Opper and H. Sompolinsky , Proc. 5th Ann. Work. Comp. Learn. Theory , New York, NY, USA, 1992, pp. 287–294. 34 M. Gastegger, J. Behler and P. Marquetand, Chem. Sci., 2017, 8, 6924–6935. 35 J. S. Smith, B. Nebgen, N. Lubbers, O. ...
work page 2019
-
[14]
54 L. Dagum and R. Menon, Comput. Sci. Eng. , 1998, 46–55. 55 P. Peterson, Int. J. Comput. Sci. Eng. , 2009, 4, 296–305. 8 | 1–8 Supplementary Information for IMPRESSION - Prediction of NMR Parameters using Machine Learning with near-DFT accuracy Will Gerrard, Lars Andersen Bratholm, Martin Packer, Adrian Mulholland, David Glowacki, Craig Butts Contents S...
work page Pith review arXiv 1998
-
[24]
While more demanding com- putational methods could be considered 25, their computational cost would be extortionate with minimal improvement in out- comes for the training and testing datasets described. Instead we found that using mPW1PW91/6-311g(d,p) for optimisation and ωb97xd/6-311g(d,p) 26–30 for computing the NMR param- eters was computationally effi...
work page 2018
-
[33]
52 N. M. O’Boyle, C. Morley and G. R. Hutchison,Chem. Cent. J., 2008, 2,
work page 2008
-
[1998]
38 Y. Binev and J. Aires-de Sousa, J. Chem. Inf. Comput. Sci. , 2004, 44, 940–945. 39 Y. Binev, M. M. Marques and J. Aires-de Sousa, J. Chem. Inf. Model., 2007, 47, 2089–2097. 40 M. Rupp, R. Ramakrishnan and O. A. Von Lilienfeld, J. Phys. Chem. Lett., 2015, 6, 3309–3313. 41 B. Huang and O. A. von Lilienfeld, arXiv preprint arXiv:1707.04146,
arXiv 2004
-
[2006]
22 F. M. Paruzzo, A. Hofstetter, F. Musil, S. De, M. Ceriotti and L. Emsley ,Nat. Commun., 2018, 9,
work page 2018
-
[2013]
2 W. Bremser, Anal. Chim. Acta , 1978, 103, 355–365. 3 S. Kuhn and S. R. Johnson, ACS Omega, 2019, 4, 7323–7329. 4 J. Aires-de Sousa, M. C. Hemmer and J. Gasteiger, Anal. Chem., 2002, 74, 80–90. 5 A. V. Buevich, J. Saurí, T. Parella, N. De Tommasi, G. Bifulco, R. T. Williamson and G. E. Martin,Chem. Commun., 2019, 55, 5781–5784. 6 J. Meiler, W. Maier, M. ...
work page 1978
Show all 13 references
-
[2016]
25 A. M. Teale, O. B. Lutnæs, T. Helgaker, D. J. Tozer and J. Gauss, J. Chem. Phys. , 2013, 138, 024111. 26 C. Adamo and V. Barone, J. Chem. Phys., 1998, 108, 664–675. 27 A. McLean and G. Chandler, J. Chem. Phys. , 1980, 72, 5639–
2013
-
[2017]
42 F. A. Faber, A. S. Christensen, B. Huang and O. A. von Lilien- feld, J. Chem. Phys. , 2018, 148, 241717. 43 A. S. Christensen, L. A. Bratholm, S. Amabilino, J. C. Kro- mann, F. A. Faber, B. Huang, A. Tkatchenko, K. R. MÃijller and O. A. von Lilienfeld, QML: A Python T oolki...
2018
-
[2019]
acdlabs.com/products/adh/nmr/nmr_pred/
18 NMR Prediction Software from ACD/Labs , https://www. acdlabs.com/products/adh/nmr/nmr_pred/. 19 NMR Prediction Software from Mestrelab , https: //mestrelab.com/software/mnova/nmr-predict/. 20 A. M. Castillo, A. Bernal, R. Dieden, L. Patiny and J. Wist, J. Cheminf., 2016, 8,
2016
-
[4501]
Venkata, M
23 C. Venkata, M. J. Forster, P. W. Howe and C. Steinbeck, PLOS ONE, 2014, 9, e111576. 24 M. Frisch, G. Trucks, H. Schlegel, G. Scuseria, M. Robb, J. Cheeseman, G. Scalmani, V. Barone, B. Mennucci, G. Peters- son and s. S. S. o. S. I. others (for the full reference, Walling- ford, CT,
2014
-
[5648]
Krishnan, J
28 R. Krishnan, J. S. Binkley , R. Seeger and J. A. Pople, J. Chem. Phys., 1980, 72, 650–654. 29 J.-D. Chai and M. Head-Gordon, J. Chem. Phys. , 2008, 128, 084106. 30 W. Deng, J. R. Cheeseman and M. J. Frisch, J. Chem. Theory Comput., 2006, 2, 1028–1037. 1–8 | 7 31 P. B. Wilso...
1980
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.