REVIEW 3 major objections 4 minor 26 references
Uncertainty band evaluation of optical potentials and differential cross-sections. Application to $^8$Li + $^{58}$Ni elastic scattering
T0 review · 3 major / 4 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read Standard chi-square fits can be converted into calibrated Bayesian uncertainty bands without running MCMC.
desk verdict The paper's core calibration is wrong—the chi-square goodness-of-fit law is not a likelihood—so the uncertainty bands are not what they claim, though the application is honest and the physics conclusions may survive. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the contour region $\Gamma[b]$ in the $M$-dimensional parameter space defined by $\chi^2_m \le \chi^2(a) \le b$, with $b$ fixed by the desired p-value. The identity that carries the argument is Eq. (5), $p(\Gamma[b]|H) = P(b,L)/P(\chi^2_m,L)$, where $P(b,L)$ is the cumulative chi-square distribution with $L = N-M$ degrees of freedom; this converts chi-square contours into Bayesian credible regions. The companion scaling law, Eq. (12), $\sigma[b](O) = f[b]\,\sigma_{LS}(O)$ with $f[b] = \sqrt{(b-\chi^2_m)/M}$, turns the least-square covariance matrix from a standard fit into the covariance on the contour and then into uncertainty bands for any smooth observable $O(a)$, while the general approach samples the region $\Gamma[b]$ directly and needs no parabolic approximation.
What would settle it
A direct repeated-experiment simulation with known true optical parameters would settle the calibration: generate many synthetic data sets from the fitted model, refit each one, and count how often the true parameters fall inside the recipe's 1-sigma and 2-sigma regions. If the empirical coverage deviates substantially from 31.8% and 4.5%, the identification of the region probability with the chi-square tail is the point to revisit.
Extended reading notes
Core claim
On the paper's own terms, the discovery is that the difference between 'frequentist' and Bayesian uncertainties in optical-model fits is not a philosophical gap but a multiplicative factor. The least-square covariance from the Hessian at the minimum describes only the tangent of the chi-square ellipsoid; regions of higher statistical significance are bigger in covariance by the factor $f[b]$, and the p-value attached to a region $\Gamma[b] = \{a: \chi^2_m \le \chi^2(a) \le b\}$ is $P(b,L)/P(\chi^2_m,L)$ with $L = N-M$ degrees of freedom. The paper derives this from Bayes' theorem applied to the chi-square sampling distribution, and verifies in the $^8$Li + $^{58}$Ni case that the cheap 'simplified' propagation bands match the expensive 'general' sampling bands. The application also establishes a physics conclusion: elastic data around the Coulomb barrier determine $W(r)$ but not $V(r)$ in the 9--10 fm region, so microscopic real potentials cannot be validated by mere agreement, and the 28.7 MeV data are inconsistent with an energy-independent optical model even when parameter uncertainty is included.
Load-bearing premise
The calibration stands or falls on one identification: the probability of the data given a parameter region is the repeated-experiment chi-square tail with $L = N-M$ degrees of freedom, $P(H|\Gamma[b]) = 1 - P(b,L)$, rather than the likelihood $\exp(-\chi^2/2)$.
Editorial extensions
If this is right
- Standard chi-square fitting codes can be upgraded in place: the covariance matrix they already output, multiplied by $f[b]$, gives 1-sigma and 2-sigma bands for parameters and observables.
- Uncertainty bands for optical potentials become narrow around the strong-absorption radius (9--10 fm here) and wide outside it, so elastic angular distributions near the rainbow angle carry most of the constraining power for the real potential.
- A model that fits 'nice' data well but leaves 'nasty' data outside the 2-sigma bands can be rejected as incomplete for those data, even after parameter uncertainty is accounted for.
- Bayesian credible regions shrink when the global chi-square minimum is poor, so the model must first pass a goodness-of-fit check before the bands are interpreted; the paper applies this by excluding the 28.7 MeV data from the nominal fit.
- Complex reaction calculations such as CDCC and coupled-channels evaluations can inherit uncertainty bands from a small number of perturbed runs (about $2M$ calculations) using the same propagation rule.
Reading between the lines
- Editorial inference: the same enhancement-factor prescription should transfer to any smooth functional of the optical parameters, so transfer cross sections, spectroscopic factors, or fusion probabilities could inherit calibrated bands from one optical-model fit plus $2M$ finite-difference runs.
- Editorial inference: because Eq. (12) assumes a parabolic $\chi^2$ surface, the simplified band should be checked against the general band whenever the Hessian-based correlation matrix is large and contours are visibly non-elliptical, as in the $V$--$a_V$ panel here; a disagreement would mean a single covariance matrix cannot summarize the parameter correlations.
- Editorial inference: the paper's finding that the 28.7 MeV residuals lie outside the 2-sigma bands does not by itself tell whether that energy features systematic normalization problems, channel-coupling effects, or a genuine energy dependence, and checking those alternatives is a natural next step with the same band tools.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript presents a method to derive Bayesian uncertainty bands for optical-model potentials and differential cross sections from least-squares fits. After an LS fit provides best-fit parameters and a covariance matrix, regions Γ[b] are defined by χ2m ≤ χ2(a) ≤ b; Eq. (5) assigns a p-value to each region, and either direct sampling (general approach) or an analytic enhancement factor f[b] (simplified approach) produces 1σ and 2σ bands. The method is applied to 8Li + 58Ni elastic scattering, yielding an energy-independent four-parameter fit for the 23.9, 26.1, and 30.0 MeV data, an imaginary potential that is better determined than the real potential in the 9–10 fm region, and a statement that the 28.7 MeV data are inconsistent with the model even within the 2σ bands.
Significance. Should the calibration in Eq. (5) be correct, the method would be valuable: it would produce p-values and uncertainty bands using only standard χ2 codes, without MCMC, and would offer an explanation for the enhancement of frequentist uncertainties relative to Bayesian ones. The paper is clearly written, gives a detailed account of the χ2-surface sampling, and compares the general and simplified approaches on real data. However, the central calibration is statistically invalid; because the p-values, enhancement factors, and all 1σ/2σ band labels derive from Eq. (5), the paper's deliverable of calibrated uncertainty bands is not achieved. The physics application and the qualitative conclusions about the 8Li + 58Ni data may survive a corrected calibration, but the central claim of the method does not.
major comments (3)
- [II.B, Eq. (5), and Appendix A.3, Eq. (A26)] The identification P(H|Γ[b]) = 1 − P(b,L) with L = N − M is incorrect. For a region defined by χ2m ≤ χ2(a) ≤ b, the sampling distribution of χ2(a) − χ2m is a χ2 law with M degrees of freedom (or an F distribution when the variance is estimated), whereas the χ2_{N−M} law of the minimized statistic describes the global goodness of fit at the best-fit point, not the probability of the data conditional on parameters lying in Γ[b]. Consequently Eq. (5), Table I, Table IV, and the f[b] factors in Eq. (12) are all miscalibrated. A direct calculation in the exactly solvable one-parameter normal-location problem shows that the region labeled '1σ' by this recipe contains about 99.8% of the posterior mass, not 68%.
- [Appendix A.3, Eq. (A33)] The derived posterior density PB(a) ∝ −(dP/db)(1/S(b))P0(a) vanishes at the best-fit point because S(b)→0 as b→χ2m, whereas a posterior obtained from the likelihood exp(−χ2(a)/2) would be maximal at the best fit. This internal inconsistency is a direct symptom of using the goodness-of-fit tail as a likelihood, and it means that the 'Bayesian' probability statements in the paper are not posterior probabilities in the usual sense.
- [III.E] The reported narrowing of the uncertainty bands when 'nasty' data are added is presented as a consequence of the Bayesian treatment, but it follows from dividing by P(χ2m,L) in Eq. (5), where P(χ2m,L) is the tail probability of the observed fit statistic. That tail probability is not the model evidence P(H) in Bayes' theorem, so the claimed robustness of the method is an artifact of the miscalibrated normalization rather than a property of a sound Bayesian analysis.
minor comments (4)
- [Table I] The table uses commas as decimal separators in several entries, for example '52,35' and '0,31731'; use decimal points throughout for consistency.
- [Keywords] The keyword list contains a typo, 'maxcimum likelihood', which should be 'maximum likelihood'.
- [II.C, Eqs. (10)–(12)] The notation around Eqs. (10)–(12), especially the accents on the covariance and derivative variables, is garbled in the rendering and should be cleaned up.
- [IV] The paper calls for a benchmark comparison with another Bayesian method; such a benchmark would have been a useful check of Eq. (5) and should be included in any revision.
Circularity Check
No significant circularity: the p-value calibration rests on an explicit, contestable assumption (Eq. A26), not on an input that is equivalent to the output by construction.
full rationale
The derivation chain is self-contained. The least-square covariance (Eq. 1 / Eq. A13) is obtained by error propagation from the data uncertainties; the maximum-likelihood covariance (Eq. 4 / Eq. A21) is an analytic integral over the ellipsoid chi2(a)=b; and the Bayesian p-value (Eq. 5 / Eq. A33) follows from the explicitly stated conditional-probability assumption P(H|Gamma[b]) = 1 - P(b,L) in Eq. A26. Each step is derived in the appendix from stated assumptions rather than imported from a self-citation, and the enhancement factors f[b] and F_B are analytic functions of chi2_m, L, and M, not parameters fitted to the observables whose bands they scale. The contested identification of the data probability given a parameter region with the goodness-of-fit tail probability is a statistical-calibration assumption; if wrong it produces miscalibrated labels, but that is a correctness concern, not circularity. The application itself uses standard chi2 minimization, grid sampling, and error propagation on the same four-parameter Woods-Saxon model, so the bands are honest derived quantities and the paper makes no coverage claim that would be forced by construction. The narrowing of bands with 'nasty' data in Sec. III.E is acknowledged as a direct consequence of the denominator P(chi2_m,L), not a disguised restatement of the data. Self-citations in the bibliography (e.g., refs. [6,17]) are contextual and are not load-bearing; refs. [7,9] are independent external works. No circular step can be exhibited from the paper's own equations.
Assumptions & free parameters
free parameters (6)
- V (real potential depth) =
8.3 +/- 4.5 MeV (3-set fit, r0 = 1.1 fm)
- aV (real diffuseness) =
0.95 +/- 0.16 fm
- W (imaginary potential depth) =
97 +/- 35 MeV
- aW (imaginary diffuseness) =
0.624 +/- 0.036 fm
- r0 (reduced radius) =
1.1 fm, also checked at 1.2 fm
- Gaussian kernel width c (Eq. A22) =
of order 1
assumptions (6)
- domain assumption Experimental cross sections are independent normal variables around the true values with known standard deviations sigma_i and no mutual correlations.
- ad hoc to paper P(H|Gamma[b]) = 1 - P(b, L): the probability of the data given that parameters lie in Gamma[b] is the cumulative chi2_L distribution of the minimized chi2 (L = N - M).
- domain assumption The analysis is data-driven, so the prior P0(a) does not distort the p-value regions.
- standard math The residual-weighted second-derivative terms in the Hessian are negligible (Eqs. A4-A5).
- domain assumption A Woods-Saxon optical potential with fixed reduced radii (r0 = 1.1 or 1.2 fm) and four free parameters (V, aV, W, aW), independent of energy, describes the data at the fitted energies.
- domain assumption The chi2(a) surface is parabolic in the region of interest, so cov[b] = f[b]^2 * cov_LS and the simplified error propagation applies.
Cite this review
Pith. "Pith review of Uncertainty band evaluation of optical potentials and differential cross-sections. Application to $^8$Li + $^{58}$Ni elastic scattering." pith.science (2026). https://pith.science/paper/T5CIZDAQ
@misc{pith2026250711591,
author = {Pith},
title = {Pith review of: Uncertainty band evaluation of optical potentials and differential cross-sections. Application to $^8$Li + $^58$Ni elastic scattering},
year = {2026},
howpublished = {\url{https://pith.science/paper/T5CIZDAQ}},
note = {Machine review of arXiv:2507.11591}
}
abstract
A statistical method is presented to evaluate the uncertainty bands in the optical nucleus-nucleus potential and in differential cross sections. The starting point is the least square fit of a set of experimental values of elastic differential cross sections, varying the relevant optical potential parameters. This is done using standard $\chi^2$ minimization codes, that provide the covariance matrix of the parameters. A maximum likelihood exploration of the $\chi^2$ surface in parameter space allows to determine the covariance matrix of the parameters associated to a contour of a given $\chi^2$ value. Bayes theorem allows to assign probabilities (p-values) to the regions in parameter space, characterized by $\chi^2$ contours. The method allows to obtain uncertainty bands of an arbitrary observables associated to a given p-value using two approaches. The general approach determines the extremes of the observables calculated in the region of parameter space associated to that p-value. This requires an adequate sampling of parameter space, and explicit calculations of the observables on all sampling points. The simplified approach considers uncertainty propagation of the observable in terms of the optical model parameters. This involves the least-square covariance matrix, given by $\chi^2$ minimization codes, and analytically calculated enhancement factors for each p-value. The method, in the general and simplified approaches, is applied to recent measurements of the elastic differential cross sections of $^8$Li + $^{58}$Ni. $1\sigma$ and $2\sigma$ uncertainty bands are obtained for the optical potentials as a function of the distance, and the differential cross sections as a function of the angle. The general and simplified approaches are very similar in this case. The application of the procedure to determine uncertainty bands of complex scattering calculations is discussed.
Figures
Figures from the paper (4 more)
Reference graph
Works this paper leans on
-
[1]
Here we will review the least square (LS) method, following [12]
Least square method . Here we will review the least square (LS) method, following [12]. This is the method used in standard χ2 minimiza- tion codes, such as MINUIT [18], which is used, for example in SFRESCO [16]. These codes minimize the quantity χ2(a), described previously, and so determine the parameters ˆa that make χ2(ˆa) = χ2 m. This minimum defines...
-
[2]
Maximum likelihood method We shall describe here the maximum likelihood method, following [12]. The application of the maximum likelihood method requires the assumption of a The likelihood function L(a) as a function of the parameters. If this function is chosen as L(a) = exp(−χ2(a)/2), then the maximum likelihood method gives the same results as the leas...
-
[3]
Bayesian approach Bayes theorem states P (A|H) = P (H|A) P (H) P (A) (A25) Let us specify this expression for our case. P (A) is the probability that the model that we use has parameters a are in a certain region A of the parameter space. This probability is previous to consideration of the experimental data, so this is the prior probability. P (A|H) is t...
-
[4]
I. J. Thompson, Coupled reaction channels calculations in nuclear physics, Computer Physics Reports 7, 167 (1988)
work page 1988
-
[5]
NuPECC, Nupecc long range plan 2024 for european nuclear physics (2025), arXiv:2503.15575 [nucl-ex]. 21
arXiv 2025
-
[6]
P. Buttle and L. Goldfarb, Neutron transfer in heavy ion reactions, Nuclear Physics 78, 409 (1966)
work page 1966
-
[7]
R. Ascuitto and J. Vaagen, The 50th anniversary of the coupled channels born approximation (ccba) and the coupled reaction channels (crc) theories of nucleon transfer reactions., EPJ H 49, 3 10.1140/epjh/s13129-023-00060-5 (2024)
-
[8]
G. R. Satchler, Direct Nuclear Reaction (Clarendon Press, 1983)
work page 1983
Show all 26 references
-
[9]
Hagino, K
K. Hagino, K. Ogata, and A. Moro, Coupled-channels calculations for nuclear reactions: From exotic nuclei to superheavy elements, Progress in Particle and Nuclear Physics 125, 103951 (2022)
2022
-
[10]
A very important aspect of these works is that they provide uncertainty bands for the theoretical calculations
and to charge exchange reactions [11]. A very important aspect of these works is that they provide uncertainty bands for the theoretical calculations. These bands indicate the expected range of the theoretical calculations, for a given confidence level. In section II we presen...
-
[11]
Rodriguez-Gallardo, J
M. Rodriguez-Gallardo, J. M. Arias, J. Gomez-Camacho, R. C. Johnson, A. M. Moro, I. J. Thompson, and J. A. Tostevin, Four-body CDCC calculations using a transformed harmonic oscillator basis, Phys. Rev. C 77, 064609 (2008), arXiv:0710.0769 [nucl-th]
2008 arXiv
-
[12]
A. E. Lovell, F. M. Nunes, J. Sarich, and S. M. Wild, Uncertainty quantification for optical model parameters, Phys. Rev. C 95, 024611 (2017)
2017
-
[13]
G. B. King, A. E. Lovell, L. Neufcourt, and F. M. Nunes, Direct comparison between bayesian and frequentist uncertainty quantification for nuclear reactions, Phys. Rev. Lett. 122, 232502 (2019)
2019
-
[14]
S¨ urer, F
O. S¨ urer, F. M. Nunes, M. Plumlee, and S. M. Wild, Uncertainty quantification in breakup reactions, Phys. Rev. C 106, 024607 (2022)
2022
-
[15]
A. J. Smith, C. Hebborn, F. M. Nunes, and R. G. T. Zegers, Uncertainty quantification in ( p, n) reactions, Phys. Rev. C 110, 034602 (2024)
2024
-
[16]
Cowan, Statistical Data Analysis (Oxford Science Publication, 1998)
G. Cowan, Statistical Data Analysis (Oxford Science Publication, 1998)
1998
-
[17]
Igo, Phys rev, Phys
G. Igo, Phys rev, Phys. Rev. 115, 1665 (1959)
1959
-
[18]
O. C. B. Santos, R. Lichtenth¨ aler, K. C. C. Pires, U. Umbelino, E. O. N. Zevallos, A. L. de Lara, A. S. Serra, V. Scarduelli, J. Alc´ antara-N´ u˜ nez, V. Guimar˜ aes, A. L´ epine-Szily, J. C. Zamora, A. M. Moro, S. Appannababu, M. Assun ¸ c ao, A. Barioni, R. Linares, V. A....
2021
-
[19]
Sanchez-Ben ´ ıtez, D
A. Sanchez-Ben ´ ıtez, D. Escrig, M. Alvarez, M. Andres, C. Angulo, M. Borge, J. Cabrera, S. Cherubini, P. Demaret, J. Espino, P. Figuera, M. Freer, J. Garcia-Ramos, J. Gomez-Camacho, M. Gulino, O. Kakuee, I. Martel, C. Metelko, A. Moro, F. Perez-Bernal, J. Rahighi, K. Rusek, ...
2008
-
[20]
I. J. Thompson, Coupled Reactions Channles Calculations , Tech. Rep. (University of Surrey, 2006)
2006
-
[21]
Pesudo, M
V. Pesudo, M. J. G. Borge, A. M. Moro, J. A. Lay, E. N´ acher, J. G´ omez-Camacho, O. Tengblad, L. Acosta, M. Al- corta, M. A. G. Alvarez, C. Andreoiu, P. C. Bender, R. Braid, M. Cubero, A. Di Pietro, J. P. Fern´ andez-Garc ´ ıa, P. Figuera, M. Fisichella, B. R. Fulton, A. B. ...
2017
-
[22]
James, MINUIT: Function Minimuzation and Error Analysis , Tech
F. James, MINUIT: Function Minimuzation and Error Analysis , Tech. Rep. (CERN, 1994)
1994
-
[23]
G. D. Greenwade, The Comprehensive Tex Archive Network (CTAN), TUGBoat 14, 342 (1993)
1993
-
[24]
R. C. Johnson, Antisymmetrized, translationally invariant theory of the nucleon optical potential, Phys Rev C 99, 044608 (2019)
2019
-
[25]
R. C. Johnson, Three-body model of the d + a system in an antisymmetrized, translationally invariant many nucleon theory, Phys Rev C 104, 024612 (2021)
2021
-
[26]
R. C. Johnson, Translation invariance and antisymmetry in the theory of the nucleon optical model, Phys Rev C 95, 064610 (2017)
2017
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.