REVIEW 3 major objections 4 minor 37 references
Path optimization cures the sign problem only where cancellation does not dominate, and the paper shows why.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · deepseek-v4-flash
2026-08-01 22:26 UTC pith:EDX4VFV7
load-bearing objection A careful, honest numerical study with a solid high-μ result and an underdetermined negative claim: the failure at low μ and in the ChRM model may be an artifact of the untested Jacobian-free approximation. the 3 major comments →
Path optimization method for the sign problem: Insights from random matrix models
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
In the Stephanov model with N=4 and N=6, the neural-network-parametrized integration path substantially raises the average phase factor at high chemical potential (around µ=1.2), so that the chiral condensate and number density match the analytic values with smaller statistical errors. At low chemical potential (e.g., µ=0.2) the method does not improve the average phase factor, and in the chiral random matrix model it fails at all µ tested. Scatter plots of the phase-weighted number density show that in the failing cases the analytic value emerges only through severe cancellation of positive and negative contributions—a signature of the global sign problem associated with the Silver Blaze ph
What carries the argument
The central object is a neural network that maps the real dynamical variables to the imaginary part of a complexified integration path, trained by minimizing a cost function equal to the phase-weighted variance of e^{iθ}. Observables are then computed by phase reweighting on the modified path. The Jacobian of the complexification is omitted in both the hybrid Monte Carlo update and the training, following earlier work. The diagnostic that carries the argument is the scatter plot of Re[n e^{iθ}] versus θ, which reveals whether the expectation value is produced by local concentration near zero phase or by global cancellation of positive and negative contributions.
Load-bearing premise
The load-bearing premise is that skipping the Jacobian in both the hybrid Monte Carlo update and the neural-network training is harmless; the paper adopts this from earlier work but never tests it in the regimes where the method fails.
What would settle it
Evaluate the same path optimization with the full Jacobian included in the low-µ Stephanov model (e.g., µ=0.2, N=4) and in the chiral random matrix model, and compare the average phase factor with the Jacobian-free results. If the average phase factor remains unimproved, the paper's global-sign-problem explanation is supported; if it improves, the Jacobian-free approximation is the culprit.
If this is right
- In the Stephanov model at high µ, the optimized path concentrates configurations near θ=0 and the average phase factor grows, yielding analytic observables with reduced errors.
- In low-µ Stephanov and in the chiral random matrix model, the average phase factor remains essentially unchanged because the required cancellation of positive and negative phase-weighted contributions cannot be removed by path deformation.
- The scatter-plot diagnostic separates regimes where contour deformation works from regimes dominated by the global sign problem, providing a practical way to anticipate whether path optimization will help.
- In Silver-Blaze-type regions, the paper argues that further progress requires extending the cost function or modifying the action, not just reshaping the integration path.
Where Pith is reading between the lines
- If the cancellation diagnosis generalizes, path optimization's benefit may depend on the observable: observables whose expectation is forced by symmetry to be near zero will show little average-phase-factor improvement even when the path is well trained.
- A cheap test of the Jacobian-free approximation would be to rerun the failing low-µ cases with the Jacobian computed exactly for a few configurations; if the average phase factor then improves, the approximation rather than the global sign problem is the limiting factor.
- The scatter-plot method could be turned into a pre-training diagnostic: sample a few configurations on the original path and check whether the phase-weighted distribution is symmetric about zero before committing to full neural-network training.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper applies the path optimization method, a contour-deformation technique with neural-network parameterization, to the Stephanov model and the chiral random matrix (ChRM) model at zero temperature and finite chemical potential. Using hybrid Monte Carlo with a Jacobian-free approximation for both sampling and training, the authors report that, in the Stephanov model with N=4, the average phase factor (APF) is enhanced on the modified path for chemical potentials above 0.2, most strongly at high mu, and that the chiral condensate and number density reproduce the analytic results with reduced statistical errors. At mu=0.2 and in the ChRM model, no clear improvement of the APF is observed. Scatter plots of Re[n exp(i theta)] are used to argue that the lack of improvement arises from the need for cancellation between positive and negative phase-weighted contributions, which they associate with the global sign problem and the Silver Blaze phenomenon.
Significance. If the negative conclusion is correct, the paper provides a useful cautionary insight: path optimization can mitigate the sign problem in regimes where the average phase factor is not already destroyed by cancellations among contributions, but it may fail in cases requiring strong cancellation, such as the ChRM model and weak-signal low-mu regions of the Stephanov model. The high-mu Stephanov result is a positive demonstration that the method can reproduce external analytic formulas with reduced statistical errors. However, the paper's central negative claim is not fully established because it depends on an uncontrolled Jacobian-free approximation in exactly the regimes where the method fails.
major comments (3)
- [Sec. II C and Sec. IV] Eq. (21) defines the cost function using the full phase theta = arg(e^{-S} J) and the Jacobian-weighted measure |J e^{-S}|. The text then states that the Jacobian-free approximation is adopted in both the HMC update and the training process, citing Refs. [22,23]. The negative conclusions for the Stephanov model at mu=0.2 and for the ChRM model are interpreted as consequences of the global sign problem. This inference is load-bearing and assumes that the omitted Jacobian is negligible precisely in the failing regimes. No diagnostic or comparison with full-Jacobian training is provided there. If the Jacobian contributes non-negligibly at small mu or in the ChRM model, the trained path is suboptimal and the failure is an artifact of the approximation, not an intrinsic property of path optimization. A numerical test with the full Jacobian at representative points, or at least an estimate of
- [Abstract; Sec. IV A, Fig. 1] The abstract claims that the method 'fails to improve the average phase factor in the Stephanov model at low chemical potential,' but Sec. IV A states that the APF is enhanced for all mu except mu=0.2. At mu=0.2 the original-path APF is already close to unity, so the absence of improvement is largely a ceiling effect. At moderate mu (about 0.4-0.8) there is visible enhancement, albeit less pronounced than at high mu. The abstract and the summary in Sec. V overstate the negative result. The claim should be restricted to mu=0.2 or rephrased as 'less pronounced improvement at low and moderate mu.'
- [Sec. IV A, Figs. 2-3] The scatter-plot argument that cancellation between positive and negative Re[n exp(i theta)] inevitably defeats path optimization is not compelling as presented. The configurations shown are generated on the trained path; the same pattern would appear if the training had not converged to the true optimum or if the network lacked sufficient expressiveness to represent the required contour. The observation is consistent with the global-sign-problem interpretation, but it does not distinguish that mechanism from a suboptimal-path artifact. A constructive test would be to compare the APF obtained with larger network capacity or with full-Jacobian training in the failing regimes.
minor comments (4)
- [Figs. 4 and 6 captions] The captions say 'result are' instead of 'results are' in Figs. 4 and 6.
- [Figs. 1-6] Statistical uncertainties on the APF are not displayed, although the Jackknife procedure is described in Sec. III. Since the claims concern the presence and size of APF improvement, error bars (or a statement that errors are negligible on the shown scale) should be included.
- [Sec. IV A, Fig. 4] For N=6, the text notes that the ergodicity problem is serious and results 'occasionally deviate from the analytical values.' These deviations are not quantified; the paper should specify at which mu and by how much, or restrict the validation claim to N=4.
- [Sec. II B, Eq. (16)] The notation D12D21 is slightly ambiguous because D12 and D21 are block matrices; writing their matrix product with explicit indices would improve clarity.
Circularity Check
No material circularity: the observable benchmark is external analytic results; only the APF metric is the training objective by Eq. (21), and the Jacobian-free approximation is a self-cited but externally testable assumption.
specific steps
-
self definitional
[Sec. II C, Eq. (21)]
"F = 1/2 ∫ dv_R |e^{iθ(v_R)} − e^{iθ_0}|^2 |J(v_R) e^{−S(v')}| = |Z| [⟨e^{iθ}⟩_{pq}^{−1} − 1], where θ = arg(e^{−S+ln J}), ⟨e^{iθ}⟩_{pq} represents the average phase factor (APF)"
By construction, minimizing F is equivalent to maximizing the APF ⟨e^{iθ}⟩_{pq}. Thus the report that the modified path 'successfully improves the average phase factor' at high µ is a restatement of the training objective rather than an independent prediction. The statement is not fully vacuous because the method fails to improve APF at low µ and in the ChRM model, so the optimization does not always reach the objective. The independent validation is instead the reproduction of the analytic ⟨σ⟩ and ⟨n⟩, which are external formulas and not fitted. This makes the APF step a minor definitional feature, not a circular derivation of the central results.
full rationale
The paper's central numerical validation is comparison with analytic results for the Stephanov model (Eqs. (9)-(10)) and the known µ-independence of the ChRM model; these are not fitted parameters, so the success/failure pattern is an independent empirical finding. The only respect in which a reported quantity is built into the method is the APF itself, since Eq. (21) defines the training cost as |Z|(APF^{-1}−1); this makes APF improvement the training goal, but the paper's more important claims concern observables and the regimes where training does not improve the APF. The Jacobian-free approximation is adopted from Refs. [22,23], which are self-citations, but those works are separate numerical studies and the approximation is externally testable; the concern that it may be non-negligible in the failing regimes (low µ and ChRM) is a substantive correctness risk, not a circularity. No uniqueness theorem is imported from the authors, no ansatz is smuggled in via citation, and the scatter-plot interpretation of the global sign problem is presented as a plausible mechanism rather than derived from the model. Overall, the derivation chain is self-contained against external benchmarks, with only a minor definitional overlap between the cost function and the APF metric.
Axiom & Free-Parameter Ledger
free parameters (1)
- Neural network hyperparameters (learning rate 1e-4–1e-3, batch size 64, 20 epochs, weight-init scale 0.2, 3 layers, unit
axioms (5)
- standard math Cauchy's integral theorem permits arbitrary contour deformation as long as boundary terms vanish
- domain assumption The Jacobian-free approximation has negligible effect on training and HMC updates
- domain assumption The neural network is expressive enough to represent the optimal integration path
- standard math Analytic formulas (9) and (10) for ⟨σ⟩ and ⟨n⟩ are correct
- standard math Phase reweighting with regenerated configurations is unbiased
read the original abstract
The path optimization method is applied to the Stephanov model and the chiral random matrix model, both of which share several properties with QCD, to mitigate the sign problem caused by the fermion determinant. The Stephanov model serves as a prototypical model of finite-density QCD, while the chiral random matrix model represents an ideal system featuring the Silver Blaze phenomenon. We show that the path optimization successfully improves the average phase factor in the Stephanov model at high chemical potential, reproducing the analytical results with reduced statistical errors. However, it fails to improve the average phase factor in the Stephanov model at low chemical potential, as well as in the chiral random matrix model. This tendency in the phase factor behavior seems to be closely related to the global sign problem.
Figures
Reference graph
Works this paper leans on
-
[1]
de Forcrand, PoS LA T2009, 010 (2009), arXiv:1005.0539 [hep-lat]
P. de Forcrand, PoS LA T2009, 010 (2009), arXiv:1005.0539 [hep-lat]
Pith/arXiv arXiv 2009
-
[2]
Nagata, (Soryusironkenkyu) 31, 1 (2020) ; Prog
K. Nagata, (Soryusironkenkyu) 31, 1 (2020) ; Prog. Part. Nucl. Phys. 127, 103991 (2022) , arXiv:2108.12423 [hep-lat]
Pith/arXiv arXiv 2020
-
[3]
E. Witten, AMS/IP Stud. Adv. Math. 50, 347 (2011), arXiv:1001.2933 [hep-th]
Pith/arXiv arXiv 2011
-
[4]
Duane, A
S. Duane, A. D. Kennedy, B. J. Pendleton, and D. Roweth, Phys. Lett. B 195, 216 (1987)
1987
-
[5]
Y. Mori, K. Kashiwa, and A. Ohnishi, Phys. Rev. D96, 111501 (2017) , arXiv:1705.05605 [hep-lat]
Pith/arXiv arXiv 2017
-
[6]
Y. Mori, K. Kashiwa, and A. Ohnishi, PTEP 2018, 023B04 (2018) , arXiv:1709.03208 [hep-lat]
Pith/arXiv arXiv 2018
-
[7]
A. Alexandru, P. F. Bedaque, H. Lamm, and S. Lawrence, Phys. Rev. D96, 094505 (2017) , arXiv:1709.01971 [hep-lat]
Pith/arXiv arXiv 2017
-
[8]
A. Alexandru, G. Basar, P. F. Bedaque, and N. C. Warrington, Rev. Mod. Phys. 94, 015006 (2022) , arXiv:2007.05436 [hep-lat]
Pith/arXiv arXiv 2022
-
[9]
M. A. Stephanov, Phys. Rev. Lett. 76, 4472 (1996) , arXiv:hep-lat/9604003
Pith/arXiv arXiv 1996
-
[10]
A. M. Halasz, A. D. Jackson, R. E. Shrock, M. A. Stephanov, and J. J. M. Verbaarschot, Phys. Rev. D 58, 096007 (1998) , arXiv:hep-ph/9804290. 7
Pith/arXiv arXiv 1998
-
[11]
J. Bloch, J. Glesaaen, J. J. M. Verbaarschot, and S. Zafeiropoulos, JHEP 03, 015 (2018) , arXiv:1712.07514 [hep-lat]
Pith/arXiv arXiv 2018
-
[12]
M. Fukuma and N. Matsumoto, PTEP 2021, 023B08 (2021), arXiv:2012.08468 [hep-lat]
Pith/arXiv arXiv 2021
-
[13]
M. Giordano, A. Pasztor, D. Pesznyak, and Z. Tulipant, Phys. Rev. D 108, 094507 (2023) , arXiv:2301.12947 [hep- lat]
Pith/arXiv arXiv 2023
-
[14]
A. Mollgaard and K. Splittorff, Phys.Rev. D88, 116007 (2013), arXiv:1309.4335 [hep-lat]
Pith/arXiv arXiv 2013
-
[15]
A. Mollgaard and K. Splittorff, Phys. Rev. D 91, 036007 (2015), arXiv:1412.2729 [hep-lat]
Pith/arXiv arXiv 2015
-
[16]
T. Ichihara, K. Nagata, and K. Kashiwa, Phys. Rev. D 93, 094511 (2016) , arXiv:1603.09554 [hep-lat]
Pith/arXiv arXiv 2016
-
[17]
G. Baranka and M. Giordano, Phys. Rev. D 110, 074024 (2024), arXiv:2408.12328 [hep-th]
Pith/arXiv arXiv 2024
-
[18]
J. Bloch, F. Bruckmann, M. Kieburg, K. Splittorff, and J. J. M. Verbaarschot, Phys. Rev. D 87, 034510 (2013) , arXiv:1211.3990 [hep-lat]
Pith/arXiv arXiv 2013
-
[19]
A. Alexandru, P. F. Bedaque, H. Lamm, and S. Lawrence, Phys. Rev. D 97, 094510 (2018) , arXiv:1804.00697 [hep-lat]
Pith/arXiv arXiv 2018
-
[20]
Szandała, in Bio-inspired neurocomputing (Springer,
T. Szandała, in Bio-inspired neurocomputing (Springer,
-
[21]
D. E. Rumelhart, G. E. Hinton, and R. J. Williams, nature 323, 533 (1986)
1986
-
[22]
Y. Namekawa, K. Kashiwa, H. Matsuda, A. Ohnishi, and H. Takase, Phys. Rev. D 107, 034509 (2023) , arXiv:2210.05402 [hep-lat]
Pith/arXiv arXiv 2023
-
[23]
K. Hisayoshi, K. Kashiwa, Y. Namekawa, and H. Takase, Phys. Rev. D 111, 094503 (2025) , arXiv:2502.02804 [hep- lat]
Pith/arXiv arXiv 2025
-
[24]
R. H. Swendsen and J.-S. Wang, Physical review letters 57, 2607 (1986)
1986
-
[25]
C. J. Geyer, Computing science and statistics: Proceed- ings of 23rd Symposium on the Interface Interface Foun- dation, Fairfax Station, 1991 , 156 (1991)
1991
-
[26]
Hukushima and K
K. Hukushima and K. Nemoto, Journal of the Physical Society of Japan 65, 1604 (1996)
1996
-
[27]
K. Kashiwa and Y. Mori, Phys. Rev. D 102, 054519 (2020), arXiv:2007.04167 [hep-lat]
Pith/arXiv arXiv 2020
-
[28]
Paszke, S
A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein, L. Antiga, et al., Advances in neural information processing systems 32 (2019)
2019
- [29]
-
[30]
Glorot and Y
X. Glorot and Y. Bengio, Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics , 249 (2010)
2010
-
[31]
I. Loshchilov and F. Hutter, in International Conference on Learning Representations (2019) arXiv:1711.05101 [cs.LG]
Pith/arXiv arXiv 2019
- [32]
-
[33]
Bottou, Online learning in neural networks (1998)
L. Bottou, Online learning in neural networks (1998)
1998
-
[34]
T. D. Cohen, Phys. Rev. Lett. 91, 222001 (2003) , arXiv:hep-ph/0307089
Pith/arXiv arXiv 2003
-
[35]
T. M. Doi and S. Tsutsui, Phys. Rev. D 96, 094511 (2017), arXiv:1709.05806 [hep-lat]
Pith/arXiv arXiv 2017
-
[36]
M. Fukuma and N. Umeda, PTEP 2017, 073B01 (2017) , arXiv:1703.00861 [hep-lat]
Pith/arXiv arXiv 2017
-
[37]
S. Lawrence and Y. Yamauchi, Phys. Rev. D 107, 114505 (2023), arXiv:2212.14606 [hep-lat]
Pith/arXiv arXiv 2023
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.