Pith. sign in

REVIEW 3 major objections 2 minor 1 cited by

Simulation-based inference from the Lyman-alpha forest 1D power spectrum with CAMELS

T0 review · 3 major / 2 minor · reviewed 2026-07-14 · grok-4.5

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Training a neural posterior on both IllustrisTNG and SIMBA recovers unbiased Ωm and σ8 from the Lyman-α forest 1D power spectrum; training on one model alone biases σ8 by about 10% on the other.

desk verdict Clean first SBI result on Lyman-α P1D: same-model NPE works, cross-model biases σ8 by ~10%, multi-domain TNG+SIMBA training removes that bias—but only inside that closed pair, and we only have the abstract. read the letter →

arxiv 2603.13011 v2 pith:5YPGY6LL submitted 2026-03-13 astro-ph.CO

Francesco Sinigaglia , Patricia Iglesias-Navarro , Matteo Viel This is my paper · ORCID
classification astro-ph.CO
keywords Lyman-alphaforestsimulation-basedinferencenormalizingflowsCAMELSneuralposteriorestimationbaryonicfeedbackΩmσ8
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper shows that full simulation-based inference can be run on the Lyman-α forest one-dimensional power spectrum using CAMELS hydrodynamic simulations. A normalizing flow is trained to estimate the posterior on two cosmological parameters (Ωm and σ8) and four astrophysical feedback parameters from P1D(k) at redshifts 2.0–3.5. When the network is trained and tested on the same galaxy-formation model, cosmological posteriors recover the true values to better than 10% in most cases, while astrophysical parameters stay largely unconstrained because of the small simulated volume. Cross-model tests (train on IllustrisTNG, test on SIMBA, or the reverse) produce a roughly 10% positive bias on σ8. Combining both simulation suites in multi-domain training removes that bias. The result is offered as a practical route to cosmological constraints from the Lyman-α forest that does not assume a single baryonic-physics model is correct.

What carries the argument

Neural posterior estimation with a normalizing flow trained on CAMELS P1D(k) spectra; multi-domain training that pools IllustrisTNG and SIMBA so the learned posterior is not locked to one baryon-physics implementation.

What would settle it

Hold out a third independent hydrodynamic suite (or real survey P1D measurements with known truth from a blinded cosmology), train only on the IllustrisTNG+SIMBA pool, and check whether the recovered σ8 still lies within the claimed unbiased interval or reappears with a systematic offset of order 10%.

Watch

Extended reading notes

Core claim

When a normalizing flow is trained jointly on IllustrisTNG and SIMBA realizations of the Lyman-α forest P1D(k), neural posterior estimation returns unbiased constraints on Ωm and σ8; single-model training yields a ~10% positive bias on σ8 when the network is evaluated on the other model.

Load-bearing premise

That the two galaxy-formation models together cover enough of the real range of supernova and AGN feedback that the multi-domain posterior will stay unbiased on real data or on any third, unseen simulation suite.

Editorial extensions

If this is right

  • Cosmological inference from Lyman-α P1D can proceed without committing to a single sub-grid feedback model if both major CAMELS suites are used for training.
  • Cross-model bias of ~10% on σ8 is a concrete, measurable diagnostic of baryonic-model mismatch for any future emulator or likelihood pipeline.
  • Astrophysical feedback parameters remain poorly constrained by P1D alone at the volumes simulated here, so joint probes will still be needed for SN/AGN physics.
  • The same multi-domain recipe can be applied to other summary statistics of the Lyman-α forest once they are available in CAMELS.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If a third, substantially different feedback implementation (e.g., a future CAMELS variant) reintroduces bias after multi-domain training, the method will need explicit domain-adaptation layers rather than simple data pooling.
  • The unconstrained astrophysical parameters suggest that P1D at these redshifts mainly encodes large-scale cosmology; adding higher-order or transverse statistics could break the remaining degeneracies.
  • Blind application to DESI or other survey P1D without an external truth test would still leave open the possibility that real baryonic physics lies outside the IllustrisTNG–SIMBA span.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 2 minor

Summary. The abstract claims the first full simulation-based inference (neural posterior estimation with a normalizing flow) on the Lyman-α forest 1D power spectrum P1D(k) at 2.0<z<3.5, using CAMELS hydrodynamic simulations with IllustrisTNG and SIMBA. Same-model train/test recovers Ωm and σ8 to better than ~10% precision with high accuracy, while four SN/AGN feedback parameters remain unconstrained (attributed to limited volume). Cross-model tests produce a ~10% positive bias on σ8; multi-domain training on the union of both models is reported to restore unbiased cosmological constraints. The supplied full manuscript body, however, is an unrelated cond-mat paper on ultrametricity of a toy protein energy landscape (arXiv:2603.13012), so none of the claimed methods, figures, coverage tests, or multi-domain results can be verified from the provided text.

Significance. If the abstract’s results hold under proper scrutiny, the work would be a useful step for cosmology with the Lyman-α forest: it demonstrates that neural posterior estimation can extract competitive Ωm–σ8 constraints from P1D and that multi-domain training can mitigate known non-convergence between galaxy-formation models. That would be practically relevant for DESI/WEAVE-style analyses and for the broader SBI literature on baryonic systematics. The contribution cannot be credited as demonstrated until the correct manuscript, diagnostics, and external-validation tests are available.

major comments (3)
  1. The full text provided under this submission is not the Lyman-α / CAMELS paper: it is a complete, unrelated manuscript on ultrametricity of a disordered heteropolymer energy landscape (protein prototype, N=128, replica overlaps via Pearson correlation of pairwise energies). No sections, equations, figures, or tables corresponding to the abstract’s claims exist in the supplied body. A technical review of training protocol, architecture, posterior calibration, coverage, or multi-domain procedure is therefore impossible. The correct manuscript must be supplied before any scientific assessment can proceed.
  2. From the abstract alone: the central claim that multi-domain (TNG+SIMBA) training recovers unbiased Ωm and σ8 is only stated for held-out draws from the same two models. There is no reported test on a third independent hydro suite or on real data. If TNG and SIMBA share residual IGM/feedback systematics not spanned by the four SN/AGN parameters, multi-domain training can remain biased while appearing calibrated inside the closed pair. This is load-bearing for the claim that multi-domain training is an “effective solution” to lack of convergence between galaxy-formation models.
  3. The abstract states that the four astrophysical parameters are “generally unconstrained due to the limited probed volume.” That leaves open residual baryonic degeneracy with σ8 (and possibly Ωm). Without published coverage tests, TARP/SBC diagnostics, or explicit checks that the multi-domain posterior remains calibrated when feedback parameters are free, the reported ~10% de-biasing of σ8 cannot be taken as robust against unmodeled baryonic physics.
minor comments (2)
  1. Abstract phrasing “within 10% deviations in ≳75% and ≳90% of the cases for Ωm and σ8, and a precision better than 10% in both” should be clarified (fraction of test realizations vs. typical posterior width; absolute vs. relative error).
  2. When the correct manuscript is provided, please ensure figure captions and tables report the exact train/test splits, number of CAMELS realizations per model, k-range and redshift binning of P1D, and the precise multi-domain mixing procedure.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: standard simulation-based NPE train/test on known CAMELS labels; multi-domain de-biasing is an empirical result, not forced by construction.

full rationale

The Lyman-α abstract describes a conventional neural posterior estimation pipeline: a normalizing flow is trained on CAMELS hydrodynamic simulations (IllustrisTNG and/or SIMBA) whose cosmological and astrophysical parameters are known by construction of the simulation suite, then evaluated on held-out draws. Same-model recovery, cross-model bias (~10% on σ8), and multi-domain recovery of unbiased Ωm/σ8 posteriors are empirical performance statements about that train/test protocol. Nothing in the claimed chain defines the target parameters in terms of the network output, fits a free parameter to the reported recovery metric and then re-labels it as a prediction, or imports a uniqueness theorem that forces the multi-domain result. Using the same simulation family for both training labels and test ground truth is ordinary SBI methodology, not circular reduction. The supplied full manuscript body is an unrelated protein-ultrametricity paper and cannot be used to audit equations or self-citations of 2603.13011; on the abstract alone there is no load-bearing circular step. Scope concerns (generalization beyond the TNG–SIMBA closed pair) are external-validity issues, not circularity.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

Abstract-only review. Load-bearing premises are the usual SBI assumptions plus the claim that the two CAMELS galaxy-formation models adequately bracket real baryonic uncertainty. No free parameters can be extracted from the abstract; the four astrophysical feedback parameters are latent targets, not fitted constants of the inference method.

assumptions (3)
  • domain assumption IllustrisTNG and SIMBA together span a representative range of supernova and AGN feedback effects on the Lyman-α forest P1D.
    Multi-domain training is presented as the solution to model misspecification; this only works if the two models bracket the true physics.
  • domain assumption Neural posterior estimation with a normalizing flow yields well-calibrated posteriors when trained on the CAMELS simulation suite.
    Standard SBI assumption; not independently verified in the abstract.
  • ad hoc to paper The limited simulation volume is the reason astrophysical parameters remain unconstrained.
    Stated as explanation in the abstract without quantitative volume-scaling tests visible here.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Simulation-based inference from the Lyman-alpha forest 1D power spectrum with CAMELS." pith.science (2026). https://pith.science/paper/5YPGY6LL

@misc{pith2026260313011,
  author       = {Pith},
  title        = {Pith review of: Simulation-based inference from the Lyman-alpha forest 1D power spectrum with CAMELS},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/5YPGY6LL}},
  note         = {Machine review of arXiv:2603.13011}
}
abstract

We perform for the first time full simulation-based inference on the Lyman-$\alpha$ forest 1D power spectrum. In particular, we consider the prediction of the Lyman-$\alpha$ forest $P_{\rm 1D}(k)$ at $2.0<z<3.5$ from the CAMELS cosmological hydrodynamic simulations run with the IllustrisTNG and SIMBA galaxy formation models. We train a normalizing flow to perform neural posterior estimation of two cosmological parameters ($\Omega_m$ and $\sigma_8$) and four astrophysical parameters parametrizing supernova and AGN feedback. When training and testing the neural network on the same baryon physics model, the posterior distributions of the cosmological parameters are found to be in excellent agreement with the true parameters values (within $10\%$ deviations in $\gtrsim 75\%$ and $\gtrsim 90\%$ of the cases for $\Omega_m$ and $\sigma_8$, and a precision better than $10\%$ in both), while the astrophysical parameters are generally unconstrained due to the limited probed volume. When training on one model and testing on the other (e.g., training on IllustrisTNG and testing on SIMBA, or viceversa), the performance is significantly worse, both in accuracy and in precision, resulting in a $\sim 10\%$ positive bias on the predicted values for $\sigma_8$. We show that a multi-domain training based on the combination of simulations from both models recovers unbiased constraints, offering an effective solution to cope with the complex problem of the lack of convergence in the predictions from different galaxy formation models. This study represents a promising way forward to constrain cosmology and fundamental physics with the Lyman-$\alpha$ forest with artificial intelligence.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Field-level multi-tracers simulation-based inference of cosmological parameters from 3D maps

    astro-ph.CO 2026-05 unverdicted novelty 7.0 of 10

    The work demonstrates that multi-tracer field-level SBI on galaxy and HI maps yields 2-7 times better constraints on Omega_m and sigma_8 than single-tracer or summary-statistic approaches, with 3D maps performing best.

Reference graph

Works this paper leans on

37 extracted references · 17 canonical work pages · cited by 1 Pith paper

  1. [1]

    Parisi, Infinite number of order parameters for spin-glasses , Phys

    G. Parisi, Infinite number of order parameters for spin-glasses , Phys. Rev. Lett. 43 (1979) 1754-1756. https://doi.org/10.1103/PhysRevLett.43.1754 1 , 2 23

    doi:10.1103/physrevlett.43.1754 1979

  2. [2]

    Parisi, A sequence of approximated solutions to the SK model f or spin glasses, Journal of Physics A: Mathematical and General 13 (4) ( 1980) L115

    G. Parisi, A sequence of approximated solutions to the SK model f or spin glasses, Journal of Physics A: Mathematical and General 13 (4) ( 1980) L115. https://doi.org/10.1088/0305-4470/13/4/009 1 , 2

    doi:10.1088/0305-4470/13/4/009 1980

  3. [3]

    M´ ezard, G

    M. M´ ezard, G. Parisi, N. Sourlas, G. Toulouse, M. Virasoro, Na- ture of the spin-glass phase. Phys. Rev. Lett. 52 (1984) 1156-1 159. https://doi.org/10.1103/PhysRevLett.52.1156 1 , 2

    doi:10.1103/physrevlett.52.1156 1984

  4. [4]

    Rammal, G

    R. Rammal, G. Toulouse, M.A. Virasoro, Ultrametricity for physicis ts, Rev. Mod. Phys. 58(3) (1986) 765-788. https://doi.org/10.1103/RevModPhys.58.765 1

    doi:10.1103/revmodphys.58.765 1986

  5. [5]

    Talagrand, Spin Glasses: A Challenge for Mathematicians, Berlin : Springer, 2003

    M. Talagrand, Spin Glasses: A Challenge for Mathematicians, Berlin : Springer, 2003. 1

    2003

  6. [6]

    Talagrand, Michel

    M. Talagrand, Michel. The Parisi Formula, Annals of Mathematics 1 63 (1) (2006) 221–

    2006

  7. [7]

    http://www.jstor.org/stable/20159953 1

    arXiv

  8. [8]

    Talagrand, Mean Field Models for Spin Glasses, Berlin: Springer, 2011

    M. Talagrand, Mean Field Models for Spin Glasses, Berlin: Springer, 2011. 1

    2011

Show all 37 references
  1. [9]

    Panchenko, The Parisi ultrametricity conjecture, Annals of Mathematics 177 (1) (2012) 383-393

    D. Panchenko, The Parisi ultrametricity conjecture, Annals of Mathematics 177 (1) (2012) 383-393. http://www.jstor.org/stable/23350562 1

    2012

  2. [10]

    Panchenko, The Sherrington-Kirkpatrick Model, New York: S pringer, 2013

    D. Panchenko, The Sherrington-Kirkpatrick Model, New York: S pringer, 2013. 1

    2013

  3. [11]

    Panchenko, Structure of 1-RSB asymptotic Gibbs measure s in the di- luted p-spin models, Journal of Statistical Physics 162 (1) (2015) 1-22

    D. Panchenko, Structure of 1-RSB asymptotic Gibbs measure s in the di- luted p-spin models, Journal of Statistical Physics 162 (1) (2015) 1-22. https://doi.org/10.1007/s10955-014-0955-5 1

    2015 doi

  4. [12]

    Subag, Free energy landscapes in spherical spin glasses, Du ke Mathematical Journal 173 (7) (2024) 1291-1357

    E. Subag, Free energy landscapes in spherical spin glasses, Du ke Mathematical Journal 173 (7) (2024) 1291-1357. https://doi.org/10.1215/00127094-2023-0033 1

    2024 doi

  5. [13]

    Ogielski, Dynamics of three-dimensional Ising spin glasses in thermal equilibrium, Physical Review B 32 (11) (1985) 7384-7398

    A.T. Ogielski, Dynamics of three-dimensional Ising spin glasses in thermal equilibrium, Physical Review B 32 (11) (1985) 7384-7398. https://doi.org/10.1103/PhysRevB.32.7384 1 , 5

    1985 doi

  6. [14]

    Marinari, G

    E. Marinari, G. Parisi, J. Ruiz-Lorenzo, F. Ritort, Numerical ev idence for spontaneously broken replica symmetry in 3D spin glasses, Physical review letters, 76 (5) (1996) 843-

    1996

  7. [15]

    https://doi.org/10.1103/PhysRevLett.76.843 1 , 5

    doi

  8. [16]

    S. Franz F. Ricci-Tersenghi, Ultrametricity in three-dimensiona l Edwards- Anderson spin glasses. Physical Review E 61 (2) (2000) 1121-1124 . DOI: https://doi.org/10.1103/PhysRevE.61.1121 1

    2000 doi

  9. [17]

    Contucci, C

    P. Contucci, C. Giardina, C. Giberti, C., G. Parisi, C. Vernia, Ultra metricity in the Edwards-Anderson model. Physical Review Letters 99 (5) (20 07) 057206-057210. https://doi.org/10.1103/PhysRevLett.99.057206 1 , 5

    doi

  10. [18]

    Katzgraber, A.P

    H.G. Katzgraber, A.P. Young, Probing the Almeida-Thouless line in spin glasses, Physical Review B 72 (18) (2006) 184416-1-184416- 5. https://doi.org/10.1103/PhysRevB.72.184416 1 24

    2006 doi

  11. [19]

    Mart ´ ın-Mayor, J.J

    V. Mart ´ ın-Mayor, J.J. Ruiz-Lorenzo, B. Seoane, A.P. Young,Numerical simulations and replica symmetry breaking. In Spin Glass Theory and Far Beyond: Re plica Symmetry Breaking After 40 Years (2023) 69–93. https://doi.org/10.1142/9789811273926 0005 1

    2023 doi

  12. [20]

    Ghofraniha, J.G

    N. Ghofraniha, J.G. Camara, S. Ferretti, S. Gentilini, D. Da Silva, C. Conti, Ob- servation of ultrametricity in photonic spin glasses, Research Squa re Preprint (2025). https://doi.org/10.21203/rs.3.rs-5433512/v1 1

    2025 doi

  13. [21]

    Frauenfelder, F

    H. Frauenfelder, F. Parak, R.D.Young, Conformational subst ates in proteins, An- nual Review of Biophysics and Biophysical Chemistry 17 (1) (1988) 4 51-479. https://doi.org/10.1146/annurev.bb.17.060188.002315 1 , 5

    1988 doi

  14. [22]

    Frauenfelder, S.G

    H. Frauenfelder, S.G. Sligar, P.G. Wolynes, The energy landscap es and motions of proteins, Science 254 (5038) (1991) 1598-1603. https://doi.org/10.1126/science.1749933 1, 5

    1991 doi

  15. [23]

    Frauenfelder, B.H

    H. Frauenfelder, B.H. McMahon, Energy landscape and fluctua tions in proteins, An- nalen der Physik 8 (7-9) (1999) 655-667. https://doi.org/10.1002/andp.200051209-1001 1, 5

    1999 doi

  16. [24]

    Avetisov, A.Kh

    V.A. Avetisov, A.Kh. Bikulov, Protein ultrametricity and spectra l diffusion in deeply frozen proteins, Biophysical Reviews and Letters 3 (3) (20 08) 387-396. https://doi.org/10.1142/S1793048008000836 1

    doi

  17. [25]

    Avetisov, A.Kh

    V.A. Avetisov, A.Kh. Bikulov, S.V. Kozyrev, Application of p-adic analysis to models of spontaneous breaking of replica symmetry, Journal of Physics A: Mathematical and General 32(50) (1999) 8785-8791. https://doi.org/10.1088/0305-4470/32/50/301 1

    1999 doi

  18. [26]

    Avetisov, A.Kh

    V.A. Avetisov, A.Kh. Bikulov, S.V. Kozyrev, V.A. Osipov, p-Adic Models of ultrametric diffusion constrained by hierarchical energy landscapes, Journal of Physics A: Mathe- matical and General 35(2) (2002) 177-189. https://doi.org/10.1088/0305-4470/35/2/301 1

    2002 doi

  19. [27]

    Avetisov, A.Kh

    V.A. Avetisov, A.Kh. Bikulov, A.P. Zubarev, Ultrametricity as a ba sis for organization of protein molecules: CO binding to myoglobin, Vestn. Samar. Gos. Te khn. Univ. Ser. Fiz.-Mat. Nauki, 1(30) (2013) 315-325. https://doi.org/10.14498/vsgtu1154 1

    2013 doi

  20. [28]

    Bikulov, & A.P

    A.Kh. Bikulov, & A.P. Zubarev, Ultrametric theory of conformat ional dynamics of protein molecules in a functional state and the description of exper iments on the kinetics of CO binding to myoglobin, Physica A: Statistical Mechanics and its Ap plications 583 (2021) 126280-1–1...

    2021 doi

  21. [29]

    Shaib, et al

    A.H. Shaib, et al. One-step nanoscale expansion microscopy rev eals in- dividual protein shapes, Nature Biotechnology 43 (2024) 1539-15 47. https://doi.org/10.1038/s41587-024-02431-9 1

    2024 doi

  22. [30]

    Velikson, J

    B. Velikson, J. Bascle, T. Garel, H. Orland, Structural and ultr amet- ric properties of (L-alanine)20, Macromolecules 26 (18) (1993) 47 91–4799. https://doi.org/10.1021/ma00070a010 1 25

    1993 doi

  23. [31]

    Scalco, A

    R. Scalco, A. Caflisch, Ultrametricity in protein folding dynamics, Journal of Chemical Theory and Computation 8 (5) (2012) 1580-1588. https://doi.org/10.1021/ct3000052 1

    2012 doi

  24. [32]

    M. Mele, R. Covino, R. Potestio, Information-theoretical mea sures identify accurate low-resolution representations of protein configurational space , Soft Matter 18 (2022) 7064-7074. https://doi.org/10.1039/d2sm00636g 1

    2022 doi

  25. [33]

    Dill, Theory for the folding and stability of globular proteins, B iochemistry 24 (1985) 1501–1509

    K.A. Dill, Theory for the folding and stability of globular proteins, B iochemistry 24 (1985) 1501–1509. https://doi.org/10.1021/bi00327a032

    1985 doi

  26. [34]

    Metropolis, A.W

    N. Metropolis, A.W. Rosenbluth, M.N. Rosenbluth, A.H. Teller, E. T eller, Equation of state calculations by fast computing machines, J. Chem. Phys. 21 ( 1953) 1087-1092. https://doi.org/10.1063/1.1699114 1

    1953 doi

  27. [35]

    Newman, G.T

    M.E.J. Newman, G.T. Barkema, Monte Carlo Methods in Statistical Physics, Oxford University Press, 1999. 1

    1999

  28. [36]

    Zubarev, On stochastic generation of ultrametrics in high- dimensional Euclidean spaces, p-Adic Numbers, Ultrametric Analysis, and Applications 6 (2) (2014) 1 55-165

    A.P. Zubarev, On stochastic generation of ultrametrics in high- dimensional Euclidean spaces, p-Adic Numbers, Ultrametric Analysis, and Applications 6 (2) (2014) 1 55-165. https://doi.org/10.1134/S2070046614020046 1

    2014 doi

  29. [37]

    A.P. Zubarev, On the ultrametric generated by random distribu tion of points in Eu- clidean spaces of large dimensions with correlated coordinates, Jou rnal of Classification 34 (3) (2017) 366-383. https://doi.org/10.1007/s00357-017-9236-8 1 26

    2017 doi

Pith tools

Reviewed July 14, 2026 · model on record in the stance chip above.