Recognition: 2 theorem links
· Lean TheoremImpact of stellar population models on the estimated physical properties of galaxies
Pith reviewed 2026-05-15 03:04 UTC · model grok-4.3
The pith
The choice of stellar population synthesis model shifts derived galaxy stellar masses by up to 0.6 dex and star formation rates by up to 0.4 dex.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Four widely used stellar population synthesis models were applied via CIGALE to the observed photometry of 17230 galaxies with spectroscopic redshifts. Stellar mass estimates differ by as much as 0.6 dex and star formation rate estimates by as much as 0.4 dex between particular model pairs. Synthetic catalogs confirm that these offsets arise from the model choice itself rather than from noise or fitting artifacts alone.
What carries the argument
Direct comparison of four stellar population synthesis models inside the CIGALE SED-fitting code, applied both to real HST/JWST photometry and to synthetic catalogs generated from each model, to measure the resulting scatter in stellar mass and SFR.
If this is right
- Galaxy evolution studies that adopt different stellar population models cannot be compared at face value without correcting for the systematic offsets.
- Error budgets on stellar mass and SFR must include an additional term that reflects the spread among common SPS models.
- Meta-analyses that pool results from multiple papers need to standardize on one model or apply explicit cross-calibration offsets.
- Conclusions about the growth of stellar mass or the decline of star formation across cosmic time carry an extra uncertainty floor set by model choice.
Where Pith is reading between the lines
- Survey teams releasing large catalogs could publish parallel versions of derived properties using two or three standard SPS models so users can propagate the choice as a systematic.
- The offsets may be larger or smaller for particular galaxy types such as quiescent versus starburst systems, suggesting targeted follow-up on subsamples.
- Future high-redshift studies with JWST could test whether the same model-to-model spread appears at earlier epochs where different stellar libraries dominate.
Load-bearing premise
The CIGALE fitting procedure and the input HST and JWST photometric catalogs contain no additional systematics that could either mask or exaggerate the differences caused by switching between stellar population models.
What would settle it
Re-running the identical photometry through an independent SED-fitting code that uses the same four models, or generating new synthetic catalogs with known input properties and recovering them with each model, would show whether the 0.6 dex and 0.4 dex spreads persist at the reported size.
Figures
read the original abstract
Accurate estimates of fundamental physical properties of galaxies, such as star formation rates (SFRs) or stellar masses, are essential for testing and constraining models of galaxy formation and evolution. Spectral energy distribution (SED) modeling has become the standard method for deriving these quantities. However, the influence of the underlying stellar population synthesis (SPS) models on the inferred parameters remains poorly quantified. This work investigates how the choice of SPS models affects the estimation of SFRs and stellar masses derived from SED modeling. Four widely used SPS models are applied to a sample of 17 230 galaxies with spectroscopic redshifts, selected from recently published Hubble Space Telescope and James Webb Space Telescope photometric catalogs. SEDs are modeled using the Code for Investigating GALaxy Emission. The analysis is performed in two steps: (i) estimating galaxy properties with each SPS model, and (ii) employing synthetic catalogs to assess the relative impact of model choice on the recovered parameters. Systematic differences are found among the models, with stellar mass estimates varying by up to ~ 0.6 dex and SFRs by up to ~ 0.4 dex between certain model pairs. The choice of stellar population model introduces significant systematic uncertainties in derived galaxy properties. This dependence should be accounted for when interpreting SED-based measurements and comparing results across different studies of galaxy evolution.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript claims that the choice of stellar population synthesis (SPS) model introduces significant systematic uncertainties in galaxy stellar mass and star-formation rate (SFR) estimates derived via SED fitting with CIGALE. Applying four SPS models to 17 230 galaxies with spectroscopic redshifts from HST/JWST photometric catalogs, the authors report offsets reaching ~0.6 dex in stellar mass and ~0.4 dex in SFR between certain model pairs. A two-step analysis—direct fitting to real photometry followed by recovery tests on synthetic catalogs—is used to isolate the effect of model choice while holding redshift, photometry, and fitting code fixed.
Significance. If the measured offsets hold, the result is significant for the field: it provides a direct, empirical quantification of SPS-driven systematics that affect fundamental galaxy properties used in evolution studies. The synthetic-catalog step supplies a controlled test that strengthens the central claim by demonstrating that the observed differences arise from model choice rather than from data-specific artifacts. The work therefore supplies a concrete, falsifiable benchmark that future SED analyses can use when comparing results across studies.
major comments (2)
- [§4.2] §4.2 (synthetic catalog construction): the procedure for generating input photometry and noise properties is described only at a high level; it is not shown that the synthetic catalogs reproduce the exact magnitude limits, filter transmission curves, and photometric-error distributions of the real HST/JWST sample. Any mismatch would weaken the claim that the recovered offsets are purely due to SPS model differences.
- [Table 2, §5.1] Table 2 and §5.1: the maximum reported offsets (0.6 dex in mass, 0.4 dex in SFR) are quoted without the corresponding model-pair identifiers or the number of galaxies contributing to each bin; without this information the reader cannot assess whether the extremes are driven by a small subset of objects or by the full sample.
minor comments (4)
- [Abstract] Abstract: the phrase 'up to ~0.6 dex' should explicitly name the two SPS models that produce the largest offset.
- [§2.1] §2.1: the list of the four SPS models should be accompanied by a brief table summarizing their key differences (IMF, stellar libraries, TP-AGB treatment) so that the origin of the observed systematics is transparent.
- [Figure 3] Figure 3 caption: the color coding for the four models is not defined in the caption or legend; readers must cross-reference the text.
- [§6] §6 (discussion): the statement that 'this dependence should be accounted for' would be strengthened by a quantitative recommendation, e.g., a suggested systematic uncertainty floor to be added in quadrature to published mass/SFR errors.
Simulated Author's Rebuttal
We thank the referee for their constructive comments and positive assessment of the manuscript's significance. We address each major comment point by point below, agreeing where revisions are warranted to improve clarity and rigor.
read point-by-point responses
-
Referee: [§4.2] §4.2 (synthetic catalog construction): the procedure for generating input photometry and noise properties is described only at a high level; it is not shown that the synthetic catalogs reproduce the exact magnitude limits, filter transmission curves, and photometric-error distributions of the real HST/JWST sample. Any mismatch would weaken the claim that the recovered offsets are purely due to SPS model differences.
Authors: We agree that a more explicit demonstration of the synthetic catalog fidelity would strengthen the analysis. In the revised manuscript we will expand §4.2 with a detailed description of how the input photometry was generated to match the exact magnitude limits, filter transmission curves, and photometric-error distributions of the real HST/JWST sample. We will add a supplementary figure that directly compares the magnitude and error distributions between the real and synthetic catalogs, confirming that the simulation reproduces the observational properties to within the required precision. revision: yes
-
Referee: [Table 2, §5.1] Table 2 and §5.1: the maximum reported offsets (0.6 dex in mass, 0.4 dex in SFR) are quoted without the corresponding model-pair identifiers or the number of galaxies contributing to each bin; without this information the reader cannot assess whether the extremes are driven by a small subset of objects or by the full sample.
Authors: We thank the referee for this observation. In the revised version we will update Table 2 to explicitly list the model pairs that produce each maximum offset and report the number of galaxies contributing to each quoted value. We will also revise the text in §5.1 to state that all offsets are measured across the full sample of 17 230 galaxies and that no small subset drives the reported extremes. revision: yes
Circularity Check
No significant circularity detected
full rationale
The paper's central results consist of direct empirical comparisons: four published SPS models are applied via the external CIGALE code to fixed photometric catalogs (real and synthetic), with differences in recovered stellar masses and SFRs measured as outputs. No derivation step reduces by construction to a fitted parameter or self-defined quantity inside the paper; the synthetic-catalog recovery test isolates model choice while holding other inputs fixed. No load-bearing self-citations, uniqueness theorems, or ansatzes are invoked to justify the core claim. The reported offsets (up to 0.6 dex in mass) are therefore independent measurements rather than tautological restatements of the inputs.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption CIGALE's parameter space and dust/AGN modules remain unchanged across SPS libraries
Lean theorems connected to this paper
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
Systematic differences are found among the models, with stellar mass estimates varying by up to ~0.6 dex and SFRs by up to ~0.4 dex between certain model pairs.
-
IndisputableMonolith/Foundation/DimensionForcing.leanalexander_duality_circle_linking unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
Four widely used SPS models are applied... BC03, CB19, BPASS single/binary
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
- [1]
- [2]
-
[3]
B., Pirzkal, N., Finkelstein, S
Bagley, M. B., Pirzkal, N., Finkelstein, S. L., et al. 2024, ApJ, 965, L6
work page 2024
-
[4]
Barro, G., Pérez-González, P. G., Kocevski, D. D., et al. 2024, ApJ, 963, 128
work page 2024
- [5]
- [6]
- [7]
-
[8]
Boquien, M., Buat, V ., Burgarella, D., et al. 2022, A&A, 663, A50
work page 2022
-
[9]
Boquien, M., Burgarella, D., Roehlly, Y ., et al. 2019, A&A, 622, A103
work page 2019
- [10]
- [11]
-
[12]
Carnall, A. C., Leja, J., Johnson, B. D., et al. 2019, ApJ, 873, 44
work page 2019
-
[13]
Casey, C. M., Kartaltepe, J. S., Drakos, N. E., et al. 2023, ApJ, 954, 31
work page 2023
-
[14]
J., Moles, M., Cristóbal-Hornillos, D., et al
Cenarro, A. J., Moles, M., Cristóbal-Hornillos, D., et al. 2019, A&A, 622, A176
work page 2019
- [15]
- [16]
- [17]
-
[18]
Clarke, L., Shapley, A. E., Sanders, R. L., et al. 2024, ApJ, 977, 133
work page 2024
-
[19]
W., Papovich, C., Finkelstein, S
Cole, J. W., Papovich, C., Finkelstein, S. L., et al. 2025, ApJ, 979, 193
work page 2025
- [20]
- [21]
- [22]
-
[23]
Conselice, C. J. 2014, ARA&A, 52, 291
work page 2014
-
[24]
2023, Nature Astronomy, 7, 622
Curtis-Lake, E., Carniani, S., Cameron, A., et al. 2023, Nature Astronomy, 7, 622
work page 2023
-
[25]
2007, ApJ, 670, 156 DESI Collaboration, Adame, A
Daddi, E., Dickinson, M., Morrison, G., et al. 2007, ApJ, 670, 156 DESI Collaboration, Adame, A. G., Aguilar, J., et al. 2024, AJ, 168, 58 Article number, page 12 of 17 Bozhidara Stoyanova et al.: Impact of stellar population models on the estimated physical properties of galaxies
work page 2007
-
[26]
J., Willott, C., Alberts, S., et al
Eisenstein, D. J., Willott, C., Alberts, S., et al. 2023, arXiv e-prints, arXiv:2306.02465
- [27]
-
[28]
Eldridge, J. J. & Stanway, E. R. 2009, MNRAS, 400, 1019
work page 2009
-
[29]
Eldridge, J. J., Stanway, E. R., Xiao, L., et al. 2017, PASA, 34, e058 Euclid Collaboration, Mellier, Y ., Abdurro’uf, et al. 2025, A&A, 697, A1
work page 2017
- [30]
-
[31]
Finkelstein, S. L., Bagley, M. B., Arrabal Haro, P., et al. 2025, ApJ, 983, L4
work page 2025
-
[32]
Finkelstein, S. L., Bagley, M. B., Arrabal Haro, P., et al. 2022, ApJ, 940, L55
work page 2022
-
[33]
Finkelstein, S. L., Bagley, M. B., Ferguson, H. C., et al. 2023, ApJ, 946, L13
work page 2023
-
[34]
Gardner, J. P., Mather, J. C., Abbott, R., et al. 2023, PASP, 135, 068001
work page 2023
-
[35]
Ge, J., Mao, S., Lu, Y ., Cappellari, M., & Yan, R. 2019, MNRAS, 485, 1675
work page 2019
- [36]
-
[37]
Hainline, K. N., Helton, J. M., Johnson, B. D., et al. 2024, ApJ, 964, 66
work page 2024
-
[38]
Helton, J. M., Rieke, G. H., Alberts, S., et al. 2025, Nature Astronomy, 9, 729
work page 2025
-
[39]
W., Hsu, C.-C., Hathi, N., et al
Holwerda, B. W., Hsu, C.-C., Hathi, N., et al. 2024, MNRAS, 529, 1067 Ivezi´c, Ž., Kahn, S. M., Tyson, J. A., et al. 2019, ApJ, 873, 111
work page 2024
- [40]
-
[41]
Kewley, L. J., Nicholls, D. C., & Sutherland, R. S. 2019, ARA&A, 57, 511
work page 2019
-
[42]
D., Guo, J., Arrabal Haro, P., et al
Kocevski, D. D., Guo, J., Arrabal Haro, P., et al. 2024, A Spectroscopic Census of Faint, Broad-Line AGN at z>5, JWST Proposal. Cycle 3, ID. #5718
work page 2024
- [43]
-
[44]
Labbe, I., Greene, J. E., Bezanson, R., et al. 2025, ApJ, 978, 92
work page 2025
-
[45]
2019, MNRAS, 486, 5104 Le Fèvre, O., Tasca, L
Laigle, C., Davidzon, I., Ilbert, O., et al. 2019, MNRAS, 486, 5104 Le Fèvre, O., Tasca, L. A. M., Cassata, P., et al. 2015, A&A, 576, A79
work page 2019
-
[46]
Leitherer, C., Ekström, S., Meynet, G., et al. 2014, ApJS, 212, 14
work page 2014
-
[47]
Leja, J., Carnall, A. C., Johnson, B. D., Conroy, C., & Speagle, J. S. 2019, ApJ, 876, 3
work page 2019
-
[48]
M., Leitherer, C., Ekstrom, S., Meynet, G., & Schaerer, D
Levesque, E. M., Leitherer, C., Ekstrom, S., Meynet, G., & Schaerer, D. 2012, ApJ, 751, 67
work page 2012
- [49]
- [50]
- [51]
-
[52]
J., Pentericci, L., Cimatti, A., et al
McLure, R. J., Pentericci, L., Cimatti, A., et al. 2018, MNRAS, 479, 25
work page 2018
- [53]
- [54]
-
[55]
Nersesian, A., Xilouris, E. M., Bianchi, S., et al. 2019, A&A, 624, A80
work page 2019
- [56]
-
[57]
Noll, S., Burgarella, D., Giovannoli, E., et al. 2009, A&A, 507, 1793
work page 2009
- [58]
-
[59]
Pacifici, C., Iyer, K. G., Mobasher, B., et al. 2023, ApJ, 944, 141 Pérez-González, P. G., Barro, G., Rieke, G. H., et al. 2024, ApJ, 968, 4
work page 2023
-
[60]
2012, MNRAS, 422, 3285 Planck Collaboration, Aghanim, N., Akrami, Y ., et al
Pforr, J., Maraston, C., & Tonini, C. 2012, MNRAS, 422, 3285 Planck Collaboration, Aghanim, N., Akrami, Y ., et al. 2020, A&A, 641, A6
work page 2012
-
[61]
Plat, A., Charlot, S., Bruzual, G., et al. 2019, MNRAS, 490, 978
work page 2019
-
[62]
Popesso, P., Concas, A., Cresci, G., et al. 2023, MNRAS, 519, 1526
work page 2023
-
[63]
Rigby, J., Perrin, M., McElwain, M., et al. 2023, PASP, 135, 048001
work page 2023
- [64]
-
[65]
Robertson, B., Johnson, B. D., Tacchella, S., et al. 2024, ApJ, 970, 31
work page 2024
-
[66]
Robertson, B. E., Tacchella, S., Johnson, B. D., et al. 2023, Nature Astronomy, 7, 611
work page 2023
-
[67]
Salim, S., Boquien, M., & Lee, J. C. 2018, ApJ, 859, 11
work page 2018
- [68]
-
[69]
Salpeter, E. E. 1955, ApJ, 121, 161 Sánchez, S. F., Barrera-Ballesteros, J. K., Lacerda, E., et al. 2022, ApJS, 262, 36
work page 1955
-
[70]
2017, ApJ, 847, 76 Seillé, L.-M., Buat, V ., Fernández, V ., et al
Santini, P., Fontana, A., Castellano, M., et al. 2017, ApJ, 847, 76 Seillé, L.-M., Buat, V ., Fernández, V ., et al. 2024, A&A, 689, A102
work page 2017
-
[71]
Smith, D. J. B., Dunne, L., da Cunha, E., et al. 2012, MNRAS, 427, 703
work page 2012
-
[72]
Somerville, R. S. & Davé, R. 2015, ARA&A, 53, 51
work page 2015
-
[73]
Speagle, J. S., Steinhardt, C. L., Capak, P. L., & Silverman, J. D. 2014, ApJS, 214, 15
work page 2014
-
[74]
Stanway, E. R. & Eldridge, J. J. 2018, MNRAS, 479, 75
work page 2018
-
[75]
Taylor, E. N., Hopkins, A. M., Baldry, I. K., et al. 2011, MNRAS, 418, 1587
work page 2011
-
[76]
Treu, T., Roberts-Borsani, G., Bradac, M., et al. 2022, ApJ, 935, 110
work page 2022
-
[77]
Walcher, J., Groves, B., Budavári, T., & Dale, D. 2011, Ap&SS, 331, 1
work page 2011
-
[78]
G., Adelman, J., Anderson, Jr., J
York, D. G., Adelman, J., Anderson, Jr., J. E., et al. 2000, AJ, 120, 1579 Article number, page 13 of 17 A&A proofs:manuscript no. aanda_revised_clean Appendix A: 2D histograms of offset variations with redshift BC03 0 5 10CB19 3403 6807 0 5 10BPASS single 958 1917 977 1954 0.5 0.0 0.5 1.0 BC03 0 5 10BPASS binary 1102 2204 0.5 0.0 0.5 1.0 CB19 1246 2492 0...
work page 2000
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.