REVIEW 1 major objections 5 minor 21 references
A morphology-blind neural network with spectral mixing beats template fitting for 79 million J-PLUS sources, and WISE cuts quasar outliers from 40% to 23%.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · grok-4.5
2026-07-10 23:47 UTC pith:ZF26F7TO
load-bearing objection Solid DR4 catalog paper: LeMoNNADE beats LePhare on a large held-out set, WISE helps QSOs, and the public products are ready to use; the EM prior shift is the softest secondary claim but is checked hard enough. the 1 major comments →
J-PLUS: Spectral classification and photometric redshifts for 79 million sources in the fourth data release
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
LeMoNNADE, trained exclusively on multi-band photometry and enlarged by spectral mixing augmentation, consistently outperforms optimised LePhare template fitting in f1, σ_NMAD and η_15 for J-PLUS galaxies and quasars; adding WISE infrared bands reduces the quasar catastrophic-outlier rate from ~40% to ~23% and keeps median redshift bias inside ±1% up to z = 4.
What carries the argument
LeMoNNADE: a morphology-blind, fully connected network that maps normalised multi-band SEDs to a three-component Gaussian-mixture redshift PDF (and a star probability), regularised by spectral-mixing data augmentation and adaptive variance scaling of photometric noise.
Load-bearing premise
The Expectation-Maximization prior shift fully removes the spectroscopic bias against stars so that the calibrated star probabilities, applied to the magnitude-limited catalogue, yield unbiased extragalactic counts and N(z).
What would settle it
If independent deep morphological catalogues or future complete spectroscopic samples show that the calibrated P_star values still produce extragalactic number counts or N(z) that deviate systematically from literature benchmarks below r ~ 20.5, the claim of unbiased class probabilities collapses.
If this is right
- Public J-PLUS DR4 catalogues now supply calibrated photo-z PDFs and star probabilities for ~79 million sources usable for local-Universe galaxy and quasar studies.
- Median photo-z estimates from LeMoNNADE suppress the redshift-aliasing artefacts that dominate mode estimates, giving smoother N(z).
- High-purity subsets (P_star < 0.1) already contain 8.3 million galaxies (σ_NMAD ~ 0.032) and 230 thousand quasars (σ_NMAD ~ 0.043) ready for statistical analyses.
- Faint-end incompleteness and residual high-z contamination from spurious detections are quantified, setting practical limits for science use.
Where Pith is reading between the lines
- The same spectral-mixing + adaptive-noise strategy should transfer directly to other multi-band surveys whose spectroscopic training sets are sparse or biased.
- Once SPHEREx near-IR spectra become available, the remaining quasar outlier rate should drop further because the continuum and emission-line leverage will increase.
- The residual excess of photo-z sources at z > 0.6 is largely an artefact of low-S/N detections; a simple S_det cut could clean the high-redshift tail without new spectroscopy.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript delivers spectral classifications and photometric redshifts for 79.2 million J-PLUS DR4 sources (r < 22) over an effective area of 4437.5 deg^{2}. It compares a customised LePhare template-fitting pipeline (galaxy templates only, z ≤ 1) against LeMoNNADE, a morphology-blind fully-connected neural network that predicts GMM PDFs and binary star probabilities from aperture-corrected photometry, trained with spectral-mixing augmentation on ~2 million spectroscopic objects. LeMoNNADE outperforms LePhare in f1, σ_NMAD and η15 across magnitudes; adding unWISE W1/W2 photometry reduces the QSO catastrophic-outlier rate from ~40 % to ~23 % and keeps median bias within ±1 % up to z = 4. An EM Bayesian prior-shift (Appendix A) corrects the spectroscopic under-representation of stars, after which extragalactic counts agree with the literature to r ~ 20.5 and the N(z) for r < 21 peaks at z ~ 0.3. High-purity samples (P_star < 0.1) of 8.34 × 10^6 galaxies and 2.30 × 10^5 QSOs are released with estimated σ_NMAD ~ 0.032 and 0.043.
Significance. The work supplies a large, publicly available, probabilistically calibrated catalogue that is immediately useful for local-Universe science. Strengths include a held-out spectroscopic test set of ~83 000 objects, explicit magnitude- and odds-dependent metrics (Figs. 4–12), transparent treatment of aliasing and PDF point-estimate choice, and thorough internal validation of the EM prior shift (Figs. A.1–A.3) plus the high-z excess (Appendix C). The morphology-blind design and spectral-mixing augmentation are well-motivated engineering choices that improve robustness against PSF variations and training-set gaps. The dual LePhare/LeMoNNADE release and the ColdPress PDF compression further increase the catalogue’s utility.
major comments (1)
- The primary performance claims (LeMoNNADE superiority on the spectroscopic test set and the WISE-driven QSO gains) rest on direct metrics that do not depend on the EM calibration and are solidly demonstrated. The secondary claim that calibrated extragalactic counts and N(z) are unbiased down to r ~ 20.5 does rely on the EM prior shift (Appendix A). The paper already supplies multiple internal checks (raw vs calibrated stellar fractions, flat extragalactic density vs Galactic latitude, agreement with Yasuda/Koushan after extinction correction, HSC morphology cross-match). These checks make the assumption controlled rather than unexamined; no additional load-bearing revision is required, but a short quantitative statement of residual stellar contamination after calibration (e.g., the ~3.5 % figure already given for |b| < 15°) should be elevated into the main text of §6.1 for clarity.
minor comments (5)
- §2.1: the three pre-processing steps applied only to LePhare photometry are clearly stated, but a one-sentence reminder that LeMoNNADE deliberately omits Galactic-extinction correction (because it over-corrects stars) would help readers who skip the later discussion.
- Fig. 3 caption and §5.1: the aliasing discussion is excellent; a brief note that z_random is the only estimator that statistically recovers the population PDF would make the later use of z_random for N(z) more self-contained.
- Appendix B: the ~5–12 % over-estimate of nominal photometric errors is useful; stating the exact correction factors per band (or a table) would aid reproducibility.
- Typographical: “que quantify” → “we quantify” (p. 8); “analised” → “analysed” (p. 2); occasional missing spaces around ~ and ± symbols.
- Data-availability statement is clear and complete; the ColdPress GitHub link is appreciated.
Circularity Check
No significant circularity: performance metrics and population statistics are evaluated against held-out external spectroscopy and independent literature counts.
full rationale
The central claims (LeMoNNADE superiority over LePhare on f1/σ_NMAD/η15, WISE-driven reduction of QSO outliers, and calibrated extragalactic N(z)/counts) rest on supervised evaluation against a held-out spectroscopic test set drawn from DESI/SDSS/HectoMAP/HETDEX and on post-hoc comparison of the magnitude-limited catalogue to external benchmarks (Yasuda et al. 2001, Koushan et al. 2021, SHELS, COMBO-17, HSC morphology). The EM prior-shift (Appendix A, Eq. A.1) is an unsupervised re-weighting of class priors that does not force agreement with those benchmarks; agreement is an empirical outcome that is further stress-tested by Galactic-latitude flatness, extinction-corrected counts, and HSC extendedness cross-matches (Appendix C). No equation reduces a claimed prediction to a quantity defined by the same data used to fit it, no uniqueness theorem is imported from the authors, and self-citations (Hernán-Caballero et al. 2021, ColdPress, LeMoNNADE in prep.) supply only methodological scaffolding, not load-bearing results. The derivation chain is therefore self-contained.
Axiom & Free-Parameter Ledger
free parameters (6)
- z_scale =
0.005
- P_floor =
0.01
- GMM components =
3
- inference iterations / adaptive variance scaling =
100 iterations, scale factor fitted
- LePhare prior parameters (α, γ, absolute-magnitude cuts) =
optimized on training set
- EM magnitude-bin width and convergence threshold =
0.5 mag, 1e-6
axioms (5)
- domain assumption Spectroscopic redshifts and classifications from DESI/SDSS/HectoMAP/HETDEX are sufficiently pure that they can serve as ground truth after quality cuts.
- domain assumption Aperture-corrected 3-arcsec photometry (scaled to AUTO total flux) preserves colors while supplying the correct luminosity prior.
- ad hoc to paper Linear spectral mixing of normalized SEDs at fixed redshift produces physically plausible training examples that fill color-redshift gaps without introducing bias.
- domain assumption The Saerens EM procedure recovers the true stellar prior of the magnitude-limited sample from the biased spectroscopic prior.
- domain assumption Summing (or Monte-Carlo sampling) well-calibrated individual PDFs yields the true population N(z).
invented entities (2)
-
LeMoNNADE
independent evidence
-
Spectral mixing augmentation
no independent evidence
read the original abstract
We present spectral classifications and photometric redshifts for 79.2 million sources up to an r-band magnitude of 22 in Data Release 4 of the Javalambre Photometric Local Universe Survey (J-PLUS). Leveraging the 12-band J-PLUS filter system, we compare a template-fitting approach (LePhare) against LeMoNNADE, a morphology-blind machine learning pipeline that uses spectral mixing augmentation to overcome training set limitations. LeMoNNADE consistently outperforms template fitting in precision, robust scatter, and outlier rates. Including WISE infrared photometry breaks optical degeneracies between stars and quasars, reducing the catastrophic outlier rate for quasars from ~40% to ~23% and constraining systemic redshift bias to <1% up to z = 4. We find LeMoNNADE is also less susceptible to redshift aliasing, particularly when adopting the probability density function median. Because the spectroscopic training samples severely under-represent stars, we apply an Expectation-Maximization Bayesian calibration to recover unbiased class probabilities for the magnitude-limited sample. This reveals that extragalactic counts agree with the literature down to the r ~ 20.5 completeness limit. The inferred redshift distribution for r < 21 extragalactic sources peaks at z ~ 0.3, showing broad agreement with existing literature up to z ~ 0.6. The resulting catalogues represent a significant milestone for local Universe science, offering probabilistically calibrated classifications and distances while explicitly characterising faint-end limits and contamination.
Figures
Reference graph
Works this paper leans on
- [1]
-
[2]
Aihara, H., Arimoto, N., Armstrong, R. et al. 2018, PASJ, 70, S4 Aihara, H., AlSayyad, Y ., Ando, M., et al. 2022, PASJ, 74, 247 Arnouts, S., & Ilbert, O. 2011, LePHARE: Photometric Analysis for Redshift Estimate, ascl:1108.009 Benítez, N., Dupke, R., Moles, M., et al. 2014, arXiv e-prints, arXiv:1403.5237 Bertin, E. & Arnouts, S. 1996, A&AS, 117, 393 Ber...
work page internal anchor Pith review Pith/arXiv arXiv 2018
-
[3]
2021, A&A, 653, A31 Boquien, M., Burgarella, D., Roehlly, Y ., et al
Bonoli, S., Marín-Franch, A., Varela, J., et al. 2021, A&A, 653, A31 Boquien, M., Burgarella, D., Roehlly, Y ., et al. 2019, A&A, 622, A103 Calzetti, D., Armus, L., Bohlin, R. C., et al. 2000, ApJ, 533, 682 Capak, P., Cowie, L. L., Hu, E. M., et al. 2004, AJ, 127, 1,
work page 2021
-
[4]
Cenarro, A. J., Moles, M., Marín-Franch, A., et al. 2014, Proceedings of the SPIE, 9149, 91491I. Cenarro, A. J., Moles, M., Cristóbal-Hornillos, D., et al. 2019, A&A, 622, A176. Chambers, K. C., Magnier, E. A., Metcalfe, N., et al. 2016, , arXiv:1612.05560. Cooper, A. P., Koposov, S. E., Allende Prieto, C., et al. 2023, ApJ, 947, 1,
work page internal anchor Pith review Pith/arXiv arXiv 2014
-
[5]
Data Release 1 of the Dark Energy Spectroscopic Instrument
Cristóbal-Hornillos, D., Gruel, N., Varela, J., et al. 2012, Proceedings of the SPIE, 8451, 845116 del Pino, A., López-Sanjuan, C., Hernán-Caballero, A., et al. 2024, A&A, 691, A221. DESI Collaboration, Abdul-Karim, M., Adame, A. G., et al. 2025, , arXiv:2503.14745. Geller, M. J., Hwang, H. S., Fabricant, D. G., et al. 2014, ApJS, 213, 2,
work page internal anchor Pith review Pith/arXiv arXiv 2012
-
[6]
Green, G. M., Schlafly, E. F., Finkbeiner, D., et al. 2018, MNRAS, 478, 651 Hernán-Caballero, A., Varela, J., Lopez-Sanjuan, C. et al. 2021, A&A, 654, 101 Hernán-Caballero, A. 2025, Research Notes of the American Astronomical So- ciety, 9, 7,
work page 2018
-
[7]
Hildebrandt, H., Erben, T., Kuijken, K., et al. 2012, MNRAS, 421, 3,
work page 2012
- [8]
-
[9]
Koushan, S., Driver, S. P., Bellstedt, S., et al. 2021, MNRAS, 503, 2,
work page 2021
-
[10]
2005, A&A, 439, 845 López-Sanjuan, C., Tremblay, P.-E., Ederoclite, A., et al
Le Fèvre, O., Vettolani, G., Garilli, B., et al. 2005, A&A, 439, 845 López-Sanjuan, C., Tremblay, P.-E., Ederoclite, A., et al. 2022, A&A, 658, A79. López-Sanjuan, C., Vázquez Ramió, H., Xiao, K., et al. 2024, A&A, 683, A29. Marin-Franch, A., Taylor, K., Cenarro, J., et al. 2015, IAU General Assembly, 29, 2257381. McCracken, H. J., Radovich, M., Bertin, E...
work page 2005
-
[11]
Mentuch Cooper, E., Gebhardt, K., Davis, D., et al. 2023, ApJ, 943, 2,
work page 2023
- [12]
-
[13]
Adjusting the Outputs of a Classifier to New a Priori Probabilities: A Simple Procedure,
Saerens, M., Latinne, P., & Decaestecker, C. 2002, “Adjusting the Outputs of a Classifier to New a Priori Probabilities: A Simple Procedure,”Neural Com- putation, 14, 21–41. Schlafly, E. F., Meisner, A. M., Stutz, A. M., et al. 2016, ApJ, 821, 78 Schlafly, E. F., Meisner, A. M., & Green, G. M. 2019, ApJS, 240, 2,
work page 2002
- [14]
-
[15]
von Marttens, R., Marra, V ., Quartin, M., et al. 2024, MNRAS, 527, 2,
work page 2024
-
[16]
Whitten, D. D., Placco, V . M., Beers, T. C., et al. 2019, A&A, 622, A182 Wolf, C., Wisotzki, L., Borch, A., et al. 2003, A&A, 408,
work page 2019
- [17]
-
[18]
2026, Nature Scientific Data, 13, 1,
Xiao, K., Huang, Y ., Yuan, H., et al. 2026, Nature Scientific Data, 13, 1,
work page 2026
- [19]
-
[20]
G., Adelman, J., Anderson, John E., J., et al
York, D. G., Adelman, J., Anderson, John E., J., et al. 2000, AJ, 120, 1579 1 Centro de Estudios de Física del Cosmos de Aragón (CEFCA), Plaza San Juan 1, 44001 Teruel, Spain 2 Unidad Asociada CEFCA-IAA, CEFCA, Unidad Asociada al CSIC por el IAA y el IFCA, Plaza San Juan 1, 44001 Teruel, Spain 3 Instituto de Física de Cantabria, Av. de los Castros, 39005 ...
work page 2000
-
[21]
could bias the inferred redshift distribution, even if thePstar values are statistically well- calibrated. Such a distortion would arise if the classification un- 0.0 0.2 0.4 0.6 0.8 1.0 zmedian 101 102 103 counts / bin HSC gri extended Pstar < 0.5 Pstar < 0.1 Pstar weighted Fig. C.1.Photometric redshift distribution forr<21 galaxies in the JPSV field der...
work page 2018
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.