Pith. sign in

REVIEW 2 major objections 5 minor 54 references

XShooter redshifts for 58 lenses and 57 sources show no measurement bias, so the source-z distribution can calibrate large imaging surveys.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

T0 review · grok-4.5

2026-07-10 05:17 UTC pith:XLUED2U6

load-bearing objection Solid southern XShooter redshift catalog for DESI Legacy lenses; the “no bias / representative zs” claim is only qualitatively supported by color–magnitude plots and should be treated as provisional. the 2 major comments →

arxiv 2607.08562 v1 pith:XLUED2U6 submitted 2026-07-09 astro-ph.CO

XShooter DESI Lens Program: Sample characterization

Eric Jullo , Christophe Boghossian , Luderic Chapel , Felipe Urcelay , Christopher Storfer , Xiaosheng Huang , Raphael Gavazzi , Jens-Kristian Krogager
show 1 more author
Aleksandar Cikota
This is my paper
classification astro-ph.CO
keywords strong gravitational lensingspectroscopic redshiftsDESI Legacy SurveysXShootersource redshift distributionsample characterizationgalaxy evolutioncosmology
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

Huge imaging surveys are finding far more strong gravitational lenses than before, but those catalogs only become useful for cosmology and galaxy evolution once redshifts are known and selection effects are under control. This paper reports VLT/XShooter spectra of 67 grade-A lens systems found by neural-network searches in the southern DESI Legacy Imaging Surveys. Redshifts are secured for 58 lenses and 57 sources (45 systems with both). Lenses mostly lie below z ~ 1 and are measured from continuum absorption features; sources span 0.28 < z < 4.34 (median 1.54) and are measured mainly from emission lines. Color–magnitude distributions of successfully measured objects look like those of the full observed sample, so the authors conclude that the spectroscopic success function introduces no obvious bias. The measured source redshift distribution can therefore be treated as representative of the true parent population and used to calibrate forward models and training sets for Euclid, LSST and similar surveys. Along the way the spectra also flag two sources with outflow signatures and seven with rotating disks.

Core claim

Spectroscopic redshifts for 58 lenses and 57 sources drawn from neural-network-selected DESI Legacy Survey lenses show no color- or magnitude-dependent bias relative to the parent observed sample; the resulting source redshift distribution (median zs = 1.54) can therefore be used as a representative calibrator for large imaging-survey analyses.

What carries the argument

Quality-flagged XShooter redshifts (Qz = 1–4) extracted from continuum absorption (lenses) and emission lines (sources), combined with a direct comparison of g−r / r−z colors and z-band magnitudes between successful measurements and the full observed set.

Load-bearing premise

That matching color and magnitude distributions between systems with good redshifts and the full observed sample is enough to prove the spectroscopic success rate is uniform across the true source-redshift range.

What would settle it

A larger, deeper spectroscopic campaign of the same parent catalog that recovers redshifts for a substantial fraction of the currently failed or low-Qz sources and finds a systematically different redshift distribution would falsify the claim of representativeness.

Watch this falsifier — get emailed when new claim-graph text bears on it.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

2 major / 5 minor

Summary. The paper reports VLT/XShooter spectroscopy of 67 grade-A strong-lens candidates from the DESI Legacy Imaging Surveys (Huang et al. 2021; Storfer et al. 2024) at Dec < −20°. Redshifts are measured for 58 lenses and 57 sources (45 systems with both), with quality flags Qz = 1–4 based on continuum and emission-line features. The sample yields a source redshift range 0.28 < zs < 4.34 (median zs = 1.54) and a lens distribution mostly at z < 1. The authors also note two sources with outflow signatures and seven with rotating disks. On the basis of magnitude and g−r / r−z color comparisons (Figs. 3–4) between systems with successful redshifts (Qz > 2) and the observed sample, they conclude that no particular bias is associated with the redshift measurement operation, so the measured source-z distribution is likely representative of the true parent distribution and can be used to calibrate analyses in large imaging surveys.

Significance. A homogeneous spectroscopic characterization of a southern DESI Legacy Survey lens sample is a useful community resource, especially given the forthcoming Euclid and LSST strong-lens catalogues. The 82 % / 85 % success rates, the tabulated redshifts with quality flags (Table 2), and the extensive per-system 1D/2D spectral figures constitute a concrete, reusable data product. The identification of outflows and rotating disks adds modest astrophysical interest. The central claim that the measured source-z histogram can be treated as representative for survey calibration is of clear practical value if it holds, but it currently rests on an incomplete empirical test.

major comments (2)
  1. The central claim (Abstract; end of §3; §4) that the measured source redshift distribution is “likely representative of the true one” is supported only by the visual similarity of g−r / r−z colors and magnitudes between systems with Qz > 2 and the observed sample (Figs. 3–4). Color–magnitude similarity does not constrain whether the spectroscopic success function S(z) is flat across 0.28 < zs < 4.34. Emission-line detectability (the dominant Qz = 4 channel) depends on which lines fall into the NIR arm, sky-line density, and continuum S/N—all of which vary strongly with redshift. The paper never constructs a selection function, nor does it compare successful versus failed subsets in any redshift-sensitive observable beyond broadband colors. Without such a test (or an explicit caveat that the histogram is an observed, not completeness-corrected, distribution), the claim that the sample “ca
  2. §3 and Table 2 report 33 % of lens redshifts with Qz < 2 and several source redshifts with Qz = 1–2 (single-line or continuum-only). The text does not state whether the histograms in Fig. 2 or the “representative” claim include only Qz ≥ 3 systems or the full set. Because low-Qz redshifts are more susceptible to line misidentification and sky residuals (explicitly noted for several systems in the appendix figures), the paper should either restrict the science sample to a well-defined quality cut or quantify how the distribution changes when low-Qz objects are excluded.
minor comments (5)
  1. Storfer et al. is cited as 2022 in the Abstract and as 2024 in the body and references; the year should be made consistent.
  2. Table 1 lists program IDs and OB counts but does not give the total on-source exposure or the fraction of grade-A nights; a one-line summary would help readers assess data quality.
  3. Several appendix figure captions (e.g., DESI-024.5133-21.9299, DESI-033.8095-29.1570) discuss alternative line identifications or photometric-redshift tensions; these caveats should be cross-referenced in Table 2 or the main text so that users of the catalogue are aware of them.
  4. Fig. 2 caption and axis labels would benefit from explicit statement of the quality cut (if any) applied to the plotted redshifts.
  5. Minor typographical issues: “XSchooter” (p. 2), “HandK” for H and K lines, and occasional missing spaces around redshifts (e.g., z=0.295).

Circularity Check

1 steps flagged

Empirical sample characterization with no derivation that reduces to its inputs; only minor non-load-bearing self-citation of the parent imaging catalog.

specific steps
  1. self citation load bearing [§3, paragraph discussing Fig. 4; also Abstract and §4]
    "Given that Huang et al. (2021) did not perform any selection on the sources, this suggests that our redshift distribution of the sources is likely representative of the true one."

    Huang is a co-author; the claim that the parent catalog is free of source selection is taken from the collaboration’s own prior imaging paper. This is only a minor premise supporting representativeness and does not force the measured redshifts or the color–magnitude comparison by construction; the redshifts remain independent spectral measurements.

full rationale

The paper reports new VLT/XShooter redshifts for 58 lenses and 57 sources drawn from an imaging neural-network catalog (Huang et al. 2021; Storfer et al. 2024). Redshifts are identified from observed absorption/emission lines against laboratory wavelengths and graded by continuum/line quality (Qz); this is direct measurement, not a fitted model or self-definitional construction. The central claim that the measured source-z distribution is “likely representative” rests on two empirical comparisons internal to the observed sample: (i) success rate versus zAB magnitude (Fig. 3) and (ii) g−r / r−z color distributions of systems with Qz>2 versus the full observed set (Fig. 4), plus the statement that Huang et al. imposed no source selection. These checks do not reduce by construction to any fitted parameter or to a uniqueness theorem; they are falsifiable photometric comparisons. The only self-citation of note is the parent-sample reference (authors overlap), which is used solely to establish that the imaging search did not pre-select sources; it is not load-bearing for the redshift values themselves nor for the color–magnitude test. No ansatz is smuggled, no prediction is a re-labeled fit, and no uniqueness result is imported. The skeptic’s concern that color similarity does not fully constrain S(z) is a completeness/correctness issue, not circularity. Score 1 reflects only the minor, non-circular self-citation of the imaging papers.

Axiom & Free-Parameter Ledger

0 free parameters · 3 axioms · 0 invented entities

The work is an observational catalog paper. It inherits standard spectroscopic redshift practice and the parent imaging selection; it introduces no free cosmological parameters, no new physical entities, and only domain-standard assumptions about line identification and quality grading.

axioms (3)
  • domain assumption Observed emission and absorption lines can be identified with rest-frame atomic transitions (e.g., [O II], Hα, Ca H&K) to assign spectroscopic redshifts.
    Standard extragalactic spectroscopy practice used throughout §2–3 and the appendix figures.
  • domain assumption Quality flags Qz=1–4 correctly rank continuum and emission-line reliability for subsequent statistical use.
    Defined in §2 and applied in Table 2; the ‘no-bias’ claim is restricted to Qz>2.
  • domain assumption The Huang et al. (2021) and Storfer et al. (2024) grade-A candidates form a parent sample whose source population is the target of the representativeness claim.
    Selection described in §1–2; the paper does not re-derive the neural-network purity.

pith-pipeline@v1.1.0-grok45 · 30309 in / 2364 out tokens · 27731 ms · 2026-07-10T05:17:26.268369+00:00 · methodology

0 comments
read the original abstract

Large imaging surveys in cosmology are detecting orders of magnitude more lens systems than known so far. This unprecedented dataset will lead to robust constraints on cosmology and galaxy evolution models. However, a preliminary careful characterization of the lens and source samples are mandatory. In this work, we report on a VLT/XShooter observation program of 67 lens systems to characterize their spectroscopic redshift distribution. These systems were previously detected on the Dark Energy Spectroscopic Instrument Legacy Imaging Surveys by Huang et al. 2021 and Storfer et al. 2022 with deep residual neural network. We manage to measure redshifts for 58 lenses and 57 sources. We also identify 2 sources with indication of outflow in the shape of the emission lines and 7 sources with rotating disks in $[OII]$ or $H\alpha$. We find no particular bias associated to the redshift measurement operation, meaning that our measured source redshift distribution is likely representative of the true one and can be used to calibrate analyses in large imaging surveys.

Figures

Figures reproduced from arXiv: 2607.08562 by Aleksandar Cikota, Christophe Boghossian, Christopher Storfer, Eric Jullo, Felipe Urcelay, Jens-Kristian Krogager, Luderic Chapel, Raphael Gavazzi, Xiaosheng Huang.

Figure 1
Figure 1. Figure 1: Sky position of targeted and observed lens systems. [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 3
Figure 3. Figure 3: Magnitude distribution of lenses and sources observed [PITH_FULL_IMAGE:figures/full_fig_p003_3.png] view at source ↗
Figure 2
Figure 2. Figure 2: Spectroscopic redshift distributions measured for the ob [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 4
Figure 4. Figure 4: Color color distributions and histograms of the lenses and [PITH_FULL_IMAGE:figures/full_fig_p004_4.png] view at source ↗

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

54 extracted references · 54 canonical work pages · 5 internal anchors

  1. [1]

    O., Corwin , Jr., H

    Abell , G. O., Corwin , Jr., H. G., & Olowin , R. P. 1989, , 70, 1

    work page 1989

  2. [2]

    Adnan , S. M. R., Hasan , M. J., Al-Imtiaz , A., et al. 2025, , 699, A259

    work page 2025

  3. [3]

    2026, , 1001, 162

    Agarwal , S., Huang , X., Sheu , W., et al. 2026, , 1001, 162

    work page 2026

  4. [4]

    2018, , 70, S4

    Aihara , H., Arimoto , N., Armstrong , R., et al. 2018, , 70, S4

    work page 2018

  5. [5]

    2010, in Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, Vol

    Bacon , R., Accardo , M., Adjali , L., et al. 2010, in Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, Vol. 7735, Ground-based and Airborne Instrumentation for Astronomy III, ed. I. S. McLean , S. K. Ramsay , & H. Takami , 773508

    work page 2010

  6. [6]

    E., Bocquet , S., Stalder , B., et al

    Bleem , L. E., Bocquet , S., Stalder , B., et al. 2020, , 247, 25

    work page 2020

  7. [7]

    E., Stalder , B., Brodwin , M., et al

    Bleem , L. E., Stalder , B., Brodwin , M., et al. 2015 a , , 216, 20

    work page 2015

  8. [8]

    E., Stalder , B., de Haan , T., et al

    Bleem , L. E., Stalder , B., de Haan , T., et al. 2015 b , , 216, 27

    work page 2015

  9. [9]

    2021, , 650, A104

    CHEX-MATE Collaboration , Arnaud , M., Ettori , S., et al. 2021, , 650, A104

    work page 2021

  10. [10]

    2019, , 884, 85

    Coe , D., Salmon , B., Brada c , M., et al. 2019, , 884, 85

    work page 2019

  11. [11]

    G., Aguilar, J., et al

    Collaboration, D., Adame, A. G., Aguilar, J., et al. 2024, The Astronomical Journal, 168, 58

    work page 2024

  12. [12]

    M., Fassnacht , C

    Despali , G., Heinze , F. M., Fassnacht , C. D., et al. 2025, , 699, A222

    work page 2025

  13. [13]

    2021, , 919, 48

    D \' az-S \'a nchez , A., Dannerbauer , H., Sulzenauer , N., Iglesias-Groth , S., & Rebolo , R. 2021, , 919, 48

    work page 2021

  14. [14]

    T., Buckley-Geer , E

    Diehl , H. T., Buckley-Geer , E. J., Lindgren , K. A., et al. 2017, , 232, 15

    work page 2017

  15. [15]

    C., & Henry , J

    Ebeling , H., Edge , A. C., & Henry , J. P. 2001, , 553, 668

    work page 2001

  16. [16]

    Euclid Collaboration , Lines , N. E. P., Collett , T. E., et al. 2025 a , arXiv e-prints, arXiv:2512.05899

    work page arXiv 2025

  17. [17]

    Euclid Collaboration , Lines , N. E. P., Collett , T. E., et al. 2025 b , arXiv e-prints, arXiv:2503.15326

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  18. [18]

    Euclid Quick Data Release (Q1) The Strong Lensing Discovery Engine B -- Early strong lens candidates from visual inspection of high velocity dispersion galaxies

    Euclid Collaboration , Rojas , K., Collett , T. E., et al. 2025 c , arXiv e-prints, arXiv:2503.15325

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  19. [19]

    Euclid Quick Data Release (Q1): The Strong Lensing Discovery Engine A -- System overview and lens catalogue

    Euclid Collaboration , Walmsley , M., Holloway , P., et al. 2025 d , arXiv e-prints, arXiv:2503.15324

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  20. [20]

    2021, , 253, 3

    Hilton , M., Sif \'o n , C., Naess , S., et al. 2021, , 253, 3

    work page 2021

  21. [21]

    R., Davis , T

    Hinton , S. R., Davis , T. M., Lidman , C., Glazebrook , K., & Lewis , G. F. 2016, Astronomy and Computing, 15, 61

    work page 2016

  22. [22]

    C., Storfer , C

    Huang , X., Inchausti , J. C., Storfer , C. J., et al. 2025, arXiv e-prints, arXiv:2509.18089

    work page arXiv 2025

  23. [23]

    2021, , 909, 27

    Huang , X., Storfer , C., Gu , A., et al. 2021, , 909, 27

    work page 2021

  24. [24]

    2020, , 894, 78

    Huang , X., Storfer , C., Ravi , V., et al. 2020, , 894, 78

    work page 2020

  25. [25]

    2019, , 243, 17

    Jacobs , C., Collett , T., Glazebrook , K., et al. 2019, , 243, 17

    work page 2019

  26. [26]

    J., et al

    Klein , M., Grandis , S., Mohr , J. J., et al. 2019, , 488, 739

    work page 2019

  27. [27]

    D., Rudnick , L., et al

    Knowles , K., Cotton , W. D., Rudnick , L., et al. 2022, , 657, A56

    work page 2022

  28. [28]

    2021, , 652, A12

    Koulouridis , E., Clerc , N., Sadibekova , T., et al. 2021, , 652, A12

    work page 2021

  29. [29]

    2018, , 473, 3895

    Lanusse , F., Ma , Q., Li , N., et al. 2018, , 473, 3895

    work page 2018

  30. [30]

    Euclid Definition Study Report

    Laureijs , R., Amiaux , J., Arduini , S., et al. 2011, ArXiv e-prints [ [arXiv] 1110.3193 ]

    work page internal anchor Pith review Pith/arXiv arXiv 2011

  31. [31]

    E., Acebron , A., et al

    Li , T., Collett , T. E., Acebron , A., et al. 2025, Breaking the mass sheet degeneracy in strong lensing time delay cosmology with a new sample of double source plane lenses. , HST Proposal. Cycle 33, ID. \#18097

    work page 2025

  32. [32]

    E., Krawczyk , C

    Li , T., Collett , T. E., Krawczyk , C. M., & Enzi , W. 2024, , 527, 5311

    work page 2024

  33. [33]

    DESI Strong Lens Foundry IV: Spectroscopic Confirmation of DESI Lens Candidates with VLT/MUSE

    Lin , E., Toro Bertolla , I., Cikota , A., et al. 2025, arXiv e-prints, arXiv:2509.18078

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  34. [34]

    May , P. E. 2013, PhD thesis, University of Birmingham, UK

    work page 2013

  35. [35]

    K., Hilton , M., et al

    Mehrtens , N., Romer , A. K., Hilton , M., et al. 2012, , 423, 1024

    work page 2012

  36. [36]

    2023, , 678, L2

    Meneghetti , M., Cui , W., Rasia , E., et al. 2023, , 678, L2

    work page 2023

  37. [37]

    2020, Science, 369, 1347

    Meneghetti , M., Davoli , G., Bergamini , P., et al. 2020, Science, 369, 1347

    work page 2020

  38. [38]

    B., Belli , S., Ellis , R

    Newman , A. B., Belli , S., Ellis , R. S., & Patel , S. G. 2018, , 862, 126

    work page 2018

  39. [39]

    2022, , 512, 6021

    Niemiec , A., Giocoli , C., Cohen , E., et al. 2022, , 512, 6021

    work page 2022

  40. [40]

    2016, , 827, 51

    Nord , B., Buckley-Geer , E., Lin , H., et al. 2016, , 827, 51

    work page 2016

  41. [41]

    2021, , 646, A83

    Richard , J., Claeyssens , A., Lagattuta , D., et al. 2021, , 646, A83

    work page 2021

  42. [42]

    A., Brammer , G

    Rodney , S. A., Brammer , G. B., Pierel , J. D. R., et al. 2021, Nature Astronomy, 5, 1118

    work page 2021

  43. [43]

    2014, , 792, 45

    Ruel , J., Bazin , G., Bayliss , M., et al. 2014, , 792, 45

    work page 2014

  44. [44]

    H., et al

    Sahu , N., Tran , K.-V., Suyu , S. H., et al. 2024, , 970, 86

    work page 2024

  45. [45]

    E., Magee , M

    Sainz de Murieta , A., Collett , T. E., Magee , M. R., et al. 2024, , 535, 2523

    work page 2024

  46. [46]

    J., Vernardos , G., Collett , T

    Shajib , A. J., Vernardos , G., Collett , T. E., et al. 2024, , 220, 87

    work page 2024

  47. [47]

    2024, , 973, 3

    Sheu , W., Cikota , A., Huang , X., et al. 2024, , 973, 3

    work page 2024

  48. [48]

    & Li , S

    Shu , Y. & Li , S. 2025, Science China Physics, Mechanics, and Astronomy, 68, 129511

    work page 2025

  49. [49]

    P., et al

    Sif \'o n , C., Finoguenov , A., Haines , C. P., et al. 2025, , 697, A92

    work page 2025

  50. [50]

    2000, SAOImage DS9: A utility for displaying astronomical images in the X11 window environment , Astrophysics Source Code Library, record ascl:0003.002

    Smithsonian Astrophysical Observatory . 2000, SAOImage DS9: A utility for displaying astronomical images in the X11 window environment , Astrophysics Source Code Library, record ascl:0003.002

    work page 2000

  51. [51]

    2024, , 274, 16

    Storfer , C., Huang , X., Gu , A., et al. 2024, , 274, 16

    work page 2024

  52. [52]

    2026, arXiv e-prints, arXiv:2602.16077

    Urcelay , F., Huang , X., Sheu , W., et al. 2026, arXiv e-prints, arXiv:2602.16077

    work page arXiv 2026

  53. [53]

    F., Huang , X., & Hernandez , J

    Urcelay , F., Jullo , E., Barrientos , L. F., Huang , X., & Hernandez , J. 2025, , 694, A35

    work page 2025

  54. [54]

    2011, , 536, A105

    Vernet , J., Dekker , H., D'Odorico , S., et al. 2011, , 536, A105

    work page 2011