Pith. sign in

REVIEW 4 major objections 4 minor 2 cited by

After size cuts and stellar-halo masking, UNIONS-3500 cosmic shear B-modes pass null tests across three E/B-separable statistics.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

T0 review · grok-4.5

2026-07-13 13:26 UTC pith:EHIXK6TF

load-bearing objection Standard multi-statistic B-mode validation for UNIONS-3500 that is useful survey housekeeping, with the usual post-hoc cut caveat but no load-bearing flaw visible from the abstract. the 4 major comments →

arxiv 2604.03227 v2 pith:EHIXK6TF submitted 2026-04-03 astro-ph.CO astro-ph.IM

UNIONS-3500 Weak Lensing: II. B-mode validation for cosmic shear

C. Daley , A. Guinot , S. Guerrini , F. Hervas-Peters , L. W. K. Goh , C. Murray , M. Kilbinger , A. Wittje
show 4 more authors
M. J. Hudson H. Hildebrandt L. van Waerbeke A. W. McConnachie
This is my paper
classification astro-ph.CO astro-ph.IM
keywords cosmic shearB modesweak lensingUNIONS-3500COSEBIscale cutssystematics validationE/B separation
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

This paper shows that the UNIONS-3500 weak-lensing catalog, covering nearly 2900 square degrees, can be cleaned of detectable B-mode contamination once galaxies that are too small and regions near bright stars are removed. Cosmic shear B modes are a pure diagnostic of systematics: gravitational lensing produces only E modes, so any residual B signal flags residual instrumental or observational bias. The authors test three independent statistics that separate E and B modes—real-space pure-mode correlation functions, COSEBI amplitudes, and harmonic-space power spectra—and find that after the sample cuts all three pass null tests, with the lowest probability-to-exceed equal to 0.18. Scale cuts that remove the angular size of a single CCD further suppress an oscillatory B-mode pattern already known from earlier MegaCam surveys. Because each statistic weights angular scales differently, the authors insist that a catalog must pass all three tests at once before it can be used for cosmological inference. The result supplies a validated shear catalog and a multi-statistic protocol that Stage-IV surveys can adopt when systematics become the dominant error.

Core claim

After galaxy-size cuts and stellar-halo masking, all three E/B-separable B-mode statistics (ξ±^B(θ), COSEBI B_n, and C_ℓ^BB) for the UNIONS-3500 survey pass the null test, with minimum PTE = 0.18, and the adopted scale cuts lie in broad stable regions of acceptable PTE.

What carries the argument

Three E/B-separable two-point statistics—pure-mode correlation functions ξ±^B(θ), COSEBI B-mode amplitudes B_n, and harmonic-space power spectra C_ℓ^BB—together with a two-dimensional grid of scale-cut boundaries used to map PTE stability.

Load-bearing premise

The post-hoc galaxy-size cuts, stellar-halo masks, and CCD-scale exclusions, chosen after B-mode failures were already seen, remove systematics without introducing selection biases that still affect the cosmological E-mode signal.

What would settle it

Recompute the three B-mode statistics on an independent shear catalog that applies the same size and stellar-halo cuts but retains the CCD angular scale; a return of the oscillatory COSEBI pattern or PTE dropping below ~0.05 would falsify the claim that the adopted cuts cleanly remove the contamination.

Watch this falsifier — get emailed when new claim-graph text bears on it.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

4 major / 4 minor

Summary. This manuscript presents a B-mode validation analysis for the UNIONS-3500 cosmic-shear catalog (2894 deg², n_eff ≈ 5.0 arcmin⁻²). Using three E/B-separable two-point statistics—pure-mode correlation functions ξ±^B(θ), COSEBI B-mode amplitudes B_n, and harmonic-space C_ℓ^BB—the authors report that, after galaxy-size cuts and stellar-halo masking motivated by failures on earlier catalog versions, all three null tests pass, with a minimum PTE of 0.18. Adopted scale cuts are stated to lie in broad stable regions of a two-dimensional scale-cut PTE grid. An oscillatory COSEBI B-mode pattern before cuts is attributed to repeating additive shear bias at the CCD angular scale (a MegaCam-level effect also seen in CFHTLenS); excluding that scale suppresses it. The paper argues that simultaneous multi-statistic null tests are required because filter functions weight scales differently across estimators, and that this approach is directly relevant to Stage-IV surveys.

Significance. If the reported null-test results hold under independent scrutiny of the full analysis chain, the work provides a necessary Stage-III validation product for UNIONS-3500 cosmology and a concrete multi-statistic template for Stage-IV B-mode control. Strengths visible from the abstract include: (i) simultaneous use of three E/B-separable estimators rather than a single diagnostic; (ii) explicit mapping of PTE over a scale-cut grid rather than a single ad-hoc cut; (iii) transparent attribution of a pre-cut oscillatory COSEBI pattern to a known detector-level additive bias shared with CFHTLenS; and (iv) a clear methodological recommendation that scale and sample selections must pass all frameworks jointly. These are load-bearing contributions for weak-lensing systematics control, provided residual E-mode impact of the chosen cuts is quantified.

major comments (4)
  1. [Abstract] The Abstract states that “B-mode detections and PTE failures on initial catalog versions led us to investigate galaxy size cuts and stellar halo masking,” after which the same three statistics pass (min PTE = 0.18). This makes the reported null-test success conditioned on sample and scale selections tuned against the same null tests. For the central claim that the catalog is validated for cosmological use, the manuscript must quantify residual E-mode impact of those cuts (e.g., size-dependent shear response, large-scale-structure correlation of stellar-halo masks, or incomplete removal of additive bias that is only rendered invisible after the CCD-scale cut). Without an independent residual-systematics budget or a blinded E-mode impact test, multi-statistic PTE agreement is necessary but not sufficient.
  2. [Abstract (scale-cut grid / PTE)] Galaxy-size cut thresholds, stellar-halo masking parameters, and per-statistic angular scale-cut boundaries are free analysis choices. The Abstract reports that adopted cuts “lie in broad stable regions of acceptable PTE,” but does not state whether the PTE grid accounts for the look-elsewhere effect of scanning a two-dimensional cut space, nor whether neighboring cut choices that also pass B-mode nulls produce consistent cosmological E-mode constraints. A load-bearing robustness demonstration is needed: either a fixed pre-specified cut policy, or a quantitative map from cut variations to shifts in the E-mode cosmological parameters.
  3. [Abstract (multi-statistic scale cuts)] The Abstract correctly notes that “scale cuts in one [statistic] do not map exactly onto cuts in another, because their respective filter functions weight angular scales differently,” and advocates simultaneous multi-statistic validation. That claim is methodologically sound, but the Abstract does not report the retained E-mode information content (e.g., Fisher information or S/N) under the joint cut set relative to each statistic’s individual optimum. Without that comparison, it is unclear whether the “most conservative” joint cut is unnecessarily aggressive or still leaves residual scale ranges that fail under a fourth, independent diagnostic.
  4. [Abstract (COSEBI oscillatory pattern / CCD scale)] The pre-cut oscillatory COSEBI B-mode pattern is attributed to repeating additive shear bias at the CCD angular scale. The Abstract states that excluding that scale suppresses the pattern, but does not state whether the additive bias is measured and subtracted (or marginalized) in the E-mode pipeline, or only hidden by the cut. If the bias couples into E modes at neighboring scales, a pure scale cut is incomplete mitigation. A concrete residual-bias model or null test after explicit additive-bias correction is needed to support the claim that the final catalog is clean for cosmology.
minor comments (4)
  1. [Abstract] The Abstract reports a single minimum PTE = 0.18 across three statistics and a scale-cut grid. Please state explicitly in the text (and preferably in a table) the PTE for each statistic at the adopted cut, the number of degrees of freedom, and the covariance model used, so that the joint claim can be audited without reconstructing the grid.
  2. [Abstract / methods (when available)] Clarify the precise definition of the galaxy-size cut (which size estimator, threshold in which units) and the stellar-halo masking parameters (magnitude limit, angular radius, or mask bit) when they are introduced, so that the sample selection is reproducible from the paper alone.
  3. [Abstract] The phrase “broad stable regions of acceptable PTE” should be defined operationally (e.g., PTE > 0.05 over a contiguous region of the cut plane larger than X) so that “stable” is not left as a qualitative judgment.
  4. [Abstract] When comparing to CFHTLenS and other Stage-III surveys that used MegaCam, cite the specific prior B-mode / additive-bias results being referenced so that the claimed commonality of the detector-level effect can be checked.

Circularity Check

2 steps flagged

Post-hoc sample/scale cuts tuned on the same B-mode null tests leave residual E-mode bias unquantified; abstract-only review cannot confirm the claimed clean validation.

specific steps
  1. fitted input called prediction [Abstract (sample selection paragraph)]
    "B-mode detections and PTE failures on initial catalog versions led us to investigate galaxy size cuts and stellar halo masking. After cuts, all three statistics pass the null test (minimum PTE = 0.18)."

    The galaxy-size cuts and stellar-halo masking were introduced after observing B-mode detections and PTE failures on the same three null-test statistics that are later reported as passed. The final sample is therefore selected to maximise success on the validation metrics themselves; the reported PTEs are conditioned on that post-hoc selection rather than being an a-priori prediction of an independent catalog.

  2. fitted input called prediction [Abstract (scale-cut / COSEBI paragraph)]
    "Before scale cuts, we measure an oscillatory COSEBI B-mode pattern consistent with repeating additive shear bias, a detector-level effect seen across multiple Stage-III surveys including CFHTLenS, which used the same MegaCam camera; scale cuts that exclude the charge-coupled device (CCD) angular scale suppress it."

    The scale cuts that exclude the CCD angular scale are chosen precisely because they suppress the oscillatory B-mode pattern that was observed before the cuts. The subsequent claim that the adopted cuts lie in broad stable regions of acceptable PTE therefore reports a null-test success that was engineered by removing the angular scales at which the failure was detected, rather than an independent validation of an unaltered data vector.

full rationale

The abstract is the only available text. It explicitly states that B-mode detections and PTE failures on initial catalogs 'led us to investigate galaxy size cuts and stellar halo masking,' after which the same three E/B-separable statistics pass (min PTE = 0.18). Scale cuts that exclude the CCD angular scale are likewise chosen because they suppress the observed oscillatory COSEBI B-mode pattern attributed to repeating additive shear bias. This is standard Stage-III practice and is not pure definitional circularity: the null tests remain externally falsifiable, multi-statistic agreement is reported, and the adopted cuts are said to lie in broad stable PTE regions rather than at a single optimized point. However, the reported PTEs are conditioned on a selection process that maximises null-test success on the same statistics later presented as validation. Nothing in the abstract quantifies residual coupling of the same systematics into the cosmological E-mode signal (size-dependent shear response, stellar-halo masking correlated with large-scale structure, or incomplete removal of additive bias). Because the full text is unavailable, independent residual-systematics budgets or blinded E-mode impact tests cannot be inspected; the score therefore reflects partial circularity of the validation loop rather than a complete reduction of the result to its inputs. Score 5 is intermediate: higher than pure self-citation of an external theorem, lower than a claim that is forced by construction.

Axiom & Free-Parameter Ledger

3 free parameters · 3 axioms · 0 invented entities

The central claim rests on standard weak-lensing E/B decomposition theory, on the Stage-III premise that residual B modes are pure systematics, and on several analysis choices (size cuts, halo masks, scale boundaries) that were adjusted after inspecting the same B-mode statistics. No new physical entities are introduced. Free parameters are the discrete cut thresholds that define the accepted sample and scales.

free parameters (3)
  • galaxy size cut threshold(s)
    Adjusted after initial catalogs failed B-mode null tests; exact numerical value(s) not given in abstract but load-bearing for the final PTE = 0.18 result.
  • stellar halo masking parameters
    Introduced after B-mode failures; defines which sky regions and galaxies enter the final sample.
  • angular scale-cut boundaries (per statistic)
    Chosen so that adopted cuts lie in “broad stable regions of acceptable PTE” on a 2-D grid; different for ξ±, COSEBIs, and C_ℓ because filter functions differ.
axioms (3)
  • domain assumption At Stage-III sensitivities, cosmic-shear B modes unambiguously indicate systematic contamination (not cosmological signal).
    Stated in the opening sentence of the abstract; underpins the entire null-test interpretation.
  • domain assumption The three E/B-separable estimators (pure-mode ξ±^B, COSEBI B_n, C_ℓ^BB) are valid and jointly sufficient probes of residual systematics in the two-point shear field.
    Assumed throughout; the paper’s multi-framework requirement rests on this.
  • standard math Standard linear E/B decomposition and the associated filter functions for COSEBIs and pure-mode correlation functions.
    Background mathematical machinery taken from the weak-lensing literature.

pith-pipeline@v1.1.0-grok45 · 6313 in / 2760 out tokens · 35399 ms · 2026-07-13T13:26:45.912564+00:00 · methodology

0 comments
read the original abstract

At Stage-III sensitivities, cosmic shear $B$ modes unambiguously indicate systematic contamination and are often used to inform data selection and scale cuts for cosmological inference. We validate $B$ modes for the Ultraviolet Near-Infrared Optical Northern Survey (UNIONS)-3500 (2894 deg$^2$, $n_\mathrm{eff} \approx 5.0$ arcmin$^{-2}$) using three $E$/$B$-separable statistics: pure-mode correlation functions $\xi_\pm^{\mathrm{B}}(\theta)$, Complete Orthogonal Sets of $E$/$B$-mode Integrals (COSEBI) $B$-mode amplitudes $B_n$, and harmonic-space power spectra $C_\ell^{BB}$. For each statistic, we compute probability-to-exceed (PTE) values over a two-dimensional grid of scale-cut boundaries; our adopted cuts lie in broad stable regions of acceptable PTE. $B$-mode detections and PTE failures on initial catalog versions led us to investigate galaxy size cuts and stellar halo masking. After cuts, all three statistics pass the null test (minimum PTE $= 0.18$). Before scale cuts, we measure an oscillatory COSEBI $B$-mode pattern consistent with repeating additive shear bias, a detector-level effect seen across multiple Stage-III surveys including CFHTLenS, which used the same MegaCam camera; scale cuts that exclude the charge-coupled device (CCD) angular scale suppress it. Although these statistics probe the same two-point shear field, scale cuts in one do not map exactly onto cuts in another, because their respective filter functions weight angular scales differently. The most conservative validation therefore requires scale and sample selections that pass null tests across all frameworks simultaneously, an approach that applies directly to Stage-IV surveys where systematic errors dominate.

Figures

Figures reproduced from arXiv: 2604.03227 by A. Guinot, A. Wittje, A. W. McConnachie, C. Daley, C. Murray, F. Hervas-Peters, H. Hildebrandt, L. van Waerbeke, L. W. K. Goh, M. J. Hudson, M. Kilbinger, S. Guerrini.

Figure 1
Figure 1. Figure 1: Pure E/B-mode decomposition of the measured shear correlation functions for the fiducial catalog. Panels show ξ+ (left) and ξ− (right) decomposed into total (black circles), E-mode (teal squares), B-mode (crimson ×), and ambiguous (purple triangles) components following Schneider et al. (2022). The E modes trace the lensing signal, while B modes—which should vanish for pure gravitational lensing—diagnose s… view at source ↗
Figure 2
Figure 2. Figure 2: COSEBI B-mode amplitudes for the fiducial catalog, nor￾malized by uncertainty (Bn/σn). Orange squares: full angular range 1–250 arcmin; blue circles: fiducial scale cuts 12–83 ar￾cmin. The shaded region highlights mode numbers n ≤ 6, which capture nearly all cosmological information. On the full range, n = 1 shows a > 4σ excess, with oscillatory structure through all twenty modes, consistent with repeating… view at source ↗
Figure 3
Figure 3. Figure 3: Harmonic-space power spectra for the fiducial catalog, normalized by uncertainty. Top: B-mode auto-power C BB ℓ /σ. Bottom: E-B cross-power C EB ℓ /σ. C BB ℓ is predominantly posi￾tive across the fiducial range. C EB ℓ scatters symmetrically around zero, suggesting that any B-mode contamination is not strongly correlated with the lensing signal. 0.5–500 arcmin, using the survey properties of Paper I and th… view at source ↗
Figure 5
Figure 5. Figure 5: B-mode data vectors across catalog versions: initial (red circles), size-cut/fiducial (gold squares), masked (teal diamonds), and relaxed-flags (purple triangles). Rectangles delineate each bin in the horizontal direction and span the range of values across versions in the vertical direction; horizontal lines mark the fiducial value. Shaded bands mark fiducial scale cuts for ξ± and Cℓ . Top: Pure E/B-mode … view at source ↗
Figure 6
Figure 6. Figure 6: Configuration-space PTE maps for all four catalog versions (Paper I, Table H.1). Columns show ξ B + , ξ B − , and COSEBI Bn PTEs as a function of angular scale cuts; rows show different catalog versions. Solid blue cells indicate PTE < 0.05; whites and reds indicate consistency with zero. Black squares mark the adopted cuts (12–83 arcmin). The size cut (fiducial versus initial) expands the acceptance regio… view at source ↗
Figure 7
Figure 7. Figure 7: Harmonic-space C BB ℓ PTE maps for all four catalog versions (Paper I, Table H.1). Solid blue cells indicate failing PTEs; whites and reds indicate consistency with zero. The initial and relaxed-flags catalogs show widespread failures across multipole ranges; the fiducial and masked catalogs pass across nearly all multipole combinations [PITH_FULL_IMAGE:figures/full_fig_p009_7.png] view at source ↗
Figure 8
Figure 8. Figure 8: COSEBI En (top row) and Bn/σn (bottom row) for the fiducial catalog, computed from configuration-space ξ± (filled circles) and harmonic-space bandpowers (open squares). Gray shading marks modes n ≤ 6, where the cosmological information is concentrated and we confirm consistency between the two paths on GLASS simulations. dithers designed to bridge chip gaps, so the focal-plane pattern maps almost directly … view at source ↗

Review history (2 revisions) →

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Assessing the large-scale angular clustering of UNIONS Lyman Break Galaxies via cross-correlations

    astro-ph.CO 2026-07 conditional novelty 6.0

    UNIONS LBGs yield robust cross-power spectra with Planck CMB lensing and DESI/Quaia quasars at amplitudes matching theory, despite systematics that render the auto-spectrum unusable.

  2. UNIONS-3500 Weak Lensing: III. 2D Cosmological Constraints in Configuration Space

    astro-ph.CO 2026-05 accept novelty 5.0

    UNIONS-3500 weak lensing data yields S_8 = 0.831^{+0.067}_{-0.078} in flat LCDM from 2D cosmic shear, consistent with Planck within 1 sigma.