REVIEW 3 major objections 5 minor 1 cited by
Galaxy-Point Spread Function correlations as a probe of weak-lensing systematics with UNIONS data
T0 review · 3 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read This paper derives a semi-analytical covariance matrix for the galaxy--PSF cross-correlations ($\tau$-statistics) that reproduces the parameter uncertainties from jackknife and simulation-based estimates at about one-eighth the…
desk verdict Useful and fast PSF systematics diagnostic, but the central covariance derivation has an index error that must be fixed before the formula is usable. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The $\tau$-statistics $\tau_0=\langle e\,e_p\rangle$, $\tau_2=\langle e\,\delta e_p\rangle$, $\tau_5=\langle e\,\delta T_p\rangle$ are linear functions of the $\rho$-statistics through parameters $\Omega=(\alpha,\beta,\eta)$, and the paper's new machinery is an analytic covariance for those $\tau$-values. It reduces the four-point correlation of the estimators to a mixed term (galaxy shape noise times a $\rho$-statistics) and cosmic-variance products of shear and PSF correlation functions, with the sums over galaxy positions replaced by ensemble averages over survey area and number density. The connected four-point term is dropped via Wick's theorem, and the shot-noise diagonal is taken from a tree-code estimator of the observed catalog; the resulting matrix is then used in a least-squares solution or a Gaussian likelihood. The redefinition $\tilde{\tau}_5$ replaces the spin-2 star ellipticity factor in the size residual by a tangential unit vector, turning the size-residual contribution into a scalar correlation that no longer mixes with PSF leakage.
What would settle it
Run the semi-analytical covariance on a suite of simulated galaxy catalogs with strongly non-Gaussian fields and with known injected PSF leakage parameters, and show that the least-squares posteriors cover the injected values; failure would demonstrate bias from the Gaussian truncation.
Extended reading notes
Core claim
The central claim is that the covariance matrix of the $\tau$-statistics can be assembled from analytic integrals over the measured two-point functions: a mixed shot-noise term involving the galaxy shape noise $\sigma_e^2$ and the relevant $\rho$-statistics, plus cosmic-variance terms built from products of the shear correlation function and the PSF-field correlations, with the connected four-point term set to zero under the Gaussian assumption. Applied to the UNIONS v1.3 shape catalogue with a data-driven multi-CCD PSF model, this semi-analytical covariance yields contours for $(\alpha,\beta,\eta)$ and a systematic level $\xi_{\mathrm{PSF,sys}}$ that agree at the 68% confidence level with jackknife and simulation-based covariances. The computation takes 27 minutes on 48 cores versus 227 minutes for jackknife, and unlike the simulations it retains galaxy--star cross terms. A reformulated $\tilde{\tau}$-statistics, treating the PSF size residual as a scalar field through a tangential unit-vector factor, removes the $\alpha$--$\eta$ degeneracy while reproducing the same systematic level.
Load-bearing premise
The derivation assumes the galaxy and PSF shape fields are close enough to Gaussian that a four-point correlation can be split into products of two-point correlations; the paper's Gaussianity test uses simulated galaxies only, not simulated stars.
Editorial extensions
If this is right
- PSF systematic parameters and their error bars can be obtained from a single galaxy-plus-star catalog, with no simulation campaign or patch resampling needed.
- The semi-analytical covariance includes galaxy--PSF cross terms that the simulation-based covariance omits, so it is a more complete comparison target.
- Runtime drops from about 227 to 27 minutes for the UNIONS setup, and using the least-squares solver instead of MCMC compounds the gain to a factor of about 8.2.
- The redefined $\tilde{\tau}$-statistics separate the leakage contribution from the size-residual contribution, giving a cleaner null test of PSF size modelling.
- Large tomographic and future survey analyses can run repeated PSF diagnostics across redshift bins or catalog cuts without rebuilding covariances each time.
Reading between the lines
- A natural next test is to validate the semi-analytical covariance on fields with strongly non-Gaussian small-scale clustering or with injected star-position correlations, since the Gaussian truncation is only tested on simulated galaxy fields in the paper.
- The $\tilde{\tau}$ redefinition could be paired with the same semi-analytical covariance derivation, an extension the paper leaves to future work that would give an end-to-end fast diagnostic with both degeneracy removal and low runtime.
- If the runtime advantage holds at future survey sizes, PSF systematics could be tracked as a function of survey depth, observing conditions, or mask geometry in near real time, informing calibration before the final cosmology run.
- The covariance formalism should transfer to fourth-order PSF-moment systematics with an analogous structure, as the paper itself notes.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces a semi-analytical estimator for the covariance matrix of the τ-statistics, i.e., cross-correlations of galaxy ellipticities with PSF ellipticity, ellipticity-residual, and size-residual fields, and applies it to the UNIONS v1.3 shear catalogue. The covariance is constructed from measured ρ-, τ-, and shear correlation functions plus a shot-noise term, using a Gaussian-field assumption to reduce four-point correlators via Wick's theorem. The authors compare constraints on the PSF error parameters (α, β, η) obtained with this covariance against jackknife and GLASS-simulation covariances, report broad agreement, and propose a redefinition of τ5 that breaks the α–η degeneracy. The paper claims a factor of about 8 speed-up relative to jackknife and positions the method as a fast PSF diagnostic for current and Stage IV weak-lensing surveys.
Significance. The methodological goal is timely and the application is nontrivial: the paper contains a detailed derivation, a real-data demonstration, a comparison against two independent covariance estimators, and a practical discussion of degeneracies. If the covariance formula is correct, the semi-analytical approach is genuinely useful for fast PSF-systematics checks in current and future surveys, and the proposed τ~-statistics are a reasonable way to separate leakage from size-residual contamination. However, the central claim of 'comparable results' is currently weakened by an apparent index inconsistency in the main formula and by the incomplete Gaussianity validation.
major comments (3)
- [Sect. 2.5.1, Eqs. (20)–(21)] The published cosmic-variance term in Eq. (21) is inconsistent with its own derivation in Eq. (20). Eq. (20) gives the first Wick term as ξγγ(ϑik)ξbc(ϑjl) along with cos(4(φik−φjl)), while Eq. (21) writes this term, and the second term, with the arguments (ϑil, ϑjk) and cos(4(φil−φjk)). The sentence after Eq. (21) that the result follows from invariance under exchange of the indices k and l is not valid, because k labels a galaxy with weight w^e_k and l labels the PSF-related field c with weight w^c_l; exchanging them changes the weight structure and the field identities. Correspondingly, the ensemble-average treatment in Sect. 2.5.2 (Eq. 27) uses F1(θ23)F2(θ14), which covers only the ξγc ξγb term; the ξγγ ξbc term depends on θ13 and θ24 and is not evaluated there. If the code implements Eq. (21) as written, the covariance is biased at the level of the main new result, and this may explain the elevated reduced chi-square (1.63 vs 0.86) and the visible shift in β. The authors should correct Eq. (21), update the ensemble-average derivation accordingly, re-run the full comparison, and provide the actual code link (the text currently gives only '/gtb').
- [App. B] The Gaussianity test used to justify Wick's theorem in Eq. (19) is based on 300 GLASS realizations in which only the galaxy catalog is simulated; the star and PSF catalogs are the observed data, repeated identically in every realization. The test therefore cannot detect non-Gaussianity in the star and PSF fields, even though those fields enter the covariance through the ξbc and ξγc factors. The Gaussian assumption for the PSF-related fields thus remains unvalidated. Please either extend the test to simulated star/PSF fields, or provide a specific physical and statistical justification for treating those sparse, selection-affected fields as Gaussian.
- [Sect. 4.1, Table 1] The semi-analytical covariance yields χ²_red = 1.63 for 57 degrees of freedom, compared with 0.86 for jackknife and 1.18 for simulations. This is a statistically poor fit, and the text's statement that the fit is 'similar' is not supported by any quantitative comparison. The discrepancy is a red flag that the published semi-analytical covariance does not fully describe the noise. The authors should either demonstrate that the corrected Eq. (21) removes the excess chi-square, or explicitly qualify the claim of comparable results by reporting this goodness-of-fit difference and its consequences for parameter inference.
minor comments (5)
- [Sect. 4.1] The text refers to 'Table 3' when summarizing parameter constraints; the table summarizing these results is Table 1.
- [Sect. 6] The repository link is given as '/gtb' without a resolvable URL; a complete link to the public repository must be provided for reproducibility.
- [Sect. 2.5.2] The sentence 'The first two terms depend on the scalars θ23 and θ14' is unclear, given that the ξγγ ξbc term depends on θ13 and θ24; please clarify the indexing used in the ensemble-average derivation.
- [Fig. 1 caption] The left panel is described as 'analytical expressions from Eq. (18)', but Eq. (18) is the general covariance definition; the actual semi-analytical expression is Eq. (21).
- [Sect. 2.4] The section heading contains a typo: 'τ-statisics' should be 'τ-statistics'.
Circularity Check
No load-bearing circularity; only a self-definitional statistic redefinition and minor self-citations; the central semi-analytical covariance result is externally benchmarked.
-
self definitional
[Section 5.2, Eqs. (36)-(37)]
"The field f is implicitly defined, with respect to the pairs, such that, when computing the ρ- and τ-correlations, only the tangential direction contributes at star positions and for a given polar angle φ. f thus reverts to the unit vector in the tangential direction, f = êt. Thus the correlation function between a spin-2 field a and the product of f with a scalar field s is obtained as follows: ξa[ f s] ± (ϑ) = ⟨at ft s⟩(ϑ) ± ⟨a× f×s⟩(ϑ) = ⟨at s⟩(ϑ)."
The paper presents the tilde-τ redefinition as a way to break the degeneracy between α and η, but the degeneracy-breaking property is placed into the construction by hand: f is chosen so that only the tangential component contributes, which removes the e* leakage information from the size-residual term. Eq. (37) is then a restatement of that definition rather than an independent derived result. The step is transparently labeled a redefinition and does not affect the main semi-analytical covariance comparison, so the circular impact is minor.
full rationale
The paper's central derivation—the semi-analytical covariance of the τ-statistics (Sect. 2.5, Eqs. 18-21)—is not circular. It is a Wick expansion of the four-point correlator under a stated Gaussianity assumption, with the connected term set to zero; the inputs are the ρ-, τ-, and ξγγ correlation functions, plugged in from the data. Section 2.5.3 states: 'we have no theoretical predictions for the ρ- and τ-statistics and use the statistics estimated on the data to build the covariance matrix.' Plug-in covariance estimation is standard and does not reduce the subsequent fit of (α, β, η) to a tautology: the validation against jackknife resampling and 300 GLASS simulations (Sect. 4) is external to the semi-analytical construction. The final systematic level ξ_PSF,sys (Eq. 15) is by definition a function of the fitted parameters and the ρ-statistics; the paper compares it across three independent covariance estimates, so the agreement is not statistically forced. The one definitional item is the Section 5.2 redefinition of the τ-statistics: f is defined so that only the tangential component contributes, making the claimed degeneracy-breaking true by construction (Eq. 37). This is transparent and does not bear on the main covariance result. Minor self-citations (Schneider et al. 2002, coauthored by Kilbinger; Kilbinger et al. 2021) are not load-bearing: the covariance formalism is reproduced in the paper and even corrected ('Note that this is incorrectly stated in Schneider et al. (2002)'). Correctness caveats that are not circularity include: the Gaussianity test (App. B) uses galaxy-only GLASS simulations, so the Gaussianity of the star/PSF fields entering the covariance is not directly tested; the apparent index inconsistency between Eqs. (20) and (21) is an internal-error concern; and the code link is missing, hampering reproduction. These lower confidence but do not make the derivation circular.
Assumptions & free parameters
free parameters (3)
- alpha (PSF leakage amplitude) =
0.014 +/- 0.008 (least-squares, semi-analytical)
- beta (PSF ellipticity residual amplitude) =
0.96 to 1.1 across methods
- eta (size residual amplitude) =
-0.4 to -1.4 across methods
assumptions (8)
- domain assumption The underlying spin-2 fields are Gaussian, so the connected four-point term vanishes via Wick's theorem.
- domain assumption All weights are set to unity in the covariance ensemble-average calculation.
- domain assumption The survey geometry is approximated by a solid angle A with uniform object number density.
- domain assumption Parity conservation of the involved fields, so xi_x = 0 and xi_* = 0.
- domain assumption The PSF error model is linear and the parameters alpha, beta, eta are scale-independent.
- domain assumption PSF fields are deterministic with no stochastic component (b_obs = b).
- domain assumption Correlation functions vary slowly over the angular bin width.
- domain assumption The tau-statistics follow a Gaussian likelihood.
invented entities (1)
-
Field f defined as the unit tangential vector e_t
Cite this review
Pith. "Pith review of Galaxy-Point Spread Function correlations as a probe of weak-lensing systematics with UNIONS data." pith.science (2026). https://pith.science/paper/UZG5MKU6
@misc{pith2026241214666,
author = {Pith},
title = {Pith review of: Galaxy-Point Spread Function correlations as a probe of weak-lensing systematics with UNIONS data},
year = {2026},
howpublished = {\url{https://pith.science/paper/UZG5MKU6}},
note = {Machine review of arXiv:2412.14666}
}
abstract
Weak gravitational lensing requires precise measurements of galaxy shapes and therefore an accurate knowledge of the PSF model. The latter can be a source of systematics that affect the shear two-point correlation function. A key stake of weak lensing analysis is to forecast the systematics due to the PSF. Correlation functions of galaxies and the PSF, the so-called $\rho$- and $\tau$-statistics, are used to evaluate the level of systematics coming from the PSF model and PSF corrections, and contributing to the two-point correlation function used to perform cosmological inference. Our goal is to introduce a fast and simple method to estimate this level of systematics and assess its agreement with state-of-the-art approaches. We introduce a new way to estimate the covariance matrix of the $\tau$-statistics using analytical expressions. The covariance allows us to estimate parameters directly related to the level of systematics associated with the PSF and provides us with a tool to validate the PSF model used in a weak-lensing analysis. We apply those methods to data from the Ultraviolet Near-Infrared Optical Northern Survey (UNIONS). We show that the semi-analytical covariance yields comparable results than using covariances obtained from simulations or jackknife resampling. It requires less computation time and is therefore well suited for rapid comparison of the systematic level obtained from different catalogs. We also show how one can break degeneracies between parameters with a redefinition of the $\tau$-statistics. The methods developed in this work will be useful tools in the analysis of current weak-lensing data but also of Stage IV surveys such as Euclid, LSST or Roman. They provide fast and accurate diagnostics on PSF systematics that are crucial to understand in the context of cosmic shear studies.
Figures
Figures from the paper (7 more)
Forward citations
Cited by 1 Pith paper
-
Galaxies OBserved as Low-luminosity Identified Nebulae (GOBLIN): a catalog of 43,000 high-probability dwarf galaxy candidates in the UNIONS survey
A machine-learning pipeline applied to the UNIONS survey identifies 42,965 high-probability dwarf galaxy candidates, released as the GOBLIN catalog.
Reference graph
Works this paper leans on
-
[1]
, " * write output.state after.block = add.period write newline
ENTRY address archiveprefix author booktitle chapter edition editor howpublished institution eprint journal key month note number organization pages publisher school series title type volume year label extra.label sort.label short.list INTEGERS output.state before.all mid.sentence after.sentence after.block FUNCTION init.state.consts #0 'before.all := #1 ...
-
[2]
write newline
" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 global.max substring 't := if while FUNCTION word.in bbl.in " " * FUNCTION format....
-
[3]
2019, The Wide Field Infrared Survey Telescope : 100 Hubbles for the 2020s
Akeson, R., Armus, L., Bachelet, E., et al. 2019, The Wide Field Infrared Survey Telescope : 100 Hubbles for the 2020s
work page 2019
-
[4]
Amon, A., Robertson, N. C., Miyatake, H., et al. 2023, Monthly Notices of the Royal Astronomical Society, 518, 477
work page 2023
-
[5]
2021, Astronomy & Astrophysics, 645, A104
Asgari, M., Lin, C.-A., Joachimi, B., et al. 2021, Astronomy & Astrophysics, 645, A104
work page 2021
- [6]
- [7]
-
[8]
Cannon, P., Ward, D., & Schmon, S. M. 2022, Investigating the Impact of Model Misspecification in Neural Simulation-based Inference
work page 2022
Show all 51 references
-
[9]
2024, Euclid
Collaboration, E., Mellier, Y., Abdurro'uf, et al. 2024, Euclid. I . Overview of the Euclid Mission
2024
-
[10]
2023, Physical Review D, 108, 123519
Dalal, R., Li, X., Nicola, A., et al. 2023, Physical Review D, 108, 123519
2023
-
[11]
2022, Physical Review D, 105, 023514
DES Collaboration , Amon, A., Gruen, D., et al. 2022, Physical Review D, 105, 023514
2022
-
[12]
2022, , 664, A141
Farrens , S., Guinot , A., Kilbinger , M., et al. 2022, , 664, A141
2022
-
[13]
W., Lang, D., & Goodman, J
Foreman-Mackey , D., Hogg, D. W., Lang, D., & Goodman, J. 2013, Publications of the Astronomical Society of the Pacific, 125, 306
2013
-
[14]
F., & Gruen , D
Friedrich , O., Seitz , S., Eifler , T. F., & Gruen , D. 2016, , 456, 2662
2016
-
[15]
Gatti, M., Jeffrey, N., Whiteway, L., et al. 2023, Dark Energy Survey Year 3 Results: Simulation-Based Cosmological Inference with Wavelet Harmonics, Scattering Transforms, and Moments of Weak Lensing Mass Maps I : Validation on Simulations
2023
-
[16]
2021, Monthly Notices of the Royal Astronomical Society, 504, 4312
Gatti, M., Sheldon, E., Amon, A., et al. 2021, Monthly Notices of the Royal Astronomical Society, 504, 4312
2021
-
[17]
2021, Astronomy & Astrophysics, 645, A105
Giblin, B., Heymans, C., Asgari, M., et al. 2021, Astronomy & Astrophysics, 645, A105
2021
-
[18]
2021, , 645, A105
Giblin , B., Heymans , C., Asgari , M., et al. 2021, , 645, A105
2021
-
[19]
2022, , 666, A162
Guinot , A., Kilbinger , M., Farrens , S., et al. 2022, , 666, A162
2022
-
[20]
Gwyn, S. et al. 2025, in preparation
2025
-
[21]
2020, Publications of the Astronomical Society of Japan, 72, 16
Hamana, T., Shirasaki, M., Miyazaki, S., et al. 2020, Publications of the Astronomical Society of Japan, 72, 16
2020
-
[22]
2012, Monthly Notices of the Royal Astronomical Society, 427, 146
Heymans, C., van Waerbeke , L., Miller, L., et al. 2012, Monthly Notices of the Royal Astronomical Society, 427, 146
2012
-
[23]
2006, , 371, 750
Heymans , C., White , M., Heavens , A., Vale , C., & van Waerbeke , L. 2006, , 371, 750
2006
- [24]
-
[25]
A., McConnachie , A., Cuillandre , J.-C., et al
Ibata , R. A., McConnachie , A., Cuillandre , J.-C., et al. 2017, , 848, 128
2017
-
[26]
M., Tyson, J
Ivezi \'c , Z ., Kahn, S. M., Tyson, J. A., et al. 2019, The Astrophysical Journal, 873, 111
2019
-
[27]
2004, , 352, 338
Jarvis, M., Bernstein, G., & Jain, B. 2004, , 352, 338
2004
-
[28]
2016, , 460, 2245
Jarvis , M., Sheldon , E., Zuntz , J., et al. 2016, , 460, 2245
2016
-
[29]
2024, Dark Energy Survey Year 3 Results: Likelihood-Free, Simulation-Based \ w\ CDM Inference with Neural Compression of Weak-Lensing Map Statistics
Jeffrey, N., Whiteway, L., Gatti, M., et al. 2024, Dark Energy Survey Year 3 Results: Likelihood-Free, Simulation-Based \ w\ CDM Inference with Neural Compression of Weak-Lensing Map Statistics
2024
-
[30]
1995, The Astrophysical Journal, 449, 460
Kaiser, N., Squires, G., & Broadhurst, T. 1995, The Astrophysical Journal, 449, 460
1995
-
[31]
2015, Reports on Progress in Physics, 78, 086901
Kilbinger , M. 2015, Reports on Progress in Physics, 78, 086901
2015
-
[32]
Kilbinger , M., Ishida , E. E. O., & Cisewski-Kehe , J. 2021, arXiv e-prints, arXiv:2112.03148
2021 arXiv
-
[33]
& Schneider, P
Kilbinger, M. & Schneider, P. 2004, , 413, 465
2004
-
[34]
2011, arXiv:1110.3193 [ [arXiv] 1110.3193 ]
Laureijs , R., Amiaux , J., Arduini , S., et al. 2011, arXiv:1110.3193 [ [arXiv] 1110.3193 ]
2011 arXiv
-
[35]
2024, arXiv e-prints, arXiv:2402.10740
Li , Q., Kilbinger , M., Luo , W., et al. 2024, arXiv e-prints, arXiv:2402.10740
2024 arXiv
-
[36]
2023 a , Astronomy and Astrophysics, 670, A100
Li, S.-S., Kuijken, K., Hoekstra, H., et al. 2023 a , Astronomy and Astrophysics, 670, A100
2023
-
[37]
2023 b , Hyper Suprime-Cam Year 3 Results : Cosmology from Cosmic Shear Two-point Correlation Functions
Li, X., Zhang, T., Sugiyama, S., et al. 2023 b , Hyper Suprime-Cam Year 3 Results : Cosmology from Cosmic Shear Two-point Correlation Functions
2023
-
[38]
2021, , 646, A27
Liaudat , T., Bonnin , J., Starck , J.-L., et al. 2021, , 646, A27
2021
-
[39]
2018, , 56, 393
Mandelbaum , R. 2018, , 56, 393
2018
-
[40]
2018, Annual Review of Astronomy and Astrophysics, 56, 393
Mandelbaum, R. 2018, Annual Review of Astronomy and Astrophysics, 56, 393
2018
-
[41]
Paulin-Henriksson , S., Amara , A., Voigt , L., Refregier , A., & Bridle , S. L. 2008, , 484, 67
2008
-
[42]
2010, , 404, 350
Rowe , B. 2010, , 404, 350
2010
-
[43]
2002, , 396, 1
Schneider, P., Van Waerbeke, L., Kilbinger, M., & Mellier, Y. 2002, , 396, 1
2002
-
[44]
2002, , 389, 729
Schneider , P., Van Waerbeke, L., & Mellier , Y. 2002, , 389, 729
2002
-
[45]
& Heavens, A
Sellentin, E. & Heavens, A. F. 2018, Monthly Notices of the Royal Astronomical Society, 473, 2355
2018
-
[46]
Sheldon , E. S. & Huff , E. M. 2017, , 841, 24
2017
-
[47]
2023, The Open Journal of Astrophysics, 6, 10.21105/astro.2302.01942
Tessore, N., Loureiro, A., Joachimi, B., von Wietersheim-Kramsta , M., & Jeffrey, N. 2023, The Open Journal of Astrophysics, 6, 10.21105/astro.2302.01942
2023 arXiv
-
[48]
E., et al
Virtanen, P., Gommers, R., Oliphant, T. E., et al. 2020, Nature Methods, 17, 261
2020
-
[49]
2024, KiDS-SBI : Simulation-Based Inference Analysis of KiDS-1000 Cosmic Shear
von Wietersheim-Kramsta , M., Lin, K., Tessore, N., et al. 2024, KiDS-SBI : Simulation-Based Inference Analysis of KiDS-1000 Cosmic Shear
2024
-
[50]
2023, Monthly Notices of the Royal Astronomical Society, 525, 2441
Zhang, T., Li, X., Dalal, R., et al. 2023, Monthly Notices of the Royal Astronomical Society, 525, 2441
2023
-
[51]
2024, arXiv e-prints, arXiv:2405.03434
Zhang , Z., Kilbinger , M., Hervas Peters , F., et al. 2024, arXiv e-prints, arXiv:2405.03434
2024 arXiv
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.