Pith. Sign in

REVIEW

ALPACA I: Controlling source and PSF systematics in JWST time-delay cosmography with differentiable lens modeling

Instrumentation and Methods for Astrophysics · Submitted 3 Sep 2026 · 89 references

Pith's verdict: A well-validated methods paper that makes a real practical point: joint PSF and pixelated-source reconstruction is affordable and removes most of the PSF systematic on D_Delta_t in realistic mocks, with the main caveat being that the mock PSF errors are spatially uniform.

T0 · AI review

How this review was made: An AI referee (deepseek/deepseek-v4-flash) read the paper on September 8, 2026 and answered a fixed list of questions about it. T0 is the starting level every paper gets. The levels describe how deeply Pith has checked the paper, never the authors.

  1. T0 AI review An AI read the paper and answered a fixed list of questions.
  2. T1 Audit Automatic checks that the references and files the paper relies on exist and match.
  3. T2 Compute The paper's code or calculations re-run with the same results.
  4. T3 Formal statement The claims written out in a formal math language a computer can read.
  5. T4 Proof Those claims proved, and the proof checked by computer.

How Pith checks papers →

· 3 major objections · 5 minor · Ask about this paper · The compiled record · Read the full review →
Challenge this review Comment (0) Read on arXiv ↗
Cite ▾
arXiv ID2609.04312 (version 1)
Pith IDSQ5GWQ4X, Pith's permanent record of this paper and its review
CitationAymeric Galan, Hrvoje Krizic, Martin Millon, Phil Marshall, Sydney Erickson. "ALPACA I: Controlling source and PSF systematics in JWST time-delay cosmography with differentiable lens modeling." arXiv:2609.04312 (2026). https://pith.science/paper/SQ5GWQ4X
Cite this reviewBibTeX for Pith's review of this paper
Claim paper

Why Pith says this

Highlight any text to comment on it.

Referee report
The paper

The paper claims

A fixed but imperfect JWST point spread function biases inferred time-delay distances by as much as 14 percent, and reconstructing the PSF jointly with the lens and source brings that bias to the percent level.

The reading

ALPACA is a new semi-automatic, GPU-accelerated, differentiable strong-lens modeling pipeline that fits the lensed source galaxy, the lens mass, the point spread function (PSF), and the time-delay distance $D_{\Delta t}$ — the combination that scales inversely with the Hubble constant — inside one joint likelihood. The paper aims to establish that the two image-level systematics which rigid models cannot absorb, irregular source morphology and an imperfectly known PSF, are both controllable, and that a fixed but wrong PSF is the larger danger. On realistic mock JWST/NIRCam images built from real galaxies, holding a kernel only 12% from the truth fixed biases $D_{\Delta t}$ by a median of 14%; jointly reconstructing the PSF cuts that bias to +1.9%. Because one full per-lens analysis runs in under 15 hours on a single GPU, the authors conclude that rigorous control of source and PSF systematics is computationally affordable, not a reason to retreat to rigid models. If the result transfers to real observations, it removes a systematic that currently rivals mass-model uncertainties in the campaign to measure $H_0$ independently of the cosmic microwave background and the distance ladder.

What carries the argument

The load-bearing object is the parametric PSF model: an analytic elliptical Moffat core plus a pixelated background grid, anchored to an initial star-based kernel estimate by a Gaussian prior scaled by a PSF error map, and regularized by a starlet-transform $\ell^1$ penalty. Because the entire forward model is differentiable, this kernel can be optimized — and later sampled — simultaneously with an elliptical power-law mass, S\'ersic lens light, a pixelated correlated-field source (a Gaussian-process prior on source pixels with an inferred power spectrum), quasar image positions, and $D_{\Delta t}$ in one likelihood. Multi-start gradient descent locates the joint maximum, and Hamiltonian Monte Carlo with geometric variational inference maps the posterior, including the inner PSF-core pixels. This combination is what reduces a full per-lens analysis from weeks to under 15 hours on a single GPU, making a flexible source and a free PSF affordable.

Extended reading notes

Core claim

The central claim is that a fixed, imperfect PSF is the dominant image-level systematic in JWST time-delay cosmography, and that fitting the PSF jointly with the lens and source in a single differentiable likelihood removes it. In a controlled ladder of ten mock JWST/NIRCam lenses, supplying distorted kernels with 0.4%, 2.0%, and 12.4% root-mean-square error from the truth produces median biases in the time-delay distance of $-$2.1%, $-$4.5%, and $-$14.1%, because the point-source residuals left by the wrong kernel are absorbed into the mass parameters. The joint reconstruction reverses this trend: median biases become $+0.7\%$, $+1.2\%$, and $+1.9\%$, comparable to the 0.84% combined statistical precision of the exact-PSF quad sample, while the recovered kernel itself reaches about 1.4% RMSE from truth in quads. The inner $(6\times\mathrm{FWHM})^2$ pixels of that kernel can be promoted to sampled parameters, and covariance maps show the remaining coupling to the mass slope and $D_{\Delta t}$ is confined to the bright core. Propagating the ten-lens posteriors through hierarchical inference recovers $H_0 = 68.95 \pm 0.83$ km s$^{-1}$ Mpc$^{-1}$ against the input 70, an offset the authors judge within expected sample variance.

Load-bearing premise

The validation assumes that a realistic PSF error can be represented as the smooth, low-order affine field distortion of Equation (23); if real JWST PSF errors are dominated by chromatic, detector, or time-varying components outside that family, the measured reduction of the $D_{\Delta t}$ bias may not fully transfer to real observations.

Editorial extensions

If this is right

  • A fixed, imperfect PSF biases $D_{\Delta t}$ monotonically with mismatch size — median $-$2.1%, $-$4.5%, and $-$14.1% — so any JWST analysis that uses only a star-derived kernel carries a systematic that can exceed its statistical error bar.
  • Joint PSF reconstruction brings the median bias to $+0.7\%$, $+1.2\%$, and $+1.9\%$ across the three distortion levels, placing the residual bias in the same percent regime as the 0.84% statistical precision of the exact-PSF quad sample.
  • Quadruple-image systems constrain the PSF roughly twice as well as doubles — recovered kernel RMSE about 1.4% versus 2.5% — since four quasar images provide more independent constraints on the kernel.
  • Sampling the inner $(6\times\mathrm{FWHM})^2$ PSF pixels together with the lens parameters is computationally feasible and shows the residual PSF–lens coupling is confined to the bright core.
  • One fixed pipeline configuration, applied without per-system tuning, fits all ten lenses and recovers the input cosmology through hierarchical inference, with $H_0 = 68.95 \pm 0.83$ km s$^{-1}$ Mpc$^{-1}$ against an input of 70.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The affine-field distortions of the PSF experiment are smooth and low-order; real JWST PSF errors also contain chromatic, temporal, and detector components, so the measured bias reduction is best read as a floor on the difficulty, with joint sampling as the mechanism that would expose un-modelled components in real data.
  • The near-resolution-independent gradient cost on a GPU points toward the roughly thousand-lens LSST time-delay sample, where per-lens runtimes of hours rather than weeks are what make uniform modeling of the whole sample feasible.
  • Because the mass model is fixed to an elliptical power law plus shear throughout, the mass-sheet degeneracy is excluded by construction; pairing the same joint likelihood with explicit mass-sheet exploration would extend this systematic control to the mass-profile axis.
  • The PSF–parameter covariance maps suggest a transferable diagnostic: in real data, a wrong fixed PSF should leave a detectable, coherent correlation between quasar-image residuals and the recovered mass slope and $D_{\Delta t}$, giving a data-driven check on the adequacy of the PSF prior.
Original abstract

Time-delay cosmography provides an independent probe of the Hubble constant ($H_0$), but exploiting the high-resolution imaging of the James Webb Space Telescope (JWST) requires strong-lens models that capture complex source-galaxy morphologies and the point spread function (PSF) with high fidelity. Flexible source and joint PSF reconstruction are computationally expensive, motivating more rigid parameterizations that can bias the inferred time-delay distance $D_{\Delta t}$. We present ALPACA, a semi-automatic, GPU-accelerated, differentiable strong-lens modeling pipeline built on Herculens, Starred, and JAX. ALPACA jointly reconstructs a pixelated correlated-field source, the lens mass, and the PSF within a single likelihood, reducing per-system runtimes from weeks to less than 15 hours. We validate the pipeline on realistic mock JWST/NIRCam observations built from morphologically complex COSMOS galaxy sources. Holding an imperfect PSF (RMSE = 12% from truth) fixed biases $D_{\Delta t}$ by up to 14%, whereas joint PSF reconstruction reduces this bias to the percent level. We further show that the reconstructed PSF core can be marginalized over jointly with the lens parameters during posterior sampling. Propagating the per-lens posteriors of a ten-lens mock sample through hierarchical inference, we recover the input cosmology without significant bias. ALPACA shows that rigorous control of source and PSF systematics is computationally affordable, supporting reliable percent-level precision in the JWST era.

The compiled record

The paper's own sentences, arranged, kept beside the review and separate from it. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.

Compiled by classifier-1.13.0 via TypeSafe API, question bank abstract-p1-20260923, 2026-09-23: 1 request, 7,144 input tokens.

What the abstract itself states, as probabilities: claims first 0.05 · states limitation 0.29 · human participants 0.02 · controlled comparison 0.59 · randomized assignment 0.01 · states quantitative result 0.99 · compares with prior results 0.71 · mentions code or data availability 0.05.

The abstract, sentence by sentence

arXiv listing abstract v1. Results and the main claim are underlined; .

Time-delay cosmography provides an independent probe of the Hubble constant ($H_0$), but exploiting the high-resolution imaging of the James Webb Space Telescope (JWST) requires strong-lens models that capture complex source-galaxy morphologies and the point spread function (PSF) with high fidelity. Flexible source and joint PSF reconstruction are computationally expensive, motivating more rigid parameterizations that can bias the inferred time-delay distance $D_{\Delta t}$. We present ALPACA, a semi-automatic, GPU-accelerated, differentiable strong-lens modeling pipeline built on Herculens, Starred, and JAX. ALPACA jointly reconstructs a pixelated correlated-field source, the lens mass, and the PSF within a single likelihood, reducing per-system runtimes from weeks to less than 15 hours. We validate the pipeline on realistic mock JWST/NIRCam observations built from morphologically complex COSMOS galaxy sources. Holding an imperfect PSF (RMSE = 12% from truth) fixed biases $D_{\Delta t}$ by up to 14%, whereas joint PSF reconstruction reduces this bias to the percent level. We further show that the reconstructed PSF core can be marginalized over jointly with the lens parameters during posterior sampling. Propagating the per-lens posteriors of a ten-lens mock sample through hierarchical inference, we recover the input cosmology without significant bias. ALPACA shows that rigorous control of source and PSF systematics is computationally affordable, supporting reliable percent-level precision in the JWST era.

background contribution method result interpretation main claim

What the classifier reports for each sentence. The number is the probability it gave the label.
#sentencerolethe authors' own workstates the main conclusionstrength
s0 Time-delay cosmography provides an independent probe of the Hubble constant ($H_0$), but exploiting the high-resolution imaging of the James Webb Space Telescope (JWST) requires strong-lens models that capture complex source-galaxy morphologies and the point spread function (PSF) with high fidelity. background 0.99 0.06 0.04 asserted 0.99
s1 Flexible source and joint PSF reconstruction are computationally expensive, motivating more rigid parameterizations that can bias the inferred time-delay distance $D_{\Delta t}$. background 0.63 0.09 0.03 asserted 0.88
s2 We present ALPACA, a semi-automatic, GPU-accelerated, differentiable strong-lens modeling pipeline built on Herculens, Starred, and JAX. contribution 0.72 0.91 0.04 asserted 0.99
s3 ALPACA jointly reconstructs a pixelated correlated-field source, the lens mass, and the PSF within a single likelihood, reducing per-system runtimes from weeks to less than 15 hours. method 0.70 0.95 0.14 asserted 1.00
s4 We validate the pipeline on realistic mock JWST/NIRCam observations built from morphologically complex COSMOS galaxy sources. method 0.87 0.96 0.03 asserted 0.99
s5 Holding an imperfect PSF (RMSE = 12% from truth) fixed biases $D_{\Delta t}$ by up to 14%, whereas joint PSF reconstruction reduces this bias to the percent level. result 1.00 0.93 0.17 asserted 0.99
s6 We further show that the reconstructed PSF core can be marginalized over jointly with the lens parameters during posterior sampling. method 0.64 0.94 0.05 asserted 0.97
s7 Propagating the per-lens posteriors of a ten-lens mock sample through hierarchical inference, we recover the input cosmology without significant bias. result 1.00 0.96 0.13 asserted 1.00
s8 ALPACA shows that rigorous control of source and PSF systematics is computationally affordable, supporting reliable percent-level precision in the JWST era. interpretation 0.99 0.90 0.89 asserted 0.97

What kind of paper the classifier reports this is: method or tool 1.00 · evidence from simulation or computation 1.00.

What was examined, and what was not

sources read
  • arXiv listing abstract v1
not examined
  • full text
  • figures and tables
  • references and citing sentences
  • relations to other papers
levels run
  • P abstract
not run
  • S sections
  • T body sentences
  • C citations
  • R cross-paper relations

Every quoted sentence on this record is the authors'. Every label is from Pith's closed vocabulary, with the probability shown beside it. Every number in the measurements table is the authors', checked by code. Record as JSON

Figures
Figure 1. The staged Alpaca workflow. Input: the image, noise map, an initial PSF guess, and the measured time delays are given as an input from the user. Furthermore, the user specifies the modeling choices inside a configuration file, which is passed to Alpaca. Maximum A Posteriori (MAP) estimation: a smooth Sérsic+Shapelet source is fit by multi-start gradient descent (1). The lens is then frozen and the source swapped for a correlated field (2). Source, lens, and PSF are finally jointly fitted together (3). The PSF is throughout modeled using Starred parametrization, anchored by a prior…
Figure 2. The controlled PSF distortions of the Rung 2 experiment.
Figure 3. Representative Rung 1 fit: a quad whose source is a real COSMOS galaxy, modeled with the staged correlated field and
Figure 4. Azimuthally-averaged PSF reconstruction for three representative systems (columns) using the Rung 2c distorted kernel.
Figure 5. Fractional bias on the recovered time-delay distance,
Figure 6. Hierarchical recovery of the cosmological and lens

Figures reproduced from arXiv:2609.04312 by the authors.

References

Discussion

Disagree with the review, or know something it missed? Leave a comment, highlight any passage above to comment on it, or challenge this review formally.