Pith. Sign in

REVIEW

Reassessing the ZTF Volume-Limited Type Ia Supernova Sample and Its Implications for Continuous, Dust-Dependent Models of Intrinsic Scatter

PaperPDF from arXiv

data files

ReviewThe objections and verdict, as JSON Paper breakdownThe authors' claims, conditions and measurements, as JSON Signed receiptProof this review has not been altered
X Bluesky LinkedIn Reddit Hacker News
Yukei S. Murakami, Daniel Scolnic

Cosmology and Nongalactic Astrophysics · Submitted 7 May 2025 · 45 references

Pith's verdict: Solid nonparametric evidence for color-dependent residual scatter, but the headline significance claims are not calibrated and need revision.

T0 · AI review

How this review was made: An AI referee (deepseek-v4-flash) read the paper on August 15, 2026 and answered a fixed list of questions about it. T0 is the starting level every paper gets. The levels describe how deeply Pith has checked the paper, never the authors.

  1. T0 AI review An AI read the paper and answered a fixed list of questions.
  2. T1 Audit Automatic checks that the references and files the paper relies on exist and match.
  3. T2 Compute The paper's code or calculations re-run with the same results.
  4. T3 Formal statement The claims written out in a formal math language a computer can read.
  5. T4 Proof Those claims proved, and the proof checked by computer.

How Pith checks papers →

· 3 major objections · 4 minor · Ask about this paper · The compiled record · Read the full review →
Challenge this review Comment (0) Read on arXiv ↗
Cite ▾
arXiv ID2505.04686 (version 1)
Pith IDR5LMOBTP, Pith's permanent record of this paper and its review
CitationDaniel Scolnic, Yukei S. Murakami. "Reassessing the ZTF Volume-Limited Type Ia Supernova Sample and Its Implications for Continuous, Dust-Dependent Models of Intrinsic Scatter." arXiv:2505.04686 (2025). https://pith.science/paper/R5LMOBTP
Cite this reviewBibTeX for Pith's review of this paper
Claim paper

Why Pith says this

Highlight any text to comment on it.

Referee report

How Pith checks papers → · Full audit of this paper →

The paper

The paper claims

ZTF's volume-limited SNe Ia show a continuous, color-dependent host correction is preferred over the discrete mass-step model.

The reading

This paper reanalyzes the 945 Type Ia supernovae in the volume-limited ZTF DR2 sample with the same fitting conventions used for earlier large samples, and argues that the data support a dust-driven, color-dependent explanation of residual scatter rather than a discrete progenitor-step picture. The authors report that the host-mass “step” depends on SN color — red supernovae show a larger host-dependent residual than blue ones by $0.18 \pm 0.09$ mag — and that red supernovae have roughly $\sim 33\%$ larger residual scatter than blue ones at more than $3\sigma$ significance. Their new correction model, Host2D, treats the residual as a continuous surface over SN color and host mass; it improves the fit over the standard mass-step model by $4.0\sigma$, which they call the strongest evidence to date that this relation is continuous rather than step-like. If correct, the standard mass-step correction is insufficient and cosmology analyses should adopt a continuous, color-dependent host correction.

What carries the argument

The load-bearing object is Host2D, an 11-parameter correction map built as a bivariate spline with a single knot: in each of the four regions around the knot, the residual is a linear function of SALT2 color $c$ and host property $h$, with the two regions connected continuously. Its best-fit knot lands near $c_0 \approx 0.04$ and host mass $\approx 10.03$, matching the point where the alligator-mouth divergence begins. The paper also relies on rolling-median binning with Monte Carlo bootstrapping to reveal the continuous profile, a three-way host-mass split (at $9.5$ and $10.3$ dex) to expose the intermediate population, and a fixed intrinsic scatter $\sigma_{\mathrm{int}} = 0.17$ mag used in the $\chi^2$ comparisons of models.

Extended reading notes

Core claim

The central claim is that the ZTF DR2 volume-limited sample, analyzed in the same way as other large SNe Ia samples, reproduces the “alligator-mouth” pattern predicted by dust-scatter models: the host-galaxy dependence of Hubble residuals nearly vanishes for blue supernovae near $c \approx -0.1$ (separation $0.05 \pm 0.06$ mag) and opens up to $0.23 \pm 0.07$ mag for red supernovae near $c \approx 0.1$, a color-dependent increase of $0.18 \pm 0.09$ mag. The paper further claims that red supernovae show $\sim 33\%$ larger residual scatter than blue supernovae ($3.4\sigma$), that a color-dependent model beats a simple step model at $\sim 3\sigma$, and that the relationship between SN color, host-galaxy properties, and luminosity is continuous rather than characterized by a discrete step ($3.5\sigma$). Its new Host2D model improves the fit over the mass-step model by $4.0\sigma$, and the paper traces the earlier ZTF conclusion to differences in binning, split locations, and fitting method rather than to the data itself.

Load-bearing premise

The reported significances rest on fixing the intrinsic scatter at $\sigma_{\mathrm{int}} = 0.17$ mag in the $\chi^2$ statistic; if the true intrinsic scatter differs or depends on color, the $4.0\sigma$ and $3.5\sigma$ preferences change.

Editorial extensions

If this is right

  • The standard mass-step correction, which applies a single offset split at one host-mass value, underfits the data; a color-dependent surface is needed.
  • Cosmology analyses should expect redder supernovae in massive hosts to carry larger correction uncertainties, since residual scatter grows with color.
  • The difference between the earlier ZTF conclusion and this paper’s conclusion is attributable to analysis methodology, not to a difference in the sample.
  • A natural next step is extending Host2D into stretch space (a “Host3D” model), because stretch-dependent residual trends survive all corrections tested here.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If Host2D’s significance depends on the fixed $\sigma_{\mathrm{int}} = 0.17$ mag, then marginalizing over $\sigma_{\mathrm{int}}$ or allowing it to be color-dependent could move the reported $4.0\sigma$ preference; this test is not run in the paper.
  • The host-mass split points at 9.5 and 10.3 dex are read off the same residuals used to claim continuity, so a fully unbiased validation would preselect those splits (e.g., on a simulated sample) before measuring the $0.18$ mag color dependence.
  • A dust interpretation also predicts a correlation between residual scatter and host extinction or reddening; checking whether redder-host supernovae concentrate at the high-scatter end would extend the dust reading beyond mean offsets.
Original abstract

The ZTF DR2 includes light curves of 3628 Type Ia supernovae (SNe Ia), making it the largest low-redshift SNe Ia sample available. One central question for analyses of SNe Ia is whether the remaining diversity of standardized luminosities arises in part from an intrinsic or extrinsic effect; characterized by the color-independent bimodality in progenitor population or color- and host- dependent diversity in dust extinction, respectively. In the initial analyses of the volume-limited subset (z < 0.06; 945 SNe) of this sample from the ZTF collaboration, the authors reported evidences for the former hypothesis, in contrast to many of the previous evidences for the dust hypothesis found across other largest high- and low- redshift SNe Ia samples. We re-analyze the volume-limited ZTF SNe Ia in the same manner that previous samples were analyzed and report consistency with trends seen in literature samples and in support of the dust hypothesis. We find the following: 1. a color dependency in the canonical `mass-step' size for SNe, with red SNe having a larger host-dependent residual step than blue SNe by 0.18 $\pm$ 0.09 mag; 2. a color-dependent difference in the Hubble residual scatter, with red SNe having a $\sim$ 33% larger scatter than blue SNe at > 3$\sigma$ significance; 3. data's preference of a model that accounts for color-dependency over a simple `step' model at $\sim$ 3$\sigma$; 4. the strongest evidence to date (3.5$\sigma$) that the relationship between SN color, host-galaxy properties, and luminosity is continuous rather than characterized by a discrete step. Accounting for 3 and 4 with our new model, Host2D, yields a 4.0$\sigma$ improvement over the mass-step model. We trace the difference in reported findings to the fitting and analysis methods, in particular the model complexity allowed for the color-luminosity relation, rather than a difference in the sample itself.

The compiled record

The paper's own sentences, arranged, kept beside the review and separate from it. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.

Compiled by classifier-1.13.0 via TypeSafe API, question bank abstract-p1-20260923, 2026-09-23: 1 request, 6,168 input tokens.

What the abstract itself states, as probabilities: claims first 0.12 · states limitation 0.17 · human participants 0.02 · controlled comparison 0.34 · randomized assignment 0.02 · states quantitative result 0.99 · compares with prior results 0.98 · mentions code or data availability 0.03.

The abstract, sentence by sentence

arXiv listing abstract v1. Results and the main claim are underlined; .

The ZTF DR2 includes light curves of 3628 Type Ia supernovae (SNe Ia), making it the largest low-redshift SNe Ia sample available. One central question for analyses of SNe Ia is whether the remaining diversity of standardized luminosities arises in part from an intrinsic or extrinsic effect; characterized by the color-independent bimodality in progenitor population or color- and host- dependent diversity in dust extinction, respectively. In the initial analyses of the volume-limited subset (z < 0.06; 945 SNe) of this sample from the ZTF collaboration, the authors reported evidences for the former hypothesis, in contrast to many of the previous evidences for the dust hypothesis found across other largest high- and low- redshift SNe Ia samples. We re-analyze the volume-limited ZTF SNe Ia in the same manner that previous samples were analyzed and report consistency with trends seen in literature samples and in support of the dust hypothesis. We find the following: 1. a color dependency in the canonical `mass-step' size for SNe, with red SNe having a larger host-dependent residual step than blue SNe by 0.18 $\pm$ 0.09 mag; 2. a color-dependent difference in the Hubble residual scatter, with red SNe having a $\sim$ 33% larger scatter than blue SNe at > 3$\sigma$ significance; 3. data's preference of a model that accounts for color-dependency over a simple `step' model at $\sim$ 3$\sigma$; 4. the strongest evidence to date (3.5$\sigma$) that the relationship between SN color, host-galaxy properties, and luminosity is continuous rather than characterized by a discrete step. Accounting for 3 and 4 with our new model, Host2D, yields a 4.0$\sigma$ improvement over the mass-step model. We trace the difference in reported findings to the fitting and analysis methods, in particular the model complexity allowed for the color-luminosity relation, rather than a difference in the sample itself.

background contribution method result interpretation main claim

What the classifier reports for each sentence. The number is the probability it gave the label.
#sentencerolethe authors' own workstates the main conclusionstrength
s0 The ZTF DR2 includes light curves of 3628 Type Ia supernovae (SNe Ia), making it the largest low-redshift SNe Ia sample available. background 0.94 0.14 0.02 asserted 1.00
s1 One central question for analyses of SNe Ia is whether the remaining diversity of standardized luminosities arises in part from an intrinsic or extrinsic effect; characterized by the color-independent bimodality in progenitor population or color- and host- dependent diversity in dust extinction, respectively. background 0.98 0.06 0.04 hedged possibility 0.73
s2 In the initial analyses of the volume-limited subset (z < 0.06; 945 SNe) of this sample from the ZTF collaboration, the authors reported evidences for the former hypothesis, in contrast to many of the previous evidences for the dust hypothesis found across other largest high- and low- redshift SNe Ia samples. background 0.91 0.11 0.05 asserted 0.83
s3 We re-analyze the volume-limited ZTF SNe Ia in the same manner that previous samples were analyzed and report consistency with trends seen in literature samples and in support of the dust hypothesis. contribution 0.88 0.92 0.57 asserted 0.68
s4 We find the following: 1. a color dependency in the canonical `mass-step' size for SNe, with red SNe having a larger host-dependent residual step than blue SNe by 0.18 $\pm$ 0.09 mag; 2. a color-dependent difference in the Hubble residual scatter, with red SNe having a $\sim$ 33% larger scatter than blue SNe at > 3$\sigma$ significance; 3. data's preference of a model that accounts for color-dependency over a simple `step' model at $\sim$ 3$\sigma$; 4. the strongest evidence to date (3.5$\sigma$) that the relationship between SN color, host-galaxy properties, and luminosity is continuous rather than characterized by a discrete step. result 1.00 0.96 0.59 asserted 1.00
s5 Accounting for 3 and 4 with our new model, Host2D, yields a 4.0$\sigma$ improvement over the mass-step model. result 1.00 0.95 0.19 asserted 1.00
s6 We trace the difference in reported findings to the fitting and analysis methods, in particular the model complexity allowed for the color-luminosity relation, rather than a difference in the sample itself. interpretation 0.99 0.70 0.18 asserted 0.99

What kind of paper the classifier reports this is: empirical study 0.96 · evidence from analysis of existing data 1.00.

What was examined, and what was not

sources read
  • arXiv listing abstract v1
not examined
  • full text
  • figures and tables
  • references and citing sentences
  • relations to other papers
levels run
  • P abstract
not run
  • S sections
  • T body sentences
  • C citations
  • R cross-paper relations

Every quoted sentence on this record is the authors'. Every label is from Pith's closed vocabulary, with the probability shown beside it. Every number in the measurements table is the authors', checked by code. Record as JSON

Figures
Figure 1. A conceptual illustration of the trends in resid￾uals that the dust and progenitor hypotheses predict, over a range of SN Ia color. Top panel: The predicted residuals of SNe Ia, split by their host property (e.g., stellar mass). Bottom panel: The predicted separation between the split populations (i.e., the separation between solid curve and the dashed curve in the top panel). Progenitor hypothesis pre￾dicts a color-independent, constant offset, while the dust hy￾pothesis predicts a color-dependent increase of the separa￾tion. red colors. The authors consider this difference…
Figure 2. (Left) Hubble residuals as a function of host logmass, when split for blue and red colors at c = 0. We only fit α and β to compute the residuals plotted: no mass-step (γ term) is added. We note there is no obvious ‘step’ for the red SNe. (Right) A further split of the plot shown in panel 1a, where now low mass (logmass < 9.5, medium mass (9.5 ≤ logmass < 10.3), and high mass (10.3 ≤ logmass) are all shown. This is consistent with the panel to the left that there is a smooth dependence on mass for the Hubble residuals of red SNe, and a consistent convergence for Hubble residuals of…
Figure 3. Color-dependent residuals, split by “step” locations of host property tracers. erty evolves (redder, more massive); in the rightmost bins in each host property types, the scatter is consis￾tently larger in x1 < 0 subsamples compared to x1 > 0. However, it is unclear how much of this is due to small sample statistics — the number of SNe with x1 > 0 are significantly skewed towards younger, less evolved host types in this dataset, and the limited data in bins like x1 > 0 and color > 1.2 makes the separation not as sig￾nificant as it seems. For the most evolved host property bins…
Figure 4. The scatter of residuals in subsamples, split by their light curve parameters (c, x1) and host properties. The scatter size is measured with nMAD, 1.48 · Med(|HR|). Residuals (HR) are calculated with Model 1 in
Figure 5. Comparison of fitting and binning methods that highlight the causes of different interpretations in G25a. In all panels, we plot the Hubble residual against SALT2 color, where the residual does not contain the γ term (i.e., before mass-step correction). Column-wide comparison highlights the dependence on “measured” profiles on binning methods, and row-wide comparison demonstrates the effects of splits and fitting methods. Right column: equally-populated binning, similar to G25a. Middle column: equally-spaced binning, similar to BS21. Left column: equally-spaced rolling binning, with…
Figure 6. The separation of the Hubble residuals between low-mass (logmass < 9.5; green curves in
Figure 7. Comparison of correction methods and remaining residuals over host logmass, SN Ia color, and SN Ia stretch (x1) values. Top row: the residuals after applying the best-fit Tripp standardization (model #1). Middle row: the residuals after applying the mass-step model (model #12). Bottom row: the residuals after applying the Host2D model (model #14). parison with the ZTF data is beyond the scope of this work, we showcase the impact of color-dependent model by fitting a simplified BS21–like model. Note this model, as well as any model discussed in G25a only accounts for correcting the…
Figure 8. An example of 2D map created for Host2D. Left: the data map, calculated with a rolling-bin + MC as discussed in Sec. 3.1. Bin locations with less than 3 SNe are excluded and marked as white. Right: the fitted Host2D map. The red dot represents the location of the spline knot that minimizes the χ 2 . The map is comprised of linear functions connected at the knot. 4.4. Host2D: A Continuous 2D Map over Host Property and SN Color In Sec. 2.1 and Sec. 3.2, we discussed the significance of intermediate population, which indicates the conti￾nuity of host property-dependent residuals,…

Showing 8 of the paper's 9 figures. See all figures in the PDF ↗ Figures reproduced from arXiv:2505.04686 by the authors.

References
How the literature uses it

1 arXiv paper cite this in 1 sentence

Each citing sentence is taken from the citing paper's LaTeX source and typed by Pith's classifier. A label appears at probability 0.8 or more (0.95 for support), a contest at 0.7 or more; the quoted words are the citing authors'. How each label was checked · JSON

What it cites · 2 sentences without a confident label

Cites as support 1 paper

Discussion

Disagree with the review, or know something it missed? Leave a comment, highlight any passage above to comment on it, or challenge this review formally.