Impact of Baseline, Cadence, and Host Contamination on AGN Variability Metrics: A Systematic Study with ZTF
Pith reviewed 2026-05-10 10:52 UTC · model grok-4.3
The pith
The Stetson index J holds steady for AGN variability while the smoothness metric s shifts with cadence and host light.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Analysis of ZTF DR24 light curves for 23 nearby AGNs shows the Stetson index J varies by at most 10 percent under baseline shifts of about two years, different cadences, and host-galaxy subtraction in the representative case of Mrk 493, whereas the smoothness metric s varies by 40 percent or more with cadence and increases after host subtraction, supporting the conclusion that J is robust for characterizing AGN variability while s must be interpreted cautiously.
What carries the argument
The Stetson index J, a metric computed from flux distributions across temporally separated epochs in AGN light curves, which remains stable against changes in baseline length, sampling cadence, and host-galaxy contamination.
If this is right
- J can be compared directly across surveys that differ in total baseline or sampling rate.
- Host-galaxy light does not bias J, so the metric can be applied even when perfect host subtraction is unavailable.
- Studies that rely on s must correct for cadence differences and host contamination before interpreting variability as a probe of accretion physics.
- J offers a practical way to combine variability measurements from multiple facilities without large systematic offsets.
Where Pith is reading between the lines
- J could become a default metric in upcoming wide-field surveys where cadence and host light vary across the sky.
- The same stability test applied to other variability statistics would reveal which ones are safest for cross-survey work.
- If the pattern holds, variability catalogs built from J could be used to study black-hole accretion rates with reduced observational bias.
Load-bearing premise
The assumption that results from 23 nearby AGNs plus the single Mrk 493 host-subtraction test apply to the full range of AGN populations and to surveys other than ZTF DR24.
What would settle it
Repeating the analysis on a larger and more distant AGN sample from a survey with different cadence or without host subtraction and finding large changes in J or no change in s would falsify the robustness claim.
Figures
read the original abstract
Variability in active galactic nuclei (AGN) probes the physics of accretion onto supermassive black holes. This variability is characterized using metrics derived from the flux distributions of temporally separated epochs. We studied the stability of two variability metrics, the Stetson index "J" and the smoothness "s", against baseline, cadence, and host galaxy contamination. We studied 23 nearby AGNs using Zwicky Transient Facility's Data Release 24. Both metrics are robust to baseline variations of $\sim 2$ years. However, s is sensitive to cadence, showing variations $\gtrsim 40\%$, while J shows minor variations $\lesssim10\%$. We studied the host galaxy impact using Mrk 493 as a representative case. We found that J remains unchanged after host subtraction, while s increases. We concluded that J is a robust tool for characterizing AGN variability, while s should be interpreted with caution.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript presents an empirical study using ZTF DR24 data on 23 nearby AGNs to assess the stability of the Stetson index J and smoothness metric s against variations in baseline length (~2 years), cadence, and host-galaxy contamination (tested via host subtraction on Mrk 493 only). It reports that both metrics are robust to baseline changes, s varies by ≳40% with cadence while J varies by ≲10%, J is unchanged by host subtraction while s increases, and concludes that J is a robust tool for AGN variability while s requires caution.
Significance. If the differential robustness holds, the work offers practical guidance for metric selection in time-domain AGN studies with large surveys. A strength is the use of public data and standard published metrics to derive concrete quantitative estimates of sensitivity; the purely empirical approach avoids circularity.
major comments (2)
- The central claim that J is robust while s is not rests on a sample of only 23 nearby AGNs with host effects tested on a single case (Mrk 493). No cross-checks against higher-redshift AGNs, different black-hole masses/luminosities, or cadences from other surveys are provided, so the observed ~10% vs ≳40% variations and the generalization in the conclusion are not load-bearing supported.
- The reported percentage changes lack error bars, statistical significance tests, or details on sample selection criteria and full methodology (e.g., how baselines/cadences were subsampled). This weakens the quantitative support for the differential robustness ranking.
minor comments (1)
- The abstract and methods would benefit from explicit references to the original definitions of J and s, plus a brief description of the host-subtraction procedure applied to Mrk 493.
Simulated Author's Rebuttal
We thank the referee for their constructive comments on our manuscript. We address each major comment below and indicate revisions made to strengthen the presentation of our empirical results.
read point-by-point responses
-
Referee: The central claim that J is robust while s is not rests on a sample of only 23 nearby AGNs with host effects tested on a single case (Mrk 493). No cross-checks against higher-redshift AGNs, different black-hole masses/luminosities, or cadences from other surveys are provided, so the observed ~10% vs ≳40% variations and the generalization in the conclusion are not load-bearing supported.
Authors: We acknowledge that the sample is limited to 23 nearby AGNs and that host subtraction was demonstrated on Mrk 493. This selection was intentional to target objects where host contamination is measurable and relevant, as it becomes negligible at higher redshifts. The observed differential behavior (J variations ≲10% vs s ≳40%) is consistent across all 23 objects for the baseline and cadence tests. We agree that the conclusions should not overgeneralize and have revised the final section to explicitly limit the claims to nearby AGNs with ZTF-like sampling, while noting that host effects are expected to be smaller at higher z. Cross-checks with other surveys or redshift ranges are outside the scope of the current ZTF DR24 analysis. revision: partial
-
Referee: The reported percentage changes lack error bars, statistical significance tests, or details on sample selection criteria and full methodology (e.g., how baselines/cadences were subsampled). This weakens the quantitative support for the differential robustness ranking.
Authors: We thank the referee for this observation. The revised manuscript now includes error bars on all percentage variations (computed via bootstrap resampling across the sample), reports the results of paired statistical tests confirming that cadence-induced changes in s are significant (p < 0.01) while those in J are not, and expands the Methods section with the full sample selection criteria (redshift < 0.1, ≥100 epochs in ZTF DR24, known AGN classification) and the exact subsampling procedures (random contiguous baseline subsets of 1–2 yr; uniform downsampling to target cadences of 1, 3, and 5 days). These additions provide the requested quantitative rigor. revision: yes
- We lack the necessary multi-survey or higher-redshift datasets to perform the suggested cross-checks within the present study.
Circularity Check
No circularity: purely empirical application of standard metrics to public data
full rationale
The paper computes the published Stetson J and smoothness s metrics on ZTF DR24 light curves for 23 nearby AGNs, then directly measures how those metric values change when baseline length, cadence, or host subtraction is varied. No new quantities are derived from fitted parameters, no target result is used to define the inputs, and no self-citation chain is invoked to justify uniqueness or an ansatz. All reported behaviors (J stable to ~10%, s varying >40%, J unchanged after host subtraction on Mrk 493) are observational outcomes, not tautological re-statements of the data selection or metric definitions. The analysis is therefore self-contained and externally falsifiable against the same public survey data.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption Variability metrics J and s applied to AGN light curves reflect intrinsic accretion processes rather than purely observational artifacts
Reference graph
Works this paper leans on
-
[1]
Barbary, K., Barclay, T., Biswas, R., et al. 2016, SNCosmo: Python library for supernova cosmology, Astrophysics Source Code Library, record ascl:1611.017. http://ascl.net/1611.017
work page 2016
-
[2]
Bellm, E. C., Kulkarni, S. R., Graham, M. J., et al. 2019, PASP, 131, 018002, doi: 10.1088/1538-3873/aaecbe
-
[3]
Butler, N. R., & Bloom, J. S. 2011, AJ, 141, 93, doi: 10.1088/0004-6256/141/3/93 DESI Collaboration, Karim, M. A., Adame, A. G., et al. 2025, arXiv e-prints, arXiv:2503.14745, doi: 10.48550/arXiv.2503.14745
-
[4]
Drake, A. J., Djorgovski, S. G., Mahabal, A., et al. 2009, ApJ, 696, 870, doi: 10.1088/0004-637X/696/1/870
-
[5]
LSST: From Science Drivers to Reference Design and Anticipated Data Products , journal =
Guo, H., Shen, Y., & Wang, S. 2018, PyQSOFit: Python code to fit the spectrum of quasars, Astrophysics Source Code Library, record ascl:1809.008. http://ascl.net/1809.008 Ivezi´ c,ˇZ., Kahn, S. M., Tyson, J. A., et al. 2019, ApJ, 873, 111, doi: 10.3847/1538-4357/ab042c
-
[6]
2024, ApJ, 966, 5, doi: 10.3847/1538-4357/ad34d6
Ma, Q., Wen, Y., Wu, X.-B., Gu, H., & Fu, Y. 2024, ApJ, 966, 5, doi: 10.3847/1538-4357/ad34d6
-
[7]
L., Ivezi´ c,ˇZ., Sesar, B., et al
MacLeod, C. L., Ivezi´ c,ˇZ., Sesar, B., et al. 2012, ApJ, 753, 106, doi: 10.1088/0004-637X/753/2/106
-
[8]
Welch, D. L., & Stetson, P. B. 1993, AJ, 105, 1813, doi: 10.1086/116556 ZTF Team. 2025, ZTF Lightcurves, IPAC, doi: 10.26131/IRSA598
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.