LITMUS: Bayesian Lag Recovery in Reverberation Mapping with Fast Differentiable Models
Pith reviewed 2026-05-22 14:50 UTC · model grok-4.3
The pith
A Bayesian method for reverberation mapping recovers lags with high precision while identifying spurious detections from seasonal gaps.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The paper claims that an algorithm for mapping the Bayesian posterior density built on the damped random walk model recovers lags from reverberation-mapping light curves with high precision and identifies spurious recoveries caused by seasonal observation windows, thereby reducing the false-positive rate.
What carries the argument
The algorithm that maps the Bayesian posterior density over lag values, which both constrains the lag and supplies evidence integrals for comparing the lag model against alternatives.
Load-bearing premise
The damped random walk model together with the seasonal gap pattern used in the mock data adequately captures the dominant sources of aliasing and false lag detections in real multi-year AGN campaigns.
What would settle it
Applying the method to real multi-year reverberation-mapping light curves and checking whether the recovered lags and false-positive identifications match independent black-hole mass measurements or results from simulations that use different variability models.
Figures
read the original abstract
Reverberation mapping is a technique in which the mass of a Seyfert I galaxy's central supermassive black hole is estimated, along with the system's physical scale, from the timescale at which variations in brightness propagate through the galactic nucleus. This mapping allows for a long baseline of time measurements to extract spatial information beyond the angular resolution of our telescopes, and is the main means of constraining supermassive black hole masses at high redshift. The most recent generation of multi-year reverberation mapping campaigns for large numbers of active galactic nuclei (e.g. OzDES) have had to deal with persistent complications of identifying false positives, such as those arising from aliasing due to seasonal gaps in time-series data. We introduce LITMUS (Lag Inference Through the Mixed Use of Samplers), a modern lag recovery tool built on the "damped random walk" model of quasar variability, built in the autodiff framework JAX. LITMUS is purpose built to handle the multimodal aliasing of seasonal observation windows and provides evidence integrals for model comparison, a more quantified alternative to existing methods of lag validation. LITMUS also offers a flexible modular framework for extending modelling of AGN variability, and includes JAX-enabled implementations of other popular lag recovery methods like nested sampling and the interpolated cross correlation function. We test LITMUS on a number of mock light curves modelled after the OzDES sample and find that it recovers their lags with high precision and a successfully identifies spurious lag recoveries, reducing its false positive rate to drastically outperform the state of the art program JAVELIN. LITMUS's high performance is accomplished by an algorithm for mapping the Bayesian posterior density which both constrains the lag and offers a Bayesian framework for model null hypothesis testing.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript introduces LITMUS, a JAX-based Bayesian framework for recovering time lags in reverberation mapping of AGN. It models quasar variability with a damped random walk, maps the posterior density over lag parameters to constrain the lag while handling multimodal aliasing from seasonal gaps, and computes evidence integrals for model comparison to flag spurious recoveries. The central empirical claim is that, on mock light curves constructed to match the OzDES sample, LITMUS recovers lags with high precision and reduces the false-positive rate substantially relative to JAVELIN.
Significance. If the performance advantage generalizes beyond the tested mocks, LITMUS would supply a modular, autodifferentiable platform that quantifies lag reliability through Bayesian evidence, which is a clear improvement over heuristic validation in existing tools. The JAX implementation and explicit support for extending the variability model are genuine strengths that could accelerate adoption in large surveys.
major comments (1)
- [Mock tests / Results] Mock tests section: the headline result that LITMUS 'drastically outperform[s] the state of the art program JAVELIN' in false-positive rate is demonstrated exclusively on light curves generated from the identical DRW model and OzDES seasonal gap pattern used inside LITMUS. This model-matched design verifies internal consistency of the posterior-mapping and evidence machinery but does not address robustness to the additional variability components (higher-order CARMA, broken power-law PSDs, non-stationarity) or gap structures that dominate real multi-year campaigns and are the dominant source of aliasing.
minor comments (2)
- [Abstract / Methods] The abstract states that LITMUS 'includes JAX-enabled implementations of other popular lag recovery methods like nested sampling and the interpolated cross correlation function'; the methods section should list the exact algorithms implemented, the interfaces provided, and whether any head-to-head timing or accuracy benchmarks were performed beyond the JAVELIN comparison.
- [Methods] Notation for the evidence integral and the posterior-mapping algorithm should be introduced with explicit equations rather than descriptive prose alone, to allow readers to verify the claimed independence from the fitted parameters.
Simulated Author's Rebuttal
We thank the referee for their constructive and detailed review of our manuscript. We address the major comment below and have revised the manuscript to better contextualize the scope and limitations of our mock tests.
read point-by-point responses
-
Referee: Mock tests section: the headline result that LITMUS 'drastically outperform[s] the state of the art program JAVELIN' in false-positive rate is demonstrated exclusively on light curves generated from the identical DRW model and OzDES seasonal gap pattern used inside LITMUS. This model-matched design verifies internal consistency of the posterior-mapping and evidence machinery but does not address robustness to the additional variability components (higher-order CARMA, broken power-law PSDs, non-stationarity) or gap structures that dominate real multi-year campaigns and are the dominant source of aliasing.
Authors: We agree that the mock tests presented in the manuscript generate light curves from the same damped random walk (DRW) model and OzDES seasonal gap pattern that are assumed within LITMUS. This design was selected to isolate and validate the performance of the posterior density mapping and Bayesian evidence calculations specifically for handling multimodal aliasing under a correctly specified variability model. In this controlled setting, the tests demonstrate that LITMUS can recover lags with high precision and substantially reduce false positives relative to JAVELIN when the DRW assumption holds. We acknowledge that these results do not directly evaluate robustness to model misspecification, including higher-order CARMA processes, broken power-law PSDs, non-stationarity, or different gap structures that may occur in real multi-year campaigns. In the revised manuscript, we have added explicit language in the Mock Tests section and a dedicated paragraph in the Discussion to clarify the assumptions of the tests, note this as a limitation, and identify robustness to more complex variability models as an important direction for future work. This revision ensures the claims are appropriately scoped without overstating generality. revision: yes
Circularity Check
No circularity detected in derivation or performance claims
full rationale
The LITMUS method is constructed from the standard damped random walk (DRW) model of AGN variability using JAX autodiff for posterior sampling and evidence integrals; these components are independent of the specific mock data generation. The performance claims (high-precision lag recovery and reduced false-positive rate versus JAVELIN) are empirical results obtained by applying the method to separate mock light curves generated under the same DRW plus OzDES gap structure. This constitutes standard internal-consistency validation under the paper's stated assumptions rather than a reduction of any derived quantity to its inputs by construction. No self-definitional steps, fitted-input predictions, or load-bearing self-citations appear in the derivation chain. The mock-based tests do not force the reported metrics; they verify that the Bayesian machinery recovers injected lags when the model is correctly specified.
Axiom & Free-Parameter Ledger
free parameters (1)
- DRW damping timescale and amplitude
axioms (1)
- domain assumption Quasar variability is adequately described by a damped random walk stochastic process.
Lean theorems connected to this paper
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
built on the 'damped random walk' model of quasar variability... covariance function φ_c(t) = σ²_c exp(-|t|/τ)
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Forward citations
Cited by 1 Pith paper
-
AMIGO: a Data-Driven Calibration of the JWST Interferometer
AMIGO is an end-to-end differentiable forward model of JWST AMI that corrects detector systematics to recover high-precision astrometry and detect close high-contrast companions.
Reference graph
Works this paper leans on
- [1]
- [2]
-
[3]
2022, Nature Reviews Methods Primers, 2, doi:10.1038/s43586-022-00121-x
Ashton, G., Bernstein, N., Buchner, J., et al. 2022, Nature Reviews Methods Primers, 2, doi:10.1038/s43586-022-00121-x
-
[4]
A Conceptual Introduction to Hamiltonian Monte Carlo
Betancourt, M. 2018, A Conceptual Introduction to Hamiltonian Monte Carlo, arXiv:1701.02434
work page internal anchor Pith review Pith/arXiv arXiv 2018
- [5]
-
[6]
2018, JAX: composable transformations of Python+NumPy programs
Bradbury, J., Frostig, R., Hawkins, P., et al. 2018, JAX: composable transformations of Python+NumPy programs
work page 2018
-
[7]
Broyden, C. G. 1970, IMA Journal of Applied Mathematics, 6, 222
work page 1970
- [8]
-
[9]
Cackett, E. M., Horne, K., & Winkler, H. 2007, Monthly Notices of the Royal Astronomical Society, 380, 669–682
work page 2007
-
[10]
Dehghanian, M., Ferland, G. J., Kriss, G. A., et al. 2019, The Astrophysical Journal, 877, 119
work page 2019
- [11]
-
[12]
2021, Monthly Notices of the Royal Astronomical Society, 503, 1096–1123
Ding, X., Treu, T., Birrer, S., et al. 2021, Monthly Notices of the Royal Astronomical Society, 503, 1096–1123
work page 2021
-
[13]
2021, PyROA: Modeling quasar light curves, Astrophysics Source Code Library, record ascl:2107.012
Donnan, F. 2021, PyROA: Modeling quasar light curves, Astrophysics Source Code Library, record ascl:2107.012
work page 2021
-
[14]
Duane, S., Kennedy, A. D., Pendleton, B. J., & Roweth, D. 1987, Physics Letters B, 195, 216
work page 1987
-
[15]
Fausnaugh, M. M., Denney, K. D., Barth, A. J., et al. 2016, ApJ, 821, 56
work page 2016
- [16]
- [17]
-
[18]
Foreman-Mackey, D., Hogg, D. W., Lang, D., & Goodman, J. 2013, Publications of the Astronomical Society of the Pacific, 125, 306
work page 2013
-
[19]
2022, dfm/tinygp: tinygp v0.2.2, doi:10.5281/zenodo.6473662
Foreman-Mackey, D., Yadav, S., Tronsgaard, R., Schmerler, S., & theorashid. 2022, dfm/tinygp: tinygp v0.2.2, doi:10.5281/zenodo.6473662
- [20]
-
[21]
1970, Mathematics of Computation, 24, 23
Goldfarb, D. 1970, Mathematics of Computation, 24, 23
work page 1970
-
[22]
2010, Communications in Applied Mathematics and Computational Science, 5, 65
Goodman, J., & Weare, J. 2010, Communications in Applied Mathematics and Computational Science, 5, 65
work page 2010
-
[23]
Grier, C. J., Martini, P., Watson, L. C., et al. 2013, ApJ, 773, 90
work page 2013
- [24]
-
[25]
J., Shen, Y., Horne, K., et al
Grier, C. J., Shen, Y., Horne, K., et al. 2019, The Astrophysical Journal, 887, 38
work page 2019
- [26]
-
[27]
Harris, C. R., Millman, K. J., van der Walt, S. J., et al. 2020, Nature, 585, 357 Hern´ andez Santisteban, J. V., Edelson, R., Horne, K., et al. 2020, MNRAS, 498, 5399
work page 2020
-
[28]
Hinton, S. R. 2016, The Journal of Open Source Software, 1, 00045
work page 2016
-
[29]
Hoormann, J. K., Martini, P., Davis, T. M., et al. 2019, Monthly Notices of the Royal Astronomical Society, 487, 3650–3663
work page 2019
-
[30]
Hunter, J. D. 2007, Computing in Science & Engineering, 9, 90
work page 2007
-
[31]
Kaspi, S., Smith, P. S., Netzer, H., et al. 2000, The Astrophysical Journal, 533, 631–649
work page 2000
-
[32]
C., Bechtold, J., & Siemiginowska, A
Kelly, B. C., Bechtold, J., & Siemiginowska, A. 2009, ApJ, 698, 895
work page 2009
-
[33]
2015, Monthly Notices of the Royal Astronomical Society: Letters, 456, L109–L112
King, A. 2015, Monthly Notices of the Royal Astronomical Society: Letters, 456, L109–L112
work page 2015
-
[34]
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. 2017, Adam: A Method for Stochastic Optimization, arXiv:1412.6980
work page internal anchor Pith review Pith/arXiv arXiv 2017
-
[35]
2014, The Astrophysical Journal, 788, 159 Koz lowski, S., Kochanek, C
Koshida, S., Minezaki, T., Yoshii, Y., et al. 2014, The Astrophysical Journal, 788, 159 Koz lowski, S., Kochanek, C. S., Udalski, A., et al. 2010, ApJ, 708, 927
work page 2014
-
[36]
2016, The Astrophysical Journal, 831, 206
Li, Y.-R., Wang, J.-M., & Bai, J.-M. 2016, The Astrophysical Journal, 831, 206
work page 2016
-
[37]
Lidman, C., Tucker, B. E., Davis, T. M., et al. 2020, Monthly Notices of the Royal Astronomical Society, 496, 19–35
work page 2020
-
[38]
L., Ivezi´ c, ˇZ ., Kochanek, C
MacLeod, C. L., Ivezi´ c, ˇZ ., Kochanek, C. S., et al. 2010, The Astrophysical Journal, 721, 1014
work page 2010
-
[39]
Malik, U., Sharp, R., Penton, A., et al. 2023, MNRAS, 520, 2009
work page 2023
-
[40]
McDougall, H. e. a. 2025, IN PREPARATION - TO BE UPDATED UPON SUBMISSION
work page 2025
-
[41]
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. 1953, The Journal of Chemical Physics, 21, 1087
work page 1953
-
[42]
2019, The Astrophysical Journal, 886, 150
Minezaki, T., Yoshii, Y., Kobayashi, Y., et al. 2019, The Astrophysical Journal, 886, 150
work page 2019
-
[43]
Neal, R. M. 1996, Monte Carlo Implementation (New York, NY: Springer New York), 55–98
work page 1996
- [44]
-
[45]
Penton, A., McDougall, H. G., Davis, T. M., et al. 2025, IN PREPARATION - TO BE UPDATED UPON SUBMISSION, 000–000
work page 2025
-
[46]
Peterson, B. M. 1993, PASP, 105, 247
work page 1993
-
[47]
Composable Effects for Flexible and Accelerated Probabilistic Programming in NumPyro
Phan, D., Pradhan, N., & Jankowiak, M. 2019, Composable Effects for Flexible and Accelerated Probabilistic Programming in NumPyro, doi:10.48550/ARXIV.1912.11554
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.1912.11554 2019
-
[48]
2009, Journal of the Royal Statistical Society Series B, 71, 319
Rue, H., Martino, S., & Chopin, N. 2009, Journal of the Royal Statistical Society Series B, 71, 319
work page 2009
-
[49]
1978, The Annals of Statistics, 6, 461
Schwarz, G. 1978, The Annals of Statistics, 6, 461
work page 1978
-
[50]
Secunda, A., Greene, J. E., Jiang, Y.-F., Yao, P. Z., & Zoghbi, A. 2023, ApJ, 956, 81
work page 2023
- [51]
-
[52]
Shanno, D. F. 1970, Mathematics of Computation, 24, 647
work page 1970
- [53]
-
[54]
Shen, Y., Hall, P. B., Horne, K., et al. 2019, The Astrophysical Journal Supplement Series, 241, 34
work page 2019
-
[55]
Shen, Y., Grier, C. J., Horne, K., et al. 2023, The Sloan Digital Sky Survey Reverberation Mapping Project: Key Results, arXiv:2305.01014
- [56]
- [57]
-
[58]
Starkey, D. A., Horne, K., & Villforth, C. 2015, Monthly Notices of the Royal Astronomical Society, 456, 1960–1973
work page 2015
-
[59]
Suganuma, M., Yoshii, Y., Kobayashi, Y., et al. 2006, ApJ, 639, 46
work page 2006
-
[60]
Uttley, P., Cackett, E. M., Fabian, A. C., Kara, E., & Wilkins, D. R. 2014, The Astronomy and Astrophysics Review, 22, doi:10.1007/s00159-014-0072-0 van Niekerk, J., Krainski, E., Rustand, D., & Rue, H. 2022, A new avenue for Bayesian inference with INLA, arXiv:2204.06797 Van Rossum, G., & Drake, F. L. 2009, Python 3 Reference Manual (Scotts Valley, CA: C...
-
[61]
Woo, J.-H., Yoon, Y., Park, S., Park, D., & Kim, S. C. 2015, The Astrophysical Journal, 801, 38
work page 2015
-
[62]
Yu, Z., Kochanek, C. S., Peterson, B. M., et al. 2019, Monthly Notices of the Royal Astronomical Society, 491, 6045–6064
work page 2019
-
[63]
2021, Monthly Notices of the Royal Astronomical Society, 507, 3771–3788 —
Yu, Z., Martini, P., Penton, A., et al. 2021, Monthly Notices of the Royal Astronomical Society, 507, 3771–3788 —. 2023, Monthly Notices of the Royal Astronomical Society, 522, 4132–4147
work page 2021
-
[64]
S., Koz lowski, S., & Udalski, A
Zu, Y., Kochanek, C. S., Koz lowski, S., & Udalski, A. 2013, The Astrophysical Journal, 765, 106
work page 2013
-
[65]
Zu, Y., Kochanek, C. S., & Peterson, B. M. 2010, JAVELIN: Just Another Vehicle for Estimating Lags In Nuclei, Astrophysics Source Code Library, record ascl:1010.007, ascl:1010.007 —. 2011, ApJ, 735, 80
work page 2010
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.