REVIEW 3 major objections 4 minor 17 references
OrbDot: A Python package for studying the secular evolution of exoplanet orbits
T0 review · 3 major / 4 minor · reviewed 2026-08-05 · deepseek-v4-flash
Pith's one-line read OrbDot claims to be the first fully packaged tool for fitting decade-long exoplanet orbit changes to transit, eclipse, and radial-velocity data at once.
desk verdict OrbDot fills a real gap with a serious tool, but the paper is nearly empty of in-paper evidence that the code actually does what it says; a minimal benchmark would settle it. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is a nested-sampling Bayesian engine wrapped around a library of long-term orbital evolution models. Nested sampling—an inference method that produces both parameter posteriors and Bayesian evidence values—is what lets OrbDot compare competing physical models, such as tidal decay versus apsidal precession versus companion-induced effects, rather than reporting a single best fit. The models act directly on transit and eclipse mid-times, transit durations, and radial velocities, so heterogeneous data sets can be combined in one fit, which the paper argues helps break parameter degeneracies.
What would settle it
Run the paper's advertised WASP-12 b example and compare the fitted orbital-decay rate with the value in the independent literature it claims to reproduce; a disagreement beyond quoted uncertainties would refute the usability claim. Stronger still is an injection-recovery test: generate synthetic transit and RV timings with known decay and precession rates, fit them with OrbDot, and check that the true parameters fall inside the reported credible intervals and that the correct model wins the evidence comparison.
Extended reading notes
Core claim
The paper's claim is that OrbDot is a complete, maintained software suite for secular orbital evolution studies, uniting transit, eclipse, and radial-velocity data in one framework that skips light-curve fitting and fits evolutionary models directly to timing measurements. It carries out Bayesian inference with nested sampling, with freedom to choose models, priors, and parameterizations, and adds an interpretation layer that reports model comparisons, tidal decay parameters, predicted precession rates, and companion dynamical effects. The authors assert no comparable open-source tool combines these capabilities: the most similar codes fit secular models only to timing data, general-purpose
Load-bearing premise
The load-bearing premise is that the secular evolution models are physically correct and numerically implemented without bugs, and that the nested sampling engines return trustworthy posterior and evidence estimates; the paper offers no in-paper benchmark of its own to verify this.
Editorial extensions
If this is right
- A researcher with only a list of free parameters and a chosen model can fit a decade of heterogeneous observations; the paper demonstrates the workflow by reproducing the literature result of WASP-12 b's orbital decay with a few lines of code.
- Simultaneously fitting transit mid-times, eclipse mid-times, and radial velocities breaks parameter degeneracies that single-data-type analyses cannot resolve.
- Bayesian model comparison becomes routine, so a reported timing anomaly can be checked against tidal decay, apsidal precession, proper-motion, and companion hypotheses within one framework.
- The interpretation reports connect fitted parameters directly to physical theory, such as tidal energy dissipation parameters and predicted precession rates, including implications for non-resonant companions.
- Because the nested-sampling machinery handles many free parameters efficiently, the package scales to the growing TESS-era archive of multi-decade ephemerides.
Reading between the lines
- If the timing-only design is as reliable as claimed, OrbDot could serve as a community-standard cross-check for newly published secular-trend detections, since its independent re-analysis of the same mid-times would either confirm or challenge decay claims.
- A natural stress test the paper does not report is an injection-recovery benchmark: simulate timing data with known decay and precession rates, and check whether OrbDot's posteriors and evidence values recover the truth; its reliability ultimately rests on such a test rather than on the three application examples.
- The framework's separation of likelihood from sampler means new secular models could be added without touching the inference layer, a testable design promise that would make the package a platform for studying effects like general-relativistic precession or Kozai–Lidov oscillations.
- Because the package reports model comparisons through Bayesian evidence, users' conclusions inherit the well-known sensitivity of nested-sampling evidence to prior choices—something the paper does not discuss.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. OrbDot is presented as a Python package for fitting secular orbital evolution models to exoplanet transit/eclipse mid-times, transit durations, and radial velocities using nested sampling. The paper describes the package's intended capabilities: simultaneous multi-dataset fitting, model/prior flexibility, Bayesian evidence computation, and report generation for physical interpretation. It argues that no existing tool provides the full suite of functionality and that OrbDot lowers the barrier for studying long-term orbital evolution. The authors cite companion papers (Hagey et al. 2025; Edwards et al. 2023) and claim that online examples reproduce literature results, but the manuscript itself contains no code listings, no equations, no test results, no benchmark figures, and no quantitative validation of the implemented models or sampling workflows.
Significance. If the software functions as claimed and is indeed validated by the external examples, it would fill a genuine niche: a single, maintained, open-source tool for secular-evolution inference from heterogeneous timing and RV data, with Bayesian model selection built in. The authors' prior applications to WASP-12 b, TrES-1 b, and LTT-9779 b suggest real-world utility. However, the current manuscript provides no in-paper evidence that the likelihoods, priors, and nested-sampling wrappers are correct. Because the entire claim is that the package reliably fits secular models, the absence of validation is a load-bearing gap. The paper is also unusually spare for a software paper: it does not give a repository URL, version number, API examples, or a description of the secular models implemented. The write-up is more a proposal than a demonstration.
major comments (3)
- [Summary, fourth paragraph] The paper states 'The examples demonstrate that OrbDot can quickly reproduce literature results using only a few lines of code,' but no examples, outputs, or quantitative comparisons are shown in the manuscript. The cited Hagey et al. (2025) and Edwards et al. (2023) are external publications that (a) are not part of this paper and (b) need not have used exactly the same model code, priors, or data reductions as OrbDot. As written, the central reliability claim—that OrbDot correctly and robustly fits secular evolution models—is unsupported. Please add at least one in-paper validation: synthetic data injection with known dP/dt and precession parameters, recovery of literature values for a benchmark system (e.g., WASP-12 b) with quoted uncertainties, or a comparison against an independent sampler on a simple test model. This is not an accusation of error; it is a request for the evidence t
- [Summary / Statement of need] No equations or explicit model definitions are provided for the secular evolutions (orbital decay, apsidal precession, proper-motion terms, companion-induced effects). A reader cannot assess whether the mapping from physical parameters (dP/dt, precession rate, RV semi-amplitude, etc.) to observables is implemented correctly or what priors are available. The paper should include a 'Models' section listing the mathematical forms fitted, or at least give explicit pointers to equations in the companion papers and documentation. Without this, the manuscript cannot support the claim that the software 'unifies transit, eclipse, and RV data' in a scientifically meaningful way.
- [Similar software] The comparison with existing codes would be more persuasive if it were grounded in quantitative capabilities. For example, the claim that PdotQuest 'currently supports only the orbital decay model' and that Susie uses 'simple least-squares fitting' needs citation to the specific code versions tested. More importantly, the absence of any benchmark timing or runtime comparison makes the 'highly efficient' claim in the Summary an assertion rather than a demonstrated property. Please provide representative runtimes or an efficiency comparison for a standard model (e.g., WASP-12 b) if efficiency is part of the contribution.
minor comments (4)
- [Throughout] No repository URL, DOI, license, or version number is given. For a software paper, this is essential. At minimum add the GitHub/ReadTheDocs links and a license statement.
- [Summary, first paragraph] The phrase 'measurements of secular variations can even probe the interior structure of exoplanets' is intriguing but not explained. A one-sentence physical justification (e.g., tidal Love numbers from apsidal precession) would help.
- [Statement of need] The claim that 'OrbDot... is presented to the community with transparency that lends itself to community contributions and independent verification' is not yet evidenced; the manuscript contains no contribution guidelines or test suite description.
- [Similar software] Minor typographical issue: 'OrbDot remains highly efficient' in the Summary has an odd line break ('thenestle'), and the text alternates between 'OrbDot' and 'OrbDot.' with inconsistent spacing. A copyedit is needed.
Circularity Check
No circularity: OrbDot is a software-description paper whose central claim is package functionality, not a derived result; the cited prior uses are external demonstrations, not load-bearing premises.
full rationale
The paper contains no derivation chain in the sense of equations that map inputs to predictions. It describes a fitting package and its capabilities. The central claim is that OrbDot is a fully packaged, documented, and maintained software suite for fitting secular evolution models to transit/eclipse times, radial velocities, and transit durations. That claim is supported by the package itself, its documentation, and worked examples, not by a fitted parameter being renamed as a prediction. The only potentially self-referential elements are citations to Hagey et al. (2025) and Edwards et al. (2023), which used OrbDot or an early version of it. These are external, peer-reviewed applications and are cited as demonstrations of prior use, not as the logical justification for OrbDot's functionality. No uniqueness theorem is imported from the authors, no ansatz is smuggled in via citation, and no known result is renamed. The absence of in-paper numerical benchmarks or synthetic recovery tests is a validation gap and a correctness risk, but it is not circularity: the software's existence and design are not defined in terms of its outputs. Under the stated rules, self-citation that is not load-bearing does not raise the circularity score. Therefore the appropriate finding is no significant circularity, score 0.
Assumptions & free parameters
assumptions (2)
- domain assumption The secular evolution models (e.g., tidal decay, apsidal precession) implemented in OrbDot are physically correct and accurately coded.
- domain assumption Nested sampling engines (nestle, PyMultiNest) produce reliable posterior samples and evidence estimates for the parameter spaces used.
Cite this review
Pith. "Pith review of OrbDot: A Python package for studying the secular evolution of exoplanet orbits." pith.science (2026). https://pith.science/paper/G36AUNEU
@misc{pith2026250904531,
author = {Pith},
title = {Pith review of: OrbDot: A Python package for studying the secular evolution of exoplanet orbits},
year = {2026},
howpublished = {\url{https://pith.science/paper/G36AUNEU}},
note = {Machine review of arXiv:2509.04531}
}
read the original abstract
OrbDot is a Python package for studying the secular (long-term) evolution of exoplanet orbits from observational data. It employs nested sampling algorithms to fit evolutionary models to any combination of transit and eclipse mid-times, radial velocities, and transit durations. Beyond model fitting, OrbDot offers tools for interpreting results, generating reports on model comparisons, derived tidal decay parameters, predicted precession rates, implications for planetary companions, and more.
Reference graph
Works this paper leans on
-
[1]
Barbary, K. (2021). nestle: Nested sampling algorithms for evaluating Bayesian evidence . https://ascl.net/2103.022
work page 2021
-
[2]
Barker, M., Jackson, B., Huchmala, R., Adams, E., & Kirk, A. (2024). Susie Transiting Exoplanet Ephemeris Package . 56th Annual Meeting of the Division for Planetary Sciences, 56, 402.02. https://doi.org/10.3847/25c2cfeb.64cecc52
-
[3]
Barker, M., & Kirk, A. (2025). The Susie Python package. In GitHub repository. https://github.com/BoiseStatePlanetary/susie; GitHub
work page 2025
-
[4]
Buchner, J., Georgakakis, A., Nandra, K., Hsu, L., Rangel, C., Brightman, M., Merloni, A., Salvato, M., Donley, J., & Kocevski, D. (2014). X-ray spectral modelling of the AGN obscuring region in the CDFS: Bayesian model selection and catalogue . Astronomy & Astrophysics, 564, A125. https://doi.org/10.1051/0004-6361/201322971
-
[5]
Deck, K. M., Agol, E., Holman, M. J., & Nesvorný, D. (2014). TTVFast : An efficient and accurate code for transit timing inversion problems. The Astrophysical Journal, 787(2), 132. https://doi.org/10.1088/0004-637X/787/2/132
-
[6]
Eastman, J. D., Rodriguez, J. E., Agol, E., Stassun, K. G., Beatty, T. G., Vanderburg, A., Gaudi, B. S., Collins, K. A., & Luger, R. (2019). EXOFASTv2 : A public, generalized, publication-quality exoplanet modeling code. arXiv e-Prints, arXiv:1907.09480. https://doi.org/10.48550/arXiv.1907.09480
-
[7]
Edwards, B., Changeat, Q., Tsiaras, A., Allan, A., Behr, P., Hagey, S. R., Himes, M. D., Ma, S., Stassun, K. G., Thomas, L., Thompson, A., Boley, A., Booth, L., Bouwman, J., France, K., Lowson, N., Meech, A., Phillips, C. L., Vidotto, A. A., Ward-Thompson, D. (2023). Characterizing a world within the hot- Neptune desert: Transit observations of LTT 9779 b...
-
[8]
Espinoza, N., Kossakowski, D., & Brahm, R. (2019). juliet : A versatile modelling tool for transiting and non-transiting exoplanetary systems. Monthly Notices of the Royal Astronomical Society, 490(2), 2262--2283. https://doi.org/10.1093/mnras/stz2688
Show all 17 references
-
[9]
P., Santos, N
Faria, J. P., Santos, N. C., Figueira, P., & Brewer, B. J. (2018). kima : Exoplanet detection in radial velocities. Journal of Open Source Software, 3(26), 487. https://doi.org/10.21105/joss.00487
2018 doi
-
[10]
P., & Bridges, M
Feroz, F., Hobson, M. P., & Bridges, M. (2009). MULTINEST : An efficient and robust Bayesian inference tool for cosmology and particle physics. Monthly Notices of the Royal Astronomical Society, 398(4), 1601--1614. https://doi.org/10.1111/j.1365-2966.2009.14548.x
2009
-
[11]
Foreman-Mackey, D., Luger, R., Agol, E., Barclay, T., Bouma, L., Brandt, T., Czekala, I., David, T., Dong, J., Gilbert, E., Gordon, T., Hedges, C., Hey, D., Morris, B., Price-Whelan, A., & Savel, A. (2021). exoplanet : Gradient-based probabilistic inference for exoplanet data ...
2021 doi
-
[12]
J., Petigura, E
Fulton, B. J., Petigura, E. A., Blunt, S., & Sinukoff, E. (2018). RadVel : The radial velocity modeling toolkit. Publications of the Astronomical Society of the Pacific, 130(986), 044504. https://doi.org/10.1088/1538-3873/aaaaa8
2018 doi
-
[13]
N., & Daylan, T
Günther, M. N., & Daylan, T. (2021). Allesfitter: Flexible star and exoplanet inference from photometry and radial velocity. The Astrophysical Journal Supplement Series, 254(1), 13. https://doi.org/10.3847/1538-4365/abe70e
2021 doi
-
[14]
R., Edwards, B., Tsiaras, A., Boley, A
Hagey, S. R., Edwards, B., Tsiaras, A., Boley, A. C., Kokori, A., Narita, N., Sada, P. V., Walter, F., Zellem, R. T., A-thano, N., Alton, K. B., Álava Amat, M. Á., Benni, P., Besson, E., Brandebourg, P., Bretton, M., Caló, M., Crow, M. V., Dalouzy, J.-C., Trnka, J. (2025). TrE...
2025 doi
-
[15]
Skilling, J. (2006). Nested sampling for general Bayesian computation. Bayesian Analysis, 1(4), 833--859. https://doi.org/10.1214/06-BA127
2006 doi
-
[16]
Trifonov, T. (2019). The Exo-Striker : Transit and radial velocity interactive fitting tool for orbital analysis and N -body simulations . Astrophysics Source Code Library, record ascl:1906.004. http://ascl.net/1906.004
2019
-
[17]
Wang, W., Zhang, Z., Chen, Z., Wang, Y., Yu, C., & Ma, B. (2024). Long-term variations in the orbital period of hot Jupiters from transit-timing analysis using TESS survey data. The Astrophysical Journal Supplement Series, 270(1), 14. https://doi.org/10.3847/1538-4365/ad0847 C...
2024 doi
Reviewed August 5, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.