REVIEW 3 major objections 7 minor 31 references
Boosting decision trees for Main Belt Asteroid selection in planetary ephemerides: an alternative model
T0 review · 3 major / 7 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read Boosted decision trees rank the 343 main-belt asteroids by effect on Mars residuals, and removing the 147 lowest-ranked ones yields a 196-asteroid model with no significant degradation of the fit.
desk verdict A credible reduced-asteroid ephemeris built with a BDT ranking, but the ranking's causal role is under-tested because there is no control ordering. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is a supervised ranking of asteroid masses by their marginal effect on Mars ranging residuals, learned by boosted regression trees. A gradient-boosted decision tree is trained on a dataset pairing random asteroid mass perturbations, uniform within ±10% of INPOP21a postfit masses, with the implied change in the Mars Express residual χ2, computed through the linearized residual formula $\Delta \widehat{(O-C)}|_O \equiv \frac{\partial (O-C)|_O}{\partial m}\Delta m$. The tree ensemble assigns a relative importance to each of the 343 masses, and that importance order is used as a removal sequence. The validation machinery is the residual indicator $RI = \sqrt{\sigma^2_{\rm MEX,fit} + \sigma^2_{\rm MEX,ext}}$, combining in-fit and extrapolated Mars Express residuals, whose minimum selects the 147-removal solution.
What would settle it
Recompute the BDT ranking with training perturbations spanning the full removal range, for example setting individual masses to zero or using ±100% mass changes, and refit the ephemerides; if the 147-removal set no longer keeps σMEX oscillations below 20 cm, the linearized ±10% training assumption is the breaking point. A second test would be to refit with a non-MEX observable, such as InSight or Mars orbiter ranging, and check whether residuals remain within 20 cm.
Extended reading notes
Core claim
The central discovery is that the relative importance of asteroid masses for the Mars Express residual fit, learned by gradient-boosted regression trees, is a reliable guide for deleting asteroids from the dynamical model altogether. Removing objects in increasing order of importance keeps the oscillation in the postfit σMEX below 20 cm up to about 200 removals, and the chosen solution INPOP25c removes 147 asteroids and keeps 196. The reduced model has a conditioning number about 70% lower, average mass uncertainties about 15% smaller, and integration time about 52% lower in user time, while the fitted masses remain consistent with an independent albedo-based posterior and with literature mass estimates. The paper presents this as evidence that the BDT ranking identifies which asteroids can be omitted from the point-mass model without significant degradation of the planetary ephemeris.
Load-bearing premise
The ranking is learned from small, ±10% mass perturbations and a linearized (straight-line) approximation of how the residuals respond, but it is then used to justify deleting asteroids entirely, a 100% change, and the validation refits use the same Mars-Express-based objective, so the order and size of the optimal reduced set could change if the linear ordering is not valid outside its training range.
Editorial extensions
If this is right
- A 196-asteroid point-mass model can replace the 343-asteroid model without significant degradation of postfit Mars Express residuals.
- The conditioning number of the least-squares fit drops by about 70%, and average fitted mass uncertainties improve by about 15%.
- Integration of the planetary ephemeris takes about 52% less user time and 30% less real time.
- The mass estimates from the reduced model are statistically consistent with an independent posterior built from neural-network albedo predictions.
- The close match between σMEX and global χ2 trends indicates that Mars Express residuals are a reliable proxy for global ephemeris quality.
Reading between the lines
- Extending beyond the tested case, the same ranking procedure could likely be applied to trans-Neptunian objects or other perturbing populations; the authors mention this as future work but do not test it, and the computational cost of building a comparable training set would need to be addressed first.
- Because the tree-based importance reflects correlations among asteroids, the method could be extended to identify groups of asteroids that can be replaced by a single effective mass, potentially reducing the model further than the 196-asteroid solution.
- If the ranking proves stable under larger training perturbations, the reduced model could guide which asteroid masses most need independent determination, for example by spacecraft flybys or occultations, to keep Mars ephemerides accurate.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a boosted decision tree (BDT) ranking of the 343 Main Belt asteroids used as point masses in the INPOP planetary ephemerides. The BDT is trained on a synthetic dataset of ±10% random mass perturbations, with the target being the linearized change in Mars Express (MEX) residual chi-square. Starting from the INPOP25b ephemeris, the authors remove asteroids one by one in increasing BDT-importance order, performing a full planetary fit after each removal. They find that removing up to 200 asteroids keeps the postfit MEX sigma within 20 cm of the reference, and they select INPOP25c, a solution with 147 asteroids removed (196 remaining), as the minimum of a residual indicator that combines fit and extrapolation dispersions. They report that INPOP25c improves the conditioning of the fit, reduces average mass uncertainties by about 15%, and cuts integration time by about half. The fitted masses are then compared with independent mass estimates from albedo-based neural networks, the literature, and Wasserstein barycenters.
Significance. If the central claims hold, the work would provide a practical and inexpensive way to reduce the dimension of the main-belt model in planetary ephemerides, with concrete benefits for conditioning, mass-parameter uncertainties, and computational cost. The paper's strongest evidence is the repeated full ephemeris refit after each cumulative removal, which is a much more demanding validation than a simple proxy test. The comparison of the INPOP25c masses with independent albedo-based and literature estimates is also a valuable sanity check. However, the central methodological claim that the BDT ranking identifies which asteroids can be omitted is not yet supported, because no alternative removal order is tested; and the training/application mismatch between ±10% linearized perturbations and 100% removal leaves open the possibility that the reduced model works for reasons unrelated to the specific ranking. The absence of public code or data also limits reproducibility of the machine-learning component. The contribution is potentially significant for the ephemerides community, but it needs stronger validation before the ranking claim can be accepted.
major comments (3)
- [Sec. 2.4, Fig. 3] The validation of the ranking is not controlled. The statement that 'the ranking is validated by the increase of the differences to the reference solution with the increase of the ranking' describes a property that any cumulative removal order necessarily possesses: residuals grow as more asteroids are removed. The plateau below 20 cm for up to 200 removals shows that the removed set as a whole is collectively unimportant, but it does not show that this particular 196-asteroid subset is the one identified by the BDT, nor that a random ordering, a reverse ranking, or a simple size/mass-based cut would not perform equally well. Without such control experiments, the causal role of the BDT in producing INPOP25c is not established, and the paper's central claim about the ranking is unsupported.
- [Sec. 2.1.3, Eqs. (3)-(5)] The training set is built from random mass variations of only ±10% around the INPOP21a postfit values, with a target defined by linearized residual changes, while the actual operation is complete removal of the asteroid, i.e., a 100% change. The paper states that the 'validity of such assumptions is going to be proved by the results presented in Sect. 2.4', but those results use the same MEX-based objective and the same full global chi-square for validation; they do not independently probe nonlinearities or interactions among the many simultaneously removed asteroids. This is a load-bearing gap because the reduced model's success might be insensitive to the ordering even if the BDT ranking is unreliable outside the training range. A focused nonlinear test, such as direct integration of a few removal scenarios or an ordering based on full-removal chi-square changes for a subset, would materially strengthen the claim.
- [Sec. 2.4.1, Fig. 4] The selection of INPOP25c as the model with 147 asteroids removed relies on the minimum of the residual indicator RI, which is computed on the same fitted quantities and the same extrapolation interval used to define 'best'. No uncertainty on the RI values, no error bars, and no stability analysis of the minimum across the training-set sizes and hyperparameters are reported. Because the same index is used both to evaluate candidates and to select the final solution, the exact number of removals may be noise-driven. The authors should report the RI values at the minimum, the sensitivity of the minimum to the chosen training set, and ideally a statement of whether solutions between, say, 100 and 200 removals are statistically indistinguishable.
minor comments (7)
- [Fig. 5 and Fig. 6 captions; Sec. 3.1] The captions of Fig. 5 and Fig. 6 refer to 'INPOP26c' while the text uses 'INPOP25c'; also Sec. 3.1 states that 196 masses are fitted by both INPOP25b and INPOP25c, whereas the Fig. 5 caption says 193 masses. Please reconcile these numbers.
- [Sec. 3.2.1 and Sec. 3] There are several typos: 'preform' should be 'perform', 'wether' should be 'whether', and the Table 1 header 'noise-to-signal ration' should be 'ratio'.
- [Sec. 2.1.3, Eqs. (4)-(5)] The notation ∆^(O−C)|O is not defined; please explain the hat operator and the restriction to O (MEX) explicitly, since Eqs. (4)-(5) are central to the training-set construction.
- [Sec. 2.4] The sentence 'For this study, we used the INPOP25a datasets' is ambiguous after the paper states that the ranking is implemented starting from INPOP25b; clarify whether 'datasets' refers to the observation data set or to the ephemeris version used as the starting model.
- [Sec. 3.2.1] The text mentions p-values for the Kolmogorov-Smirnov tests, but Fig. 7 does not show them; please report the p-values in the text or in the figure.
- [Sec. 2.4.1, RI definition] The residual indicator RI combines σ_MEX,fit and σ_MEX,ext in quadrature without an explicit justification for this particular combination; please state the units and whether the two dispersions are weighted equally by construction or by choice.
- [Sec. 2.3 and Sec. 3.2.2] Minor inconsistencies in formatting include 'several trainingsets' (missing space) and inconsistent capitalization of 'INPOP25C' versus 'INPOP25c' in Sec. 3.2.2.
Circularity Check
BDT ranking and its validation share the MEX residual metric, so the main degradation curve is partly a restatement of the training objective; independent nonlinear refits and external mass checks keep the central result from being fully circular.
-
fitted input called prediction
[Sec. 2.1.2-2.1.3 (Eqs. 2-5) and Sec. 2.4 (Fig. 3)]
"f∗ : ∆mAST 7→ ∆˜χ2 OMEX(∆mAST) (2) ... ∆˜χ2 O(∆m)≡ [∆ ^(O−C)|O] T [∆ ^(O−C)|O] . (4) ... The ranking is validated by the increase of the differences to the reference solution (INPOP25b) with the increase of the ranking."
The BDT importance is trained to reproduce Δ~χ2_OMEX, a linearized approximation of the MEX-residual χ2 (Eqs. 2-5). The validation in Sec. 2.4 then reports σMEX of the postfit MEX residuals and the RI based on σMEX,fit and σMEX,ext. To first order, removing asteroids with the smallest linearized effect on MEX residuals must least increase the linearized MEX χ2; the <20 cm plateau up to 200 removals is therefore partly a consequence of the training objective rather than an independent confirmation. The paper explicitly relies on Sec. 2.4 to 'prove' the linearity assumption, but Sec. 2.4 uses the same MEX-based observable, so that proof is circular. The full nonlinear refits, global χ2, and external mass comparisons add independent content, making the circularity partial.
full rationale
The paper's claimed reduction chain is: (i) generate a training set of ±10% mass perturbations with target Δ~χ2_OMEX computed from linearized MEX residuals (Eqs. 2-5); (ii) train a BDT to rank asteroids by importance for that target; (iii) remove asteroids cumulatively from lowest importance, refit the full planetary model, and show σMEX stays below 20 cm for up to 200 removals; (iv) select INPOP25c by minimizing an RI that again combines σMEX,fit and σMEX,ext. Step (iii) is the load-bearing validation of the ranking, but it uses the same MEX residual metric that defined the training target. Under the linearity assumption of Eq. (5), the smallest-importance asteroids are, by construction, the ones whose removal least increases the linearized MEX χ2; the observed plateau is therefore partly encoded in the ranking itself. The paper's statement that the linearity assumption 'is going to be proved by the results presented in Sect. 2.4' is circular in that the same observable is used both to define importance and to test it. This does not make the work wholly circular: the cumulative removals are tested through full nonlinear least-squares refits of all available planetary observations, the global χ2 follows the same trend, and the resulting masses are compared with independent albedo-based posteriors and literature mass determinations (Sec. 3.2). These provide outside support. The absence of a control ordering (e.g., random or reverse ranking) is a substantive limitation of the evidence, but it is a correctness/design issue rather than a circularity per se. Overall, the central reduction claim is partially self-confirming in its validation metric but retains independent content, so the score is 4.
Assumptions & free parameters
free parameters (3)
- 196 INPOP25c asteroid masses =
given in Appendix Table 1
- XGBoost hyperparameters =
not reported
- Mass boundary relaxation factor =
1.25 times the Fienga et al. (2019) boundaries
assumptions (5)
- domain assumption Linearized residual approximation of Eq. (5) is accurate for ±10% mass changes
- domain assumption MEX tracking residuals are a sufficient proxy for global planetary ephemeris quality
- domain assumption XGBoost split-based feature importance correctly ranks strongly correlated asteroid masses
- domain assumption Albedo-based mass posterior, with density uniform in 0.5 to 4.5 g/cm3 and albedo from Murray (2023), represents independent physical mass constraints
- domain assumption INPOP25c and Kretlow (2020) mass determinations are treated as normal distributions for Wasserstein barycenters
Cite this review
Pith. "Pith review of Boosting decision trees for Main Belt Asteroid selection in planetary ephemerides: an alternative model." pith.science (2026). https://pith.science/paper/HJG6BMMG
@misc{pith2026250510487,
author = {Pith},
title = {Pith review of: Boosting decision trees for Main Belt Asteroid selection in planetary ephemerides: an alternative model},
year = {2026},
howpublished = {\url{https://pith.science/paper/HJG6BMMG}},
note = {Machine review of arXiv:2505.10487}
}
read the original abstract
One of the main bottleneck in assessing the accuracy of Mars orbit is the unknown value of the asteroids in the Main Asteroid Belt. Nowadays a modeling with 343 asteroids as point masses is used, with the relative masses fitted to observational data. In the current work we propose an innovative methodology to reduce the number of asteroids implemented as point masses, thus reducing the number of parameters to be fitted, without a significant degradation of the postfit residuals.
Figures
Figures from the paper (5 more)
Reference graph
Works this paper leans on
-
[1]
, " * write output.state after.block = add.period write newline
ENTRY address archivePrefix author booktitle chapter doi edition editor eprint howpublished institution journal key month number organization pages publisher school series title misctitle type volume year version url label extra.label sort.label short.list INTEGERS output.state before.all mid.sentence after.sentence after.block FUNCTION init.state.consts ...
-
[2]
write newline
" write newline "" before.all 'output.state := FUNCTION format.url url empty "" new.block "" url * "" * if FUNCTION format.eprint eprint empty "" archivePrefix empty "" archivePrefix "arXiv" = new.block " " eprint * " " * new.block " " eprint * " " * if if if FUNCTION format.doi doi empty "" " " doi * " " * if FUNCTION format.pid doi empty eprint empty ur...
-
[3]
Asteroid masses obtained with INPOP planetary ephemerides
thebibliography [1] 20pt to REFERENCES 6pt =0pt -12pt 10pt plus 3pt =0pt =0pt =1pt plus 1pt =0pt =0pt -12pt =13pt plus 1pt =20pt =13pt plus 1pt \@M =10000 =-1.0em =0pt =0pt 0pt =0pt =1.0em @enumiv\@empty 10000 10000 `\.\@m \@noitemerr \@latex@warning Empty `thebibliography' environment \@ifnextchar \@reference \@latexerr Missing key on reference command E...
-
[4]
2014, Nuclear Data Sheets, 120, 106, https://doi.org/10.1016/j.nds.2014.07.019
Birch, M., & Singh, B. 2014, Nuclear Data Sheets, 120, 106, https://doi.org/10.1016/j.nds.2014.07.019
-
[5]
J., & Olshen, R
Breiman, L., Friedman, J., Stone, C. J., & Olshen, R. 1984, Classification and Regression Trees (Chapman and Hall/CRC)
1984
-
[6]
2012, Planetary and Space Science, 73, 98, https://doi.org/10.1016/j.pss.2012.03.009
Carry, B. 2012, Planetary and Space Science, 73, 98, https://doi.org/10.1016/j.pss.2012.03.009
- [7]
-
[8]
2020, waspr : Wasserstein Barycenters of Subset Posteriors
Cremers, J. 2020, waspr : Wasserstein Barycenters of Subset Posteriors. https://CRAN.R-project.org/package=waspr
work page 2020
Show all 31 references
-
[9]
2019, Monthly Notices of the Royal Astronomical Society, 492, 589, 10.1093/mnras/stz3407
Fienga, A., Avdellidou, C., & Hanuš, J. 2019, Monthly Notices of the Royal Astronomical Society, 492, 589, 10.1093/mnras/stz3407
2019 doi
-
[10]
2021, Notes Scientifiques et Techniques de l'Institut de Mecanique Celeste, 110
Fienga , A., Deram , P., Di Ruscio , A., et al. 2021, Notes Scientifiques et Techniques de l'Institut de Mecanique Celeste, 110
2021
-
[11]
2019, Notes Scientifiques et Techniques de l'Institut de Mecanique Celeste, 109
Fienga , A., Deram , P., Viswanathan , V., et al. 2019, Notes Scientifiques et Techniques de l'Institut de Mecanique Celeste, 109
2019
-
[12]
2015, Celestial Mechanics and Dynamical Astronomy, 123, 325–349, 10.1007/s10569-015-9639-y
Fienga, A., Laskar, J., Exertier, P., Manche, H., & Gastineau, M. 2015, Celestial Mechanics and Dynamical Astronomy, 123, 325–349, 10.1007/s10569-015-9639-y
2015 doi
-
[13]
2023, An Invitation to Optimal Transport, Wasserstein Distances, and Gradient Flows: Second Edition, 10.4171/etb/25
Figalli, A., & Glaudo, F. 2023, An Invitation to Optimal Transport, Wasserstein Distances, and Gradient Flows: Second Edition, 10.4171/etb/25
2023 doi
-
[14]
Friedman, J. H. 2001, The Annals of Statistics, 29, 1189 , 10.1214/aos/1013203451
2001
-
[15]
2009, The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition (Springer Series in Statistics)
Hastie, T., Tibshirani, R., & Friedman, J. 2009, The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition (Springer Series in Statistics)
2009
-
[16]
2020, in European Planetary Science Congress, EPSC2020--690, 10.5194/epsc2020-690
Kretlow , M. 2020, in European Planetary Science Congress, EPSC2020--690, 10.5194/epsc2020-690
2020 doi
-
[17]
Kuchynka, P., & Folkner, W. M. 2013, Icarus, 222, 243, https://doi.org/10.1016/j.icarus.2012.11.003
2013 doi
-
[18]
2010, Astronomy and Astrophysics, 514, A96, 10.1051/0004-6361/200913346
Kuchynka, P., Laskar, J., Fienga, A., & Manche, H. 2010, Astronomy and Astrophysics, 514, A96, 10.1051/0004-6361/200913346
2010 doi
-
[19]
L., & Hanson, R
Lawson, C. L., & Hanson, R. J. 1995, Solving Least Squares Problems (Society for Industrial and Applied Mathematics), 10.1137/1.9781611971217
1995 doi
-
[20]
2023, The Astronomical Journal, 166, 93, 10.3847/1538-3881/ace52b
Li, F., Yuan, Y., Fu, Y., & Chen, J. 2023, The Astronomical Journal, 166, 93, 10.3847/1538-3881/ace52b
2023 doi
-
[21]
2024, PhD thesis
Mariani, V. 2024, PhD thesis. https://theses.fr/s316642?domaine=theses
2024
- [22]
-
[23]
2020, Computational Optimal Transport
Peyré, G., & Cuturi, M. 2020, Computational Optimal Transport. 1803.00567
2020 arXiv
-
[24]
2020, Journal of Multivariate Analysis, 176, 104581, https://doi.org/10.1016/j.jmva.2019.104581
Puccetti, G., Rüschendorf, L., & Vanduffel, S. 2020, Journal of Multivariate Analysis, 176, 104581, https://doi.org/10.1016/j.jmva.2019.104581
2020
-
[25]
2010, Planetary and Space Science, 58, 858, https://doi.org/10.1016/j.pss.2010.01.010
Somenzi, L., Fienga, A., Laskar, J., & Kuchynka, P. 2010, Planetary and Space Science, 58, 858, https://doi.org/10.1016/j.pss.2010.01.010
2010 doi
-
[26]
Standish, E., & Hellings, R. W. 1989, Icarus, 80, 326, https://doi.org/10.1016/0019-1035(89)90143-7
1989 doi
-
[27]
M., & Fienga, A
Standish, E. M., & Fienga, A. 2002, A&A, 384, 322, 10.1051/0004-6361:20011821
2002 doi
-
[28]
2004, Statistical Orbit Determination, 1st edn
Tapley, B., Schutz, B., & Born, G. 2004, Statistical Orbit Determination, 1st edn. (Elsevier), 10.1016/b978-0-12-683630-1.x5019-x
2004 doi
-
[29]
2008, Optimal Transport: Old and New, Grundlehren der mathematischen Wissenschaften (Springer Berlin Heidelberg)
Villani, C. 2008, Optimal Transport: Old and New, Grundlehren der mathematischen Wissenschaften (Springer Berlin Heidelberg). https://books.google.fr/books?id=hV8o5R7_5tkC
2008
-
[30]
2017, PhD thesis
Viswanathan, V. 2017, PhD thesis. http://www.theses.fr/2017PSLEO005
2017
-
[31]
1984, Icarus, 57, 1, https://doi.org/10.1016/0019-1035(84)90002-2
Williams, J. 1984, Icarus, 57, 1, https://doi.org/10.1016/0019-1035(84)90002-2
1984 doi
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.