Pith. sign in

REVIEW 3 major objections 5 minor 8 references

Using the chi-square test to compare asteroid and laboratory reflectance spectra

T0 review · 3 major / 5 minor · reviewed 2026-08-12 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read The paper claims that the Pearson chi-square test, run against about 11,000 laboratory reflectance spectra, is a very useful initial technique for finding spectral analogs, and that its Mars Trojan matches support a Martian origin.

desk verdict Useful first-pass spectral matching with clean controls; the Mars trojan origin claim outruns the statistics. read the letter →

arxiv 2411.18705 v1 pith:V7XZSGA3 submitted 2024-11-27 astro-ph.EP astro-ph.IM

Latika Joshi , Ines Belkhodja , Livneh Naaman , Thomas Burbine , Brian Burt This is my paper · ORCID
classification astro-ph.EPastro-ph.IM
keywords chi-squaretestreflectancespectroscopyspectralmatchingMarsTrojansmeteoriteanalogsspaceweatheringasteroidmineralogyVNIRspectra
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper is trying to establish that the Pearson chi-square test, applied to a large library of laboratory reflectance spectra, is a reliable first-pass method for identifying an asteroid's spectral analogs. It validates the method on three asteroids with well-known mineralogies, Vesta, Hebe, and Fortuna, and shows the test recovers their previously predicted meteorite matches. It then applies the technique to four Mars Trojans and finds that their best matches are Martian meteorites, Martian-like minerals and synthetic Martian basalts, which supports the hypothesis that these Trojans came from Mars. The authors also conclude that such automated matching is useful before any mineralogical assumption is made, and that a future sample return is the only conclusive test of the Trojans' origin.

What carries the argument

The central object is the Pearson chi-square statistic, defined for each candidate as a sum over wavelength channels of the squared difference between the normalized asteroid reflectance and the laboratory reflectance, scaled by the laboratory reflectance. The code normalizes both spectra to unity at 0.55 µm (or 1.215 µm), smooths the asteroid spectrum with Savitzky-Golay filtering, interpolates the 10,884 laboratory spectra to the same wavelengths, and ranks all resulting chi-square values; the lowest values are the best spectral analogs. For space-weathered asteroids, a linear slope is divided out, labeled 'de-reddened,' before matching to improve the reliability of the comparison.

What would settle it

Re-run the same matching code on the same 10,884-spectrum library using asteroid spectra whose wavelength channels have been randomly shuffled, or synthetic featureless spectra with added noise. If the best chi-square for those control spectra falls below the values reported for the Mars Trojans, especially the values above 7 for 1998VF31, then the apparent Martian-origin matches are not distinguishable from chance.

Watch

Extended reading notes

Core claim

On its own terms, the paper establishes that ranking by Pearson's chi-square statistic turns a large mixed library of laboratory reflectance spectra into a practical first-pass analog finder: the top matches for (4) Vesta are dominated by HED howardites and eucrites, for (19) Fortuna by CM2 carbonaceous chondrites, and for (6) Hebe after removing a linear slope by H chondrites. Applied to four Mars Trojans, the top matches are dominated by olivine, low- and high-calcium pyroxenes, carbonates, synthetic Martian basalts, and Martian meteorites; the authors read these as supporting a Martian origin for the analyzed Trojans while explicitly allowing that they could be fragments of a disrupted differentiated body or bodies.

Load-bearing premise

The method's conclusion rests on assuming that the smallest chi-square value among 10,884 library spectra is meaningful evidence of compositional similarity, not a number that would often be small just because so many comparisons are being tried.

Editorial extensions

If this is right

  • The chi-square test should become the initial step before any mineralogical assumption or more complex spectral modeling is made for an asteroid.
  • For Vesta and Fortuna, the previously known meteorite links appear in the top chi-square matches, confirming that the method retrieves real compositional analogs.
  • For Hebe, de-reddening increases the number of meteoritic matches, indicating that a simple slope correction can partly compensate for space weathering during library searches.
  • For Eureka, 2007NS2, and 2001DH47, the best matches are olivine- and pyroxene-dominated, carbonate-bearing, or synthetic Martian materials; Eureka's best original match is a Martian shergottite.
  • The Martian-origin hypothesis for the Mars Trojans gains support from these matches, but the possibility of fragments from a disrupted differentiated body remains open, and sample return is the only conclusive test.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The paper reports top-twenty rankings without a null distribution; comparing the observed chi-square values to a shuffled-spectrum baseline would tell whether the Martian-origin matches are statistically distinctive.
  • For newly discovered asteroids, the same screening could be run automatically as soon as a VNIR spectrum exists, with de-reddening variants included, since the code is simple and fast.
  • The method's usefulness on Vesta and Fortuna suggests it can identify analogs that are not represented as meteorites, such as terrestrial, synthetic, and lunar samples, which is exactly what the Mars Trojan matches show.
  • A testable extension would be to fit a grid of linear reddening slopes for each asteroid and report the minimum chi-square over the grid, rather than one ad hoc de-reddened spectrum.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. This manuscript applies Pearson's chi-square spectral matching between the VNIR reflectance spectra of seven asteroids and 10,884 RELAB laboratory spectra. The method is validated on three control asteroids with independently known mineralogies (Vesta, Hebe, Fortuna) and then applied to four Mars trojans (Eureka, 1998VF31, 2007NS2, 2001DH47). For some objects a linear slope is divided out from the asteroid spectrum to approximate space-weathering removal. Top-20 matches are reported in tables and figures, and the paper concludes that chi-square matching is a very useful initial screening technique and that the Mars trojan matches support a Martian origin for these objects.

Significance. If the central claims hold, the paper offers a simple, transparent, and quantitative first-pass spectral analog tool, and it sharpens the scientific case for Mars trojan sample return. The control tests are a genuine strength: Vesta returns howardites at the top, Fortuna returns CM2 chondrites, and de-reddening moves Hebe toward H chondrites. These results are internally consistent and independently support the utility of the method as a screening tool. The significance is limited, however, by the absence of a statistical calibration for the top-20 convention and by the overstatement of the Mars trojan results, which are substantially weaker than the controls.

major comments (3)
  1. [§Analysis and §Results (101429) 1998VF31] The top-20 convention inherited from DeMeo et al. (2009) is not a statistical threshold, and the search over 10,884 spectra introduces a severe multiple-comparison problem. For 1998VF31 the best chi-square values are 7.28 (original, Table 8) and 5.37 (de-reddened, Table 9), far above the sub-unity values for Vesta and Fortuna. The manuscript calls these matches 'significant' in the abstract, but no null distribution is constructed and no multiple-comparison correction is applied. The authors should demonstrate, for example by matching random or compositionally unrelated spectra against the same library, what chi-square values arise by chance; otherwise the top-20 lists for the Mars trojans, especially 1998VF31, do not establish compositional similarity.
  2. [§Analysis, §Results (6) Hebe, Tables 6–13] The linear-slope de-reddening procedure is applied post hoc to all four Mars trojans without an objective criterion, and it changes the interpretation of the matches. For Eureka it shifts the best match from the shergottite ALHA77005 (Table 6) to the ungrouped achondrite GRA06129 (Table 7); for 2007NS2 and 2001DH47 it introduces carbonates and pallasitic material (Tables 11 and 13) that the authors themselves note are implausible in the required abundances. The manuscript also concedes that de-reddening can create an unphysical blue slope for Hebe. The authors should validate the de-reddening on the control asteroids with a predefined criterion, or present it as a sensitivity check rather than as evidence supporting a Martian origin.
  3. [§Abstract and §Conclusions] The claim that 'the top chi-square matches among the Mars trojans reveal significant spectral similarities with Martian meteorites and minerals found on Mars' is not supported for all four objects. In the original-spectrum top-20 lists, no Martian meteorite appears for 1998VF31 (Table 8), 2007NS2 (Table 10), or 2001DH47 (Table 12); only Eureka has the shergottite ALHA77005 as its best match (Table 6). The conclusion that the matches 'support the hypothesis of a Martian origin for the analyzed Mars trojans' therefore overstates the evidence presented in the tables. The authors should either limit the Martian-origin inference to Eureka or supply additional quantitative support for the other three objects.
minor comments (5)
  1. [§Results (6) Hebe] The figure numbering is inconsistent: the text following Table 4 refers to 'Figure 5' for the de-reddened Hebe matches, but the plot is labeled Figure 3.
  2. [Table 13] The table heading reads '2001DH74' instead of '2001DH47'.
  3. [Table 12] Row 18 ('TanOlivine', chi-square 2.30) is out of numerical order; the table should be reordered or the value should be corrected.
  4. [§Abstract] The abstract contains a grammatical error: 'The chi-square test is then be applied' should read 'is then applied'.
  5. [§Analysis] The preprocessing details are not fully specified: the Savitzky-Golay window width and polynomial order, the interpolation scheme for the laboratory spectra, and the rule for choosing the normalization wavelength (0.55 µm versus 1.215 µm) should be stated explicitly, or a code repository should be provided, to make the results reproducible.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the chi-square rankings are computed directly from external RELAB spectra, and the Mars trojan inference is an interpretive claim rather than a fitted output.

full rationale

The paper's central workflow is a direct comparison of each asteroid spectrum against 10,884 RELAB laboratory spectra, with chi-square values computed from normalized reflectances. No parameter is fitted to the target conclusion, and no equation or result is recycled as an input. The Vesta and Fortuna controls are independent, previously established mineralogical links, and finding LEW90500 for Fortuna and HED meteorites for Vesta among the top matches is a genuine external validation rather than a construction of the result. The self-citation to DeMeo et al. (2022) for the chi-square matching code is not load-bearing: the method is re-implemented, described, and validated against known-mineralogy asteroids. The post hoc decision to de-redden some spectra is a preprocessing choice motivated by prior expectations, and the paper explicitly acknowledges the artifacts this can introduce, so it does not amount to fitting the output. The absence of a null distribution and multiple-comparison correction is a statistical significance concern, not a circularity: the top-20 convention inherited from DeMeo et al. (2009) is arbitrary, but it does not make the chi-square rankings equivalent to the Martian-origin hypothesis. The Martian-origin interpretation is logically separable from the computed matches and is even partially undercut by the paper's own statement that igneous asteroidal processes can roughly duplicate Martian crust, which further shows the conclusion is an interpretation rather than an input-output identity. Overall, the derivation is self-contained against an external spectral library, so the circularity score is 0.

Assumptions & free parameters 3 free parameters · 5 assumptions · 0 invented entities

No new physical entities are introduced; the paper only re-analyzes existing spectra. The analytic choices that affect the result are the normalization wavelength, the optional linear slope removal, and the smoothing parameters. The main statistical assumptions are that chi-square is a valid spectral distance and that the top of a large-ranked list is meaningful without a null model.

free parameters (3)
  • Normalization wavelength = 0.55 µm or 1.215 µm
    Each spectrum is scaled to unity at 0.55 µm, or at 1.215 µm when the 0.55 µm region is not covered (Analysis). This choice rescales all comparisons and directly changes every chi-square value.
  • De-reddening linear slope = not stated numerically
    A linear slope is divided out of Hebe, Eureka, 1998VF31, 2007NS2, and 2001DH47 spectra to mimic space weathering. The slope value is computed per spectrum and is not reported; it changes the ranking of matches, and the authors note it makes the de-reddened Hebe spectrum artificially blue past 1.5 µm.
  • Savitzky-Golay smoothing parameters = not stated
    Laboratory spectra are smoothed before matching, but window size and polynomial order are not given, which affects interpolated values and chi-square results.
assumptions (5)
  • standard math Pearson's chi-square statistic measures spectral similarity when applied to normalized reflectance spectra
    The paper uses the chi-square statistic of Pearson 1900 as a distance metric between asteroid and laboratory spectra. This is a standard statistical tool, though its validity for reflectance spectra with correlated errors is assumed.
  • domain assumption Asteroid and laboratory reflectance spectra are directly comparable after normalization to unity
    The comparison assumes that scaling to 0.55 or 1.215 µm removes the main brightness and slope differences and that visual albedo can be checked separately (Analysis, Results).
  • ad hoc to paper Space weathering reddening can be approximated by dividing out a linear slope
    The paper de-reddens by linear slope removal for bodies suspected of weathering. The authors themselves note this is 'rather simplistic' and creates an unphysical blue spectrum past 1.5 µm for Hebe.
  • ad hoc to paper Top 20 chi-square matches among about 10,884 spectra are meaningful without a significance threshold
    The paper follows DeMeo et al. 2009 in listing top 20 matches, but does not estimate a null distribution or correct for multiple comparisons, so low chi-square can be expected by chance.
  • domain assumption Laboratory room-temperature spectra can be compared to cold asteroid surfaces without temperature correction
    The Analysis states 'No correction was made for differences in temperature... RELAB spectra were measured at room temperature while asteroids tend to have colder surface temperatures.' This is an acknowledged assumption.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Using the chi-square test to compare asteroid and laboratory reflectance spectra." pith.science (2026). https://pith.science/paper/V7XZSGA3

@misc{pith2026241118705,
  author       = {Pith},
  title        = {Pith review of: Using the chi-square test to compare asteroid and laboratory reflectance spectra},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/V7XZSGA3}},
  note         = {Machine review of arXiv:2411.18705}
}
read the original abstract

This study uses the Pearson's chi-square test to analyze the VNIR reflectance spectra of seven asteroids and look for spectral matches among approximately 11,000 laboratory spectra of meteoritic, terrestrial, synthetic, Apollo, and Luna samples. First, we use the chi-square method to analyze three well-studied asteroids - (4) Vesta, (6) Hebe, and (19) Fortuna - to establish the technique's reliability by attempting to confirm previously predicted spectral matches. The chi-square test is then applied to four other asteroids: the Mars trojans (5261) Eureka, (101429) 1998 VF31, (311999) 2007 NS2, and (385250) 2001 DH47. This study focuses on Mars trojans because of their undetermined origin and possible relationship to Mars. For asteroids that may have undergone space weathering, reddening effects are removed from the spectra to allow for a more accurate chi-square analysis. The top chi-square matches among the Mars trojans reveal significant spectral similarities with Martian meteorites and minerals found on Mars, supporting the hypothesis of a Martian origin for the analyzed Mars trojans. However, the possibility that these Mars trojans could be fragments of a disrupted differentiated body or bodies cannot be ruled out. We find that using the chi-square test with a large number of laboratory spectra is a very useful initial technique for identifying spectral analogs to asteroids.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

8 extracted references · 7 canonical work pages

  1. [1]

    Bishop,J.L.,Lougear, A.,Newton,J.,etal.2021,GeCoA, 65, 2875

    work page 2021

  2. [2]

    2017, MNRAS, 466, 489 Burbine,T

    Borisov, G., Christou, A., Bagnulo, S., et al. 2017, MNRAS, 466, 489 Burbine,T. H.1998,M&PS,33,253 Burbine,T. H.,McCoy, T. J.,Hinrichs,J.L.,&Lucey, P. G.2006,M&PS,41,1139, Bus,S.J.&Binzel,R.P. 2002,Icarus,158,106 Cannon,K.M.,Parman,S.W.,&Mustard,J.F.,2017,Nature,552,88 Castro-Cisneros,J.D.,Malhotra,R.,&Rosengren,A.J.2023,ComEE,4,372 Christou,A.A.2013,Icar...

    work page 2017

  3. [3]

    E.,Binzel,R.P.,Slivan,S.M.,&Bus,S.J.2009,Icarus,202,160 DeMeo,F

    Day, J.M.D.,Ash,R.D.,Liu,Y.,etal.2009,Nat,457,179 DeMeo,F. E.,Binzel,R.P.,Slivan,S.M.,&Bus,S.J.2009,Icarus,202,160 DeMeo,F. E.,Burt,B.J.,Marsset,M.,etal.2022,Icarus,380,114971 Dibb,S.D.,Bell,J.F. III,Elkins-Tanton,L.T.,&Williams,D.A.2023,E&SS,10,e2022EA002694 Ehlmann,B.L.&Edwards,C.S.2014,AREPS,42,291 Franke,T. M.,Ho,T.,&Christie,C.A.2012,AmJE,33,448

    work page 2009

  4. [4]

    Gaffey, M.J.&Gilbert,S.L.1998,M&PS,33,1281 Glotch,T. D.,Edwards,C.S.,Yesiltas,M.,etal.2018,JGRE,123,2467 Hazen,R.M.,Downs,R.T.,Morrison,S.M.,etal.2023,JGRE,128,e2023JE007865 Herrin,J.S.,Zolensky, M.E.,Cartwright,J.E.,etal.2011,2011LPI,2806 Hyodo,R.&Genda,H.2018,ApJL,856,L36 Hyodo,R.,Genda,H.,Charnoz,S.,&Rosenblatt,P. 2017.ApJ,845,125 Jiao,Y.,Cheng,B.,Huan...

    doi:10.1038/s41550-024-02258-z 1998

  5. [5]

    2007,AnMN,30(1),16 McCord,T

    Mainzer, A.,Bauer, J.,Cutri,R.,etal.2019,NASAPDS,NEOWISEDiametersandAlbedosV2.0 Mason,B.1981,AnMN,4(1),12 McBride,K.,McCoy, T.,&Reynolds,V. 2007,AnMN,30(1),16 McCord,T. B.,Adams,J.B.,&Johnson,T. V. 1970,Sci,168,1445 McSween,H.Y. Jr.,Taylor, L.A.,&Stolper, E.M.,1979,Sci,204,1201 MeteoriticalBulletinDatabase2024,https://www.lpi.usra.edu/meteor/ Mikouchi,T. ...

    work page 2019

  6. [6]

    Sharkey, B.N.L.,Reddy, V.,Malhotra,R.,etal.2021,ComEE,2,231 Tedesco,E.F.,Noah,P. V.,Noah,M.,&PriceS.D.2004,PDSS,IRAS-A-FPA-3-RDR-IMPS-V6.0 Thompson,M.S.,Morris,R.V.,Clemett,S.J.,etal.2020,Icarus,346,113775 Trilling,D.E.,Rivkin,A.S.,Stansberry, J.A.,etal.2007,Icarus,192,442 Wickhusen,K.,Oberst,J., Christou,A.,&Damme,F. 2023,P&SS,105649

    work page 2021

  7. [7]

    Wray, J.J.,Murchie,S.L.,Bishop,J.L.,etal.2016,JGRE,121,652 Yamada,M.,Sasaki,S.,Nagahara,H.,etal.1999,EP&S,51,1255

    work page 2016

  8. [8]

    D.2021,GRL,48,e2020GL092365

    Zastrow, A.M.&Glotch,T. D.2021,GRL,48,e2020GL092365

    work page 2021

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.