REVIEW 9 cited by
Exoplaneteers Keep Overestimating Sigma Significances
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Exoplaneteers Keep Overestimating Sigma Significances
abstract
Astronomers, and in particular exoplaneteers, have a curious habit of expressing Bayes factors as frequentist sigma values. This is of course completely unnecessary and arguably rather ill-advised. Regardless, the practice is common - especially in the detection claims of chemical species within exoplanet atmospheres. The current canonical conversion strategy stems from a statistics paper from Sellke et al. (2001), who derived an upper bound on the Bayes factor between the test and null hypotheses, as a function of the $p$-value (or number of sigmas, $n_{\sigma}$). A common practice within the exoplanet atmosphere community is to numerically invert this formula, going from a Bayes factor to $n_\sigma$. This goes back to Benneke & Seager (2013) -- a highly cited paper that introduced Bayesian model comparison as a means of inferring the presence of specific chemical species -- in an attempt to calibrate the Bayes factors from their technique for a community that in 2013 was more familiar with frequentist sigma significances. However, as originally noted by Sellke et al. (2001), the conversion only provides an upper limit on $n_\sigma$, with the true value generally being lower. This can result in inflations of claimed detection significances, and this note strongly urges the community to stop converting to $n_\sigma$ at all and simply stick with Bayes factors.
Forward citations
Cited by 9 Pith papers
-
Aerosols and hydrocarbons in the atmosphere of a white dwarf planet
JWST NIRSpec PRISM transmission spectroscopy detects CH4, other hydrocarbons, and aerosols in WD 1856 b's atmosphere, with evidence for recent reheating and a carbon-enriched composition.
-
Photochemical CS$_2$ Gas Detected on a 20-Myr-old Exoplanet
Transmission spectroscopy detects CS2 at >8σ in the H/He atmosphere of young exoplanet V1298 Tau e, contrasting with SO2 on sibling planet b.
-
Detection of CO, H$_2$O, and OH in WASP-18b with JWST/NIRISS using Direct-Extracted Spectra and Cross-Correlation
Direct pixel-level extraction of NIRISS spectra for WASP-18b followed by cross-correlation yields 4.4σ CO, 3.4σ H2O, and 7.8σ OH detections, with improved abundance constraints from subsequent retrievals.
-
The KPF SURFS-UP Survey I: Transmission Spectroscopy of WASP-76 b
KPF transmission spectroscopy of WASP-76 b detects Fe I with a clear ingress-egress asymmetry but no measurable asymmetry for Na I or Ca II, supporting altitude-dependent circulation.
-
Chemistry and Isotope Ratios of Substellar Atmospheres in the $\beta$ Pictoris Young Moving Group and Vicinity
Atmospheric retrievals yield C/O = 0.57±0.01, [M/H] = 0.18±0.05, and 12CO/13CO ≈ 95 for 2MASS J0249-0557 c, matching benchmark brown dwarfs and favoring star-like gravitational collapse over disk accretion.
-
Chemistry and Isotope Ratios of Substellar Atmospheres in the $\beta$ Pictoris Young Moving Group and Vicinity
Atmospheric retrievals on CRIRES+ spectra of 2MASS J0249-0557 c and two eta Pic YMG brown dwarfs give solar-like C/O, metallicity, and carbon isotope ratios, supporting gravitational collapse formation for the companion.
-
The Bayesian view of DESI DR2 with unimpeded: Evidence and tension in a combined analysis with CMB and supernovae across cosmological models
Bayesian evidence computation on DESI DR2 plus Planck and supernovae eliminates the frequentist 3.1 sigma preference for w0waCDM over LambdaCDM when using the DES-Dovekie recalibration, yielding ln B = -0.30 favoring ...
-
NASA's Pandora SmallSat Mission: Simulating the Impact of Stellar Photospheric Heterogeneity and Its Correction
Pandora simulations recover stellar photospheric temperatures to ~30 K with no bias and reduce simple spot contamination from 100-1000 ppm to under 10 ppm, but complex spot geometries leave ~1000 ppm residuals.
-
Panchromatic View of the Frigid Jovian Exoplanet COCONUTS-2 b
Panchromatic 1-15 micron observations of COCONUTS-2 b yield Teff=496 K, log g=4.3, near-solar metallicity, radius 1.03 Rjup, luminosity log(L/Lsun)=-6.166, and mass 7.3 Mjup from evolutionary models.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.