Pith. sign in

REVIEW 2 cited by

The look-elsewhere effect from a unified Bayesian and frequentist perspective

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2007.13821 v1 pith:CGUE7XZ6 submitted 2020-07-27 physics.data-an astro-ph.COastro-ph.IMhep-exstat.AP

classification physics.data-anastro-ph.COastro-ph.IMhep-exstat.AP
keywords effectsignificancefactorlook-elsewherestatisticalexpensivefrequentistlarge
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
abstract

When searching over a large parameter space for anomalies such as events, peaks, objects, or particles, there is a large probability that spurious signals with seemingly high significance will be found. This is known as the look-elsewhere effect and is prevalent throughout cosmology, (astro)particle physics, and beyond. To avoid making false claims of detection, one must account for this effect when assigning the statistical significance of an anomaly. This is typically accomplished by considering the trials factor, which is generally computed numerically via potentially expensive simulations. In this paper we develop a continuous generalization of the Bonferroni and Sidak corrections by applying the Laplace approximation to evaluate the Bayes factor, and in turn relating the trials factor to the prior-to-posterior volume ratio. We use this to define a test statistic whose frequentist properties have a simple interpretation in terms of the global $p$-value, or statistical significance. We apply this method to various physics-based examples and show it to work well for the full range of $p$-values, i.e. in both the asymptotic and non-asymptotic regimes. We also show that this method naturally accounts for other model complexities such as additional degrees of freedom, generalizing Wilks' theorem. This provides a fast way to quantify statistical significance in light of the look-elsewhere effect, without resorting to expensive simulations.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Debiasing inference in large-scale structure with non-flat volume measures

    astro-ph.CO 2025-07 conditional novelty 6.0 of 10

    A curvature-weighted, non-flat volume measure removes the leading-order marginalization bias in posterior means, recovering cosmological parameters in mocks to below 0.1 sigma.

  2. Searching for Inflationary Physics with the CMB Trispectrum: 3. Constraints from Planck

    astro-ph.CO 2025-02 accept novelty 6.0 of 10

    A comprehensive Planck PR4 trispectrum analysis finds no primordial non-Gaussianity across 33 templates and sets leading constraints, including tau_NL loc < 1500 at 95% CL.

Pith tools