Pith. sign in

Carefree multiple testing with e-processes

1 Pith paper cite this work. Polarity classification is still indexing.

1 Pith paper citing it
abstract

E-processes enable hypothesis testing with ongoing data collection while maintaining Type I error control. However, when testing multiple hypotheses simultaneously, current $e$-value based multiple testing methods such as e-BH are not invariant to the order in which data are gathered for the different $e$-processes. This can lead to undesirable situations, e.g., where a hypothesis rejected at time $t$ is no longer rejected at time $t+1$ after choosing to gather more data for one or more $e$-processes unrelated to that hypothesis. We argue that multiple testing methods should always work with suprema of $e$-processes. We provide an example to illustrate that e-BH does not control the FDR, at level $\alpha$ when applied to suprema of $e$-processes. From the same example we see that the FWER is not controlled with averaging, and also closed e-BH does not control the FDR. We show that adjusters can be used to ensure FDR-sup control with e-BH under arbitrary dependence.

fields

stat.ME 1

years

2025 1

verdicts

ACCEPT 1

representative citing papers

Anytime-valid FDR control with the stopped e-BH procedure

stat.ME · 2025-02-12 · accept · novelty 6.0

Stopped e-BH controls FDR at all stopping times when the underlying e-processes are global, and local e-processes become global under a no-unobserved-confounding Markov condition.

citing papers explorer

Showing 1 of 1 citing paper.

  • Anytime-valid FDR control with the stopped e-BH procedure stat.ME · 2025-02-12 · accept · none · ref 8 · internal anchor

    Stopped e-BH controls FDR at all stopping times when the underlying e-processes are global, and local e-processes become global under a no-unobserved-confounding Markov condition.