A/A-test resampling with a Kolmogorov-Smirnov test on the resulting p-values is proposed as an empirical check for whether normal-approximation confidence intervals and p-values are valid for a given outcome metric.
Stevens, Tatiana Xifara, and Amit Gandhi
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
background 1
citation-polarity summary
fields
stat.ME 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
$t$-Testing the Waters: Empirically Validating Assumptions for Reliable A/B-Testing
A/A-test resampling with a Kolmogorov-Smirnov test on the resulting p-values is proposed as an empirical check for whether normal-approximation confidence intervals and p-values are valid for a given outcome metric.