Pith. sign in

REVIEW 1 cited by

Logical contradictions in the One-way ANOVA and Tukey-Kramer multiple comparisons tests with more than two groups of observations

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2104.07552 v2 pith:ODW6K2SM submitted 2021-04-15 math.ST stat.MEstat.TH

classification math.STstat.MEstat.TH
keywords anovaassumptionsgroupsldotscaseinahpairtests
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
abstract

We show that the One-way ANOVA and Tukey-Kramer (TK) tests agree on any sample with two groups. This result is based on a simple identity connecting the Fisher-Snedecor and studentized probabilistic distributions and is proven without any additional assumptions; in particular, the standard ANOVA assumptions (independence, normality, and homoscedasticity (INAH)) are not needed. In contrast, it is known that for a sample with k > 2 groups of observations, even under the INAH assumptions, with the same significance level $\alpha$, the above two tests may give opposite results: (i) ANOVA rejects its null hypothesis $H_0^{A}: \mu_1 = \ldots = \mu_k$, while the TK one, $H_0^{TK}(i,j): \mu_i = \mu_j$, is not rejected for any pair $i, j \in \{1, \ldots, k\}$; (ii) the TK test rejects $H_0^{TK}(i,j)$ for a pair $(i, j)$ (with $i \neq j$) while ANOVA does not reject $H_0^{A}$. We construct two large infinite pseudo-random families of samples of both types satisfying INAH: in case (i) for any $k \geq 3$ and in case (ii) for some larger $k$. Furthermore, in case (ii) ANOVA, being restricted to the pair of groups $(i,j)$, may reject equality $\mu_i = \mu_j$ with the same $\alpha$. This is an obvious contradiction, since $\mu_1 = \ldots = \mu_k$ implies $\mu_i = \mu_j$ for all $i, j \in \{1, \ldots, k\}.$ Similar contradictory examples are constructed for the Multivariable Linear Regression (MLR). However, for these constructions it seems difficult to verify the Gauss-Markov assumptions, which are standardly required for MLR.

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Local-available quantum correlation swapping in one-parameter X states

    quant-ph 2025-07 reject novelty 5.0 of 10

    LAQC can be redistributed by projective swapping in X states, but the paper's key examples claiming separable final states with nonzero LAQC are only valid for part of the parameter space.

Pith tools