Pith. sign in

REVIEW 2 cited by

Selective inference for multiple pairs of clusters after K-means clustering

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2405.16379 v1 pith:UUHXGJGC submitted 2024-05-25 stat.ME

classification stat.ME
keywords clusterstestclusteringpairsk-meansmultipletestingunknown
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

If the same data is used for both clustering and for testing a null hypothesis that is formulated in terms of the estimated clusters, then the traditional hypothesis testing framework often fails to control the Type I error. Gao et al. [2022] and Chen and Witten [2023] provide selective inference frameworks for testing if a pair of estimated clusters indeed stem from underlying differences, for the case where hierarchical clustering and K-means clustering, respectively, are used to define the clusters. In applications, however, it is often of interest to test for multiple pairs of clusters. In our work, we extend the pairwise test of Chen and Witten [2023] to a test for multiple pairs of clusters, where the cluster assignments are produced by K-means clustering. We further develop an analogous test for the setting where the variance is unknown, building on the work of Yun and Barber [2023] that extends Gao et al. [2022]'s pairwise test to the case of unknown variance. For both known and unknown variance settings, we present methods that address certain forms of data-dependence in the choice of pairs of clusters to test for. We show that our proposed tests control the Type I error, both theoretically and empirically, and provide a numerical study of their empirical powers under various settings.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Robust Inference Methods for Latent Group Panel Models under Possible Group Non-Separation

    econ.EM 2025-11 conditional novelty 7.0 of 10

    Selective conditional inference gives Wald tests on estimated latent panel groups a truncated chi-square null distribution, valid even without group separation.

  2. Testing Clustered Equal Predictive Ability with Unknown Clusters

    econ.EM 2025-07 conditional novelty 6.0 of 10

    A selective inference test for clustered equal predictive ability that is valid when clusters are estimated by panel k-means.

Pith tools