Testing Separability of High-Dimensional Covariance Matrices

Bongjung Sung; Peter D. Hoff

REVIEW 2 major objections 2 minor 1 cited by

Testing separability of a high-dimensional covariance matrix is equivalent to testing sphericity of its core component.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

T0 review · grok-4.3

2026-05-19 07:53 UTC pith:E6CFC3TF

load-bearing objection The core covariance reduction turns separability testing into sphericity testing, which cleanly delivers invariant high-dimensional statistics with simulatable nulls. the 2 major comments →

arxiv 2506.17463 v4 pith:E6CFC3TF submitted 2025-06-20 math.ST stat.MEstat.TH

Testing Separability of High-Dimensional Covariance Matrices

Bongjung Sung , Peter D. Hoff This is my paper

classification math.ST stat.MEstat.TH

keywords separability testinghigh-dimensional covariancecore covariance matrixsphericity testmatrix-variate datainvariant testsasymptotic spectral equivalence

verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper shows that checking whether the covariance matrix Σ for matrix-variate data is separable is the same as checking whether its core component is spherical. This equivalence produces test statistics that remain well-defined when the dimension is large relative to sample size and whose distributions under the null do not depend on unknown parameters. Researchers can therefore simulate the null distribution exactly and control error rates precisely. The authors also prove that the sample covariance and its core are asymptotically equivalent in spectrum when the ratio of dimension to sample size converges to a positive constant, which justifies the use of these tests in the high-dimensional regime. Numerical comparisons indicate that the resulting procedures detect non-separability more often than earlier methods.

Core claim

We show that testing separability of Σ is equivalent to testing sphericity of its core component. With this insight, we construct test statistics that are well-defined in high-dimensional settings and have distributions that are invariant under the null hypothesis of separability, allowing for exact simulation of null distributions. We establish the asymptotic properties of some test statistics by proving the asymptotic spectral equivalence between the sample covariance matrix and its core in a p/n→γ∈(0,∞) regime.

What carries the argument

The core covariance matrix, a complementary object to a separable covariance matrix, carries the argument by converting separability testing into an equivalent sphericity test whose null distribution is parameter-free.

Load-bearing premise

The core covariance matrix is defined so that separability of the original matrix holds exactly if and only if the core is spherical, and the asymptotic spectral equivalence between sample and population versions is valid when dimension over sample size approaches a positive constant.

What would settle it

A Monte Carlo experiment in which the proposed test statistic under the null of separability produces a distribution that still depends on unknown parameters, or in which the tests do not show higher power than existing procedures, would falsify the central claims.

Watch this falsifier — get emailed when new claim-graph text bears on it.

If this is right

Test statistics become invariant under the null, so their critical values can be obtained by direct simulation without estimating nuisance parameters.
The tests remain valid when the ratio of variables to observations converges to any positive finite limit.
The same equivalence supplies a route to other high-dimensional tests by replacing separability with other structural hypotheses on the core.
Numerical evidence indicates these procedures detect departures from separability more reliably than prior methods for the same sample sizes.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

The reduction to a sphericity problem on the core may simplify the derivation of tests for related covariance structures such as Kronecker or factor models.
Applied researchers working with matrix-valued observations could use the exact null simulation to set precise significance levels in settings where parameter-dependent approximations have been unreliable.
Finite-sample refinements that exploit the exact invariance might further improve performance when the dimension-to-sample ratio is moderate rather than large.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Desk Editor's Note

The core covariance reduction turns separability testing into sphericity testing, which cleanly delivers invariant high-dimensional statistics with simulatable nulls.

read the letter

The main thing to know is that this paper defines a core covariance matrix so separability of the full Sigma becomes equivalent to sphericity of the core. That move lets them build test statistics that stay invariant under the null and whose distributions can be simulated exactly without estimating any parameters. It also gives asymptotic spectral equivalence results between the sample covariance and the core when p/n goes to a positive constant. This directly targets the two problems called out in the abstract: statistics that fall apart in high dimensions and nulls that depend on unknowns. The numerical comparisons show higher power than prior methods, which is useful if the tests hold up. The reduction itself looks like a genuine step beyond the cited separability literature. The soft spot is exactly where the stress-test note points: the equivalence is only as strong as the core definition. If that definition requires hidden normalizations, eigenvalue separation, or extra moment conditions to map separable matrices exactly to spherical ones and non-separable ones to non-spherical ones, then both the exact invariance and the high-dimensional asymptotics become conditional rather than unconditional. The abstract states the equivalence and the spectral result, but the proofs will need to be checked for any such restrictions. This is aimed at statisticians working with matrix-variate data who need to validate the separability assumption before fitting Kronecker models. Readers who care about exact error control in high dimensions or who already use sphericity tests will see the most direct value. It deserves peer review because the reduction is new, the invariance property is practically attractive, and the technical claims are specific enough to be refereeable even if some conditions need tightening.

Referee Report

2 major / 2 minor

Summary. The paper proposes a new approach to testing separability of high-dimensional covariance matrices Σ by introducing the complementary notion of a core covariance matrix. It claims that testing separability of Σ is exactly equivalent to testing sphericity of the core component. This equivalence is used to construct invariant test statistics that remain well-defined when p/n → γ ∈ (0, ∞), possess null distributions free of unknown parameters (hence exactly simulable), and satisfy asymptotic spectral equivalence between the sample covariance and the core. Numerical experiments are presented to illustrate higher power relative to existing procedures.

Significance. If the claimed exact equivalence and the asymptotic spectral equivalence hold under the stated high-dimensional regime, the work supplies a principled route to parameter-free, simulable null distributions for separability testing. This would address two documented shortcomings of prior tests (ill-defined statistics in high dimensions and parameter-dependent nulls) and could be useful in matrix-variate applications where Kronecker structure is assumed but must be verified.

major comments (2)

[Abstract and §2] Abstract and §2 (definition of core): the central claim that separability of Σ is equivalent to sphericity of the core holds only if the core is constructed so that any separable Σ maps precisely to a multiple of the identity and any non-separable Σ maps to a non-spherical matrix, without implicit normalizations or additional eigenvalue-separation assumptions. The manuscript must exhibit the explicit mapping and verify that no hidden parameters remain.
[§4] §4 (asymptotic spectral equivalence): the transfer of null-distribution properties to the proposed test statistics relies on proving that the sample covariance and its core are asymptotically spectrally equivalent when p/n → γ. The proof must state the precise moment and eigenvalue conditions under which this equivalence is unconditional; otherwise the invariance and exact simulation claims become conditional.

minor comments (2)

[§2] Notation for the core matrix should be introduced with a clear symbol (e.g., Σ_core) and distinguished from the separable factors at first use.
[Numerical experiments] The numerical section would benefit from reporting the exact simulation size used for critical values and the number of Monte Carlo replications.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the careful reading and constructive comments on our manuscript. We address each major comment below and indicate how we will revise the paper accordingly.

read point-by-point responses

Referee: [Abstract and §2] Abstract and §2 (definition of core): the central claim that separability of Σ is equivalent to sphericity of the core holds only if the core is constructed so that any separable Σ maps precisely to a multiple of the identity and any non-separable Σ maps to a non-spherical matrix, without implicit normalizations or additional eigenvalue-separation assumptions. The manuscript must exhibit the explicit mapping and verify that no hidden parameters remain.

Authors: We agree that the equivalence requires explicit verification. In the revised manuscript we will expand Section 2 to include the full construction of the core component and a direct proof that Σ is separable if and only if its core is a scalar multiple of the identity. The argument will rely solely on the given definitions and will confirm the absence of hidden normalizations or eigenvalue-separation assumptions. revision: yes
Referee: [§4] §4 (asymptotic spectral equivalence): the transfer of null-distribution properties to the proposed test statistics relies on proving that the sample covariance and its core are asymptotically spectrally equivalent when p/n → γ. The proof must state the precise moment and eigenvalue conditions under which this equivalence is unconditional; otherwise the invariance and exact simulation claims become conditional.

Authors: We accept the need for explicit conditions. We will revise the statement of the main theorem in Section 4 to list the precise assumptions—finite fourth moments of the entries and eigenvalues of Σ bounded away from zero and infinity—under which the asymptotic spectral equivalence holds unconditionally. This will make clear that the invariance and exact-simulation properties are valid under these stated conditions. revision: yes

Circularity Check

1 steps flagged

Equivalence of separability testing to core sphericity is by construction via complementary definition of the core

specific steps

self definitional [Abstract]
"we propose novel invariant tests using the core covariance matrix, a complementary notion to a separable covariance matrix. We show that testing separability of Σ is equivalent to testing sphericity of its core component."

The core is introduced as the complementary notion to separability; the claimed equivalence therefore holds exactly by how the core is defined (any separable Σ produces a spherical core and vice versa). The 'show that' step is thus a restatement of the definition rather than a derived result from matrix properties or external theorems.

full rationale

The paper introduces the core covariance matrix as a 'complementary notion to a separable covariance matrix' and then states that testing separability of Σ is equivalent to testing sphericity of the core. This equivalence is load-bearing for the subsequent construction of invariant test statistics and the claim of exact null distribution simulation. Because the core is explicitly positioned as complementary, the mapping (separable Σ maps to spherical core, non-separable maps to non-spherical) is built into the definition rather than independently derived from first principles or external properties. The asymptotic spectral equivalence result between sample covariance and core is presented as a separate technical contribution, but the foundational population-level equivalence reduces to the definitional choice. This produces partial circularity: the central insight is self-definitional while later asymptotic and simulation steps retain independent content.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 1 invented entities

The central claim rests on the definition of the core covariance matrix as a complementary notion to separability and on standard assumptions for covariance matrices in high-dimensional settings. No free parameters are mentioned. The core matrix itself functions as an invented entity whose independent evidence is not provided in the abstract.

axioms (1)

domain assumption Covariance matrices are symmetric positive semi-definite and the observations follow a distribution permitting the stated spectral equivalences.
Standard background assumption invoked for the asymptotic results in the p/n → γ regime.

invented entities (1)

core covariance matrix no independent evidence
purpose: Complementary notion that reduces separability testing to sphericity testing and enables invariant statistics.
Introduced in the paper as the key device for constructing the new tests.

pith-pipeline@v0.9.0 · 5742 in / 1379 out tokens · 38503 ms · 2026-05-19T07:53:23.535072+00:00 · methodology

0 comments

read the original abstract

Due to their parsimony, separable covariance models have been popular in modeling matrix-variate data. However, the inference from such a model may be misleading if the population covariance matrix $\Sigma$ is actually non-separable, motivating the use of statistical tests of separability. The existing separability tests suffer mainly from two issues: 1) test statistics that are not well-defined in high-dimensional settings, 2) low power for small sample sizes and null distributions that depend on unknown parameters, preventing exact error rate control. To address these issues, we propose novel invariant tests using the core covariance matrix, a complementary notion to a separable covariance matrix. We show that testing separability of $\Sigma$ is equivalent to testing sphericity of its core component. With this insight, we construct test statistics that are well-defined in high-dimensional settings and have distributions that are invariant under the null hypothesis of separability, allowing for exact simulation of null distributions. We establish the asymptotic properties of some test statistics by proving the asymptotic spectral equivalence between the sample covariance matrix and its core in a $p/n\rightarrow\gamma\in(0,\infty)$ regime. The large power of our proposed tests relative to existing procedures is demonstrated numerically.

Figures

Figures reproduced from arXiv: 2506.17463 by Bongjung Sung, Peter D. Hoff.

**Figure 1.** Figure 1: Empirical power of the separability tests under Np1×p2 (0, C1,w) as functions of n across each w = 0.2, 0.4, 0.6, 0.8, and ˆγ := ˆγ1γˆ2 = p1p2/n. The tests ϕ1, ϕ2, and ϕ3 are those proposed in this article. LRT and PTCLT denote the tests by [41, 34] and [3], respectively. LRT is not present when ˆγ > 1, since its test statistic is not well-defined in this case [PITH_FULL_IMAGE:figures/full_fig_p018_1.png] view at source ↗

**Figure 2.** Figure 2: Empirical power of the separability tests under Np1×p2 (0, C2,w) as functions of n across each w = 0.2, 0.4, 0.6, 0.8, and ˆγ := ˆγ1γˆ2 = p1p2/n. For the notations of ϕ1, ϕ2, ϕ3, LRT, and PTCLT, see [PITH_FULL_IMAGE:figures/full_fig_p018_2.png] view at source ↗

**Figure 3.** Figure 3: Empirical power of the separability tests under Np1×p2 (0, C1,w) as functions of w across (ˆγ1, γˆ2). Here n = 256 and (p1, p2) is determined according to the value of (ˆγ1, γˆ2). For the notations of ϕ1, ϕ2, ϕ3, LRT, and PTCLT, see [PITH_FULL_IMAGE:figures/full_fig_p019_3.png] view at source ↗

**Figure 4.** Figure 4: Empirical power of the separability tests under Np1×p2 (0, C1,w) as functions of w across (ˆγ1, γˆ2). Here n = 256 and (p1, p2) is determined according to the value of (ˆγ1, γˆ2). For the notations of ϕ1, ϕ2, ϕ3, LRT, and PTCLT, see [PITH_FULL_IMAGE:figures/full_fig_p019_4.png] view at source ↗

discussion (0)

Lean theorems connected to this paper

Citations machine-checked in the Pith Canon. Every link opens the source theorem in the public Lean library.

IndisputableMonolith/Cost/FunctionalEquation.lean washburn_uniqueness_aczel (J-cost uniqueness) unclear

?

unclear
Relation between the paper passage and the cited Recognition theorem.

We show that testing separability of Σ is equivalent to testing sphericity of its core component... Σ = K^{1/2} C K^{1/2,⊤} ... C = I_p
IndisputableMonolith/Foundation/RealityFromDistinction.lean reality_from_one_distinction unclear

?

unclear
Relation between the paper passage and the cited Recognition theorem.

Kronecker-core decomposition (KCD) ... core map c : S_p^+ → C_{p1,p2}^+

What do these tags mean?

matches: The paper's claim is directly supported by a theorem in the formal canon.
supports: The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
extends: The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
uses: The paper appears to rely on the theorem as machinery.
contradicts: The paper's claim conflicts with a theorem or certificate in the canon.
unclear: Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

Testing Covariance Separability in High Dimensions
stat.ME 2026-07 conditional novelty 5.0

Separability of high-dimensional matrix covariances can be tested by Monte Carlo sphericity after separable MLE whitening, with an angular version robust to heavy-tailed elliptical laws and consistency under dense alt...