Cellwise and Casewise Robust Covariance in High Dimensions
read the original abstract
The sample covariance matrix is a cornerstone of multivariate statistics, but it is highly sensitive to outliers. These can be casewise outliers, such as cases belonging to a different population, or cellwise outliers, which are deviating cells (entries) of the data matrix. Recently some robust covariance estimators have been developed that can handle both types of outliers, but their computation is only feasible up to at most 20 dimensions. To remedy this we propose the cellRCov method, a robust covariance estimator that simultaneously handles casewise outliers, cellwise outliers, and missing data. It relies on a decomposition of the covariance on principal and orthogonal subspaces, leveraging recent work on robust PCA. It also employs a ridge-type regularization to stabilize the estimated covariance matrix. We establish some theoretical properties of cellRCov, including its casewise and cellwise influence functions as well as consistency and asymptotic normality. A simulation study demonstrates the superior performance of cellRCov in contaminated and missing data scenarios. Furthermore, its practical utility is illustrated in a real-world application to anomaly detection. We also construct and illustrate the cellRCCA method for robust and regularized canonical correlation analysis.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
Cellwise and Casewise Robust Multivariate Regression with Inference
cellMR provides robust multivariate regression for casewise and cellwise outliers, missing data, and high dimensions, with cellBoot delivering asymptotically valid robust inference via indirect bootstrap.
-
Explainable Outlier Detection for Multivariate Functional Data
A framework connects separable-covariance functional data to matrix-variate MMCD estimation and linear-complexity Shapley decompositions to deliver robust and explainable outlier detection.
-
Cellwise Outliers
Cellwise outliers can contaminate over half the cases even at low proportions, necessitating specialized robust techniques for location, covariance, regression, PCA, and tensor data that differ from casewise approaches.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.