Improved batch-means rates for SGD covariance estimation plus a minimax-optimal trajectory-regression estimator achieving Θ(n^{-(1-α)/2}) for Hessian-free inference.
arXiv preprint arXiv:2212.01259 , year=
3 Pith papers cite this work. Polarity classification is still indexing.
verdicts
UNVERDICTED 3representative citing papers
Develops a batch-free online covariance estimator for sketched Newton methods, proves its consistency, and demonstrates use for online statistical inference on regression and CUTEst problems.
A novel bias-reduced online covariance estimator for SGD achieves convergence rate n to the power (α-1)/2 times square root of log n without second-order derivatives.
citing papers explorer
-
Online Covariance Estimation in Averaged SGD: Improved Batch-Mean Rates and Minimax Optimality via Trajectory Regression
Improved batch-means rates for SGD covariance estimation plus a minimax-optimal trajectory-regression estimator achieving Θ(n^{-(1-α)/2}) for Hessian-free inference.
-
Online Covariance Matrix Estimation in Sketched Newton Methods
Develops a batch-free online covariance estimator for sketched Newton methods, proves its consistency, and demonstrates use for online statistical inference on regression and CUTEst problems.
-
Refining Covariance Matrix Estimation in Stochastic Gradient Descent Through Bias Reduction
A novel bias-reduced online covariance estimator for SGD achieves convergence rate n to the power (α-1)/2 times square root of log n without second-order derivatives.