Proves the first fully non-asymptotic bound on the accuracy of multiplier bootstrap for constructing confidence sets from Polyak-Ruppert SGD iterates, achieving convex-distance rates up to 1/sqrt(n) under regularity conditions.
It remains to note that E[∥θk − θ⋆∥2p] ≤ 22p−1E[∥θ′ k − θ⋆∥2p] + 22p−1E[∥θk − θ′ k∥2p] ≤ C2p,1 exp − pµc0 4 (k + k0)1−γ (∥θ0 − θ⋆∥2p + σ2p 2p) + C2p,2σ2p 2pαp k
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
stat.ML 1years
2025 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Gaussian Approximation and Multiplier Bootstrap for Stochastic Gradient Descent
Proves the first fully non-asymptotic bound on the accuracy of multiplier bootstrap for constructing confidence sets from Polyak-Ruppert SGD iterates, achieving convex-distance rates up to 1/sqrt(n) under regularity conditions.