SGD with greedy step size on smooth quadratics in the interpolation regime attains O(1/t^{3/4}) last-iterate convergence.
How catastrophic can catastrophic forgetting be in linear regression? In Conference on Learning Theory, pages 4028--4079
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Last-Iterate Convergence of Randomized Kaczmarz and SGD with Greedy Step Size
SGD with greedy step size on smooth quadratics in the interpolation regime attains O(1/t^{3/4}) last-iterate convergence.