pith. sign in

arxiv: 1609.07358 · v1 · pith:BCYEI3LSnew · submitted 2016-09-23 · 🧮 math.OC

Restarting accelerated gradient methods with a rough strong convexity estimate

classification 🧮 math.OC
keywords restartingacceleratedgradientmethodsadaptiveconvergenceconvexityproblem
0
0 comments X
read the original abstract

We propose new restarting strategies for accelerated gradient and accelerated coordinate descent methods. Our main contribution is to show that the restarted method has a geometric rate of convergence for any restarting frequency, and so it allows us to take profit of restarting even when we do not know the strong convexity coefficient. The scheme can be combined with adaptive restarting, leading to the first provable convergence for adaptive restarting schemes with accelerated gradient methods. Finally, we illustrate the properties of the algorithm on a regularized logistic regression problem and on a Lasso problem.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Stochastic algorithms with geometric step decay converge linearly on sharp functions

    math.OC 2019-07 unverdicted novelty 7.0

    Geometric step decay yields local linear convergence for stochastic algorithms on sharp nonconvex problems and gives matching or new guarantees for phase retrieval and blind deconvolution under Gaussian and heavy-tail...