pith. sign in

arxiv: 1506.08187 · v1 · pith:2233FGMPnew · submitted 2015-06-26 · 🧮 math.OC · cs.DS· cs.LG· cs.NA

A geometric alternative to Nesterov's accelerated gradient descent

S\'ebastien Bubeck , Yin Tat Lee , Mohit Singh This is my paper
classification 🧮 math.OC cs.DScs.LGcs.NA
keywords accelerateddescentgradientmethodnesterovgeometricalgorithmalternative
0
0 comments X
read the original abstract

We propose a new method for unconstrained optimization of a smooth and strongly convex function, which attains the optimal rate of convergence of Nesterov's accelerated gradient descent. The new algorithm has a simple geometric interpretation, loosely inspired by the ellipsoid method. We provide some numerical evidence that the new method can be superior to Nesterov's accelerated gradient descent.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Perfect Parallelization in Mini-Batch SGD with Classical Momentum Acceleration

    cs.LG 2026-05 unverdicted novelty 6.0

    Classical momentum acceleration in mini-batch SGD for quadratics is proportional to batch size up to saturation, enabling perfect parallelization under minimal noise assumptions.

  2. Adaptive Federated Optimization

    cs.LG 2020-02 unverdicted novelty 6.0

    Proposes federated adaptive optimizers (FedAdagrad, FedAdam, FedYogi) with convergence analysis for non-convex objectives under data heterogeneity and reports empirical gains over FedAvg.