Gradient descent with step size alpha in (0, 2/L) globally converges for functions with sector-bounded gradients, proved through a discrete-time passivity argument, with a boundary case treated via the weak passivity theorem.
Nesterov, Introductory Lectures on Convex Optimization: A Basic Course
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
math.OC 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Input-Output Stability of Gradient Descent: A Discrete-Time Passivity-Based Approach
Gradient descent with step size alpha in (0, 2/L) globally converges for functions with sector-bounded gradients, proved through a discrete-time passivity argument, with a boundary case treated via the weak passivity theorem.