Gradient descent with step size alpha in (0, 2/L) globally converges for functions with sector-bounded gradients, proved through a discrete-time passivity argument, with a boundary case treated via the weak passivity theorem.
Some Methods of Speeding Up the Convergence of Iteration Methods,
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
math.OC 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Input-Output Stability of Gradient Descent: A Discrete-Time Passivity-Based Approach
Gradient descent with step size alpha in (0, 2/L) globally converges for functions with sector-bounded gradients, proved through a discrete-time passivity argument, with a boundary case treated via the weak passivity theorem.