An m-moment minimum error method is constructed for quadratic optimization in Hilbert space, with proved convergence, optimality among Krylov methods, and numerical tests on Helmholtz, heat, and thermoacoustics inverse problems.
Polyak Minorant Method for Convex Optimization
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
In 1963 Boris Polyak suggested a particular step size for gradient descent methods, now known as the Polyak step size, that he later adapted to subgradient methods. The Polyak step size requires knowledge of the optimal value of the minimization problem, which is a strong assumption but one that holds for several important problems. In this paper we extend Polyak's method to handle constraints and, as a generalization of subgradients, general minorants, which are convex functions that tightly lower bound the objective and constraint functions. We refer to this algorithm as the Polyak Minorant Method (PMM). It is closely related to cutting-plane and bundle methods.
citation-role summary
citation-polarity summary
fields
math.OC 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
On the construction of a gradient method of quadratic optimization, optimal from the point of view of minimizing the distance to the exact solution
An m-moment minimum error method is constructed for quadratic optimization in Hilbert space, with proved convergence, optimality among Krylov methods, and numerical tests on Helmholtz, heat, and thermoacoustics inverse problems.