REVIEW 5 cited by
Moving Anchor Extragradient Methods For Smooth Structured Minimax Problems
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
This work introduces a moving anchor acceleration technique to extragradient algorithms for smooth structured minimax problems. The moving anchor is introduced as a generalization of the original algorithmic anchoring framework, i.e. the EAG method introduced in [32], in hope of further acceleration. We show that the optimal order of convergence in terms of worst-case complexity on the squared gradient, O(1/k2), is achieved by our new method (where k is the number of iterations). We have also extended our algorithm to a more general nonconvex-nonconcave class of saddle point problems using the framework of [14], which slightly generalizes [32]. We obtain similar order-optimal complexity results in this extended case. In both problem settings, numerical results illustrate the efficacy of our moving anchor algorithm variants, in particular by attaining the theoretical optimal convergence rate for first order methods, as well as suggesting a better optimized constant in the big O notation which surpasses the traditional fixed anchor methods in many cases. A proximal-point preconditioned version of our algorithms is also introduced and analyzed to match optimal theoretical convergence rates.
Forward citations
Cited by 5 Pith papers
-
Direct Acceleration of Stochastic Root-Finding Without Variance Reduction and Regularization
A dual-anchor stochastic root-finding algorithm achieves O(epsilon^{-3}) oracle complexity with constant mini-batching and no variance reduction for cocoercive operators.
-
Convergence Analysis of the Restarted Moving-Anchored Extra-Gradient Method in the Absence of Local Lipschitz Continuity
The MAEG-R method achieves convergence for monotone inclusions with merely continuous operators via a moving-anchor restart strategy, while preserving O(1/k) complexity in the Lipschitz case.
-
Variance-Reduced Fast Operator Splitting Methods for Generalized Equations
A new class of accelerated forward-backward and backward-forward splitting methods with variance-reduced estimators achieves O(1/k^2) and o(1/k^2) expected residual convergence for generalized equations under co-coerc...
-
Accelerated Extragradient-Type Methods -- Part 2: Generalization and Sublinear Convergence Rates under Co-Hypomonotonicity
A unified family of anchored and Nesterov-accelerated extragradient methods achieves O(1/k) and o(1/k) last-iterate residual convergence for co-hypomonotone inclusions, with iterate convergence for the new GAEG+ class.
-
Stochastic Moving Anchor Algorithms and a Popov's Scheme with Moving Anchor
Stochastic moving-anchor EAG-V is claimed to keep an O(1/k^2) squared-gradient-norm rate under a strong variance-decay condition; two moving-anchor Popov variants are introduced without a convergence proof.
Discussion (0). Continue with ORCID to comment.