REVIEW 4 cited by
A Unified Analysis of Extra-gradient and Optimistic Gradient Methods for Saddle Point Problems: Proximal Point Approach
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
In this paper we consider solving saddle point problems using two variants of Gradient Descent-Ascent algorithms, Extra-gradient (EG) and Optimistic Gradient Descent Ascent (OGDA) methods. We show that both of these algorithms admit a unified analysis as approximations of the classical proximal point method for solving saddle point problems. This viewpoint enables us to develop a new framework for analyzing EG and OGDA for bilinear and strongly convex-strongly concave settings. Moreover, we use the proximal point approximation interpretation to generalize the results for OGDA for a wide range of parameters.
Forward citations
Cited by 4 Pith papers
-
Layer-wise Quantization for Quantized Optimistic Dual Averaging
A new quantized optimistic dual averaging algorithm with layer-wise adaptive compression is presented, with theoretical convergence guarantees for monotone variational inequalities and empirical speedups on distribute...
-
On the convergence of single-call stochastic extra-gradient methods
Single-call stochastic extra-gradient methods achieve O(1/t) ergodic convergence in deterministic monotone variational inequalities and O(1/t) last-iterate local convergence around regular solutions in stochastic non-...
-
Convergence of Gradient Methods on Bilinear Zero-Sum Games
For bilinear zero-sum games, the paper derives necessary and sufficient convergence conditions and optimal linear rates for generalized GD, EG, OGD, and momentum methods, with Gauss-Seidel updates converging in a larg...
-
Gradient Methods for Solving Stackelberg Games
The paper adapts forward and reverse gradient techniques from hyperparameter optimization to solve continuous high-dimensional Stackelberg games, with complexity trade-offs and an adversarial regression application.
Discussion (0). Continue with ORCID to comment.