Pith. sign in

REVIEW 4 cited by

A Unified Analysis of Extra-gradient and Optimistic Gradient Methods for Saddle Point Problems: Proximal Point Approach

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1901.08511 v4 pith:KTN5TGHG submitted 2019-01-24 math.OC cs.LGstat.ML

classification math.OCcs.LGstat.ML
keywords pointgradientogdaproblemsproximalsaddlealgorithmsanalysis
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

In this paper we consider solving saddle point problems using two variants of Gradient Descent-Ascent algorithms, Extra-gradient (EG) and Optimistic Gradient Descent Ascent (OGDA) methods. We show that both of these algorithms admit a unified analysis as approximations of the classical proximal point method for solving saddle point problems. This viewpoint enables us to develop a new framework for analyzing EG and OGDA for bilinear and strongly convex-strongly concave settings. Moreover, we use the proximal point approximation interpretation to generalize the results for OGDA for a wide range of parameters.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Layer-wise Quantization for Quantized Optimistic Dual Averaging

    cs.LG 2025-05 reject novelty 7.0 of 10

    A new quantized optimistic dual averaging algorithm with layer-wise adaptive compression is presented, with theoretical convergence guarantees for monotone variational inequalities and empirical speedups on distribute...

  2. On the convergence of single-call stochastic extra-gradient methods

    math.OC 2019-08 accept novelty 7.0 of 10

    Single-call stochastic extra-gradient methods achieve O(1/t) ergodic convergence in deterministic monotone variational inequalities and O(1/t) last-iterate local convergence around regular solutions in stochastic non-...

  3. Convergence of Gradient Methods on Bilinear Zero-Sum Games

    cs.LG 2019-08 conditional novelty 7.0 of 10

    For bilinear zero-sum games, the paper derives necessary and sufficient convergence conditions and optimal linear rates for generalized GD, EG, OGD, and momentum methods, with Gauss-Seidel updates converging in a larg...

  4. Gradient Methods for Solving Stackelberg Games

    cs.GT 2019-08 conditional novelty 5.0 of 10

    The paper adapts forward and reverse gradient techniques from hyperparameter optimization to solve continuous high-dimensional Stackelberg games, with complexity trade-offs and an adversarial regression application.

Pith tools