REVIEW 3 cited by
Training GANs with Centripetal Acceleration
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Training generative adversarial networks (GANs) often suffers from cyclic behaviors of iterates. Based on a simple intuition that the direction of centripetal acceleration of an object moving in uniform circular motion is toward the center of the circle, we present the Simultaneous Centripetal Acceleration (SCA) method and the Alternating Centripetal Acceleration (ACA) method to alleviate the cyclic behaviors. Under suitable conditions, gradient descent methods with either SCA or ACA are shown to be linearly convergent for bilinear games. Numerical experiments are conducted by applying ACA to existing gradient-based algorithms in a GAN setup scenario, which demonstrate the superiority of ACA.
Forward citations
Cited by 3 Pith papers
-
Layer-wise Quantization for Quantized Optimistic Dual Averaging
A new quantized optimistic dual averaging algorithm with layer-wise adaptive compression is presented, with theoretical convergence guarantees for monotone variational inequalities and empirical speedups on distribute...
-
On the convergence of single-call stochastic extra-gradient methods
Single-call stochastic extra-gradient methods achieve O(1/t) ergodic convergence in deterministic monotone variational inequalities and O(1/t) last-iterate local convergence around regular solutions in stochastic non-...
-
Convergence of Gradient Methods on Bilinear Zero-Sum Games
For bilinear zero-sum games, the paper derives necessary and sufficient convergence conditions and optimal linear rates for generalized GD, EG, OGD, and momentum methods, with Gauss-Seidel updates converging in a larg...
Discussion (0). Continue with ORCID to comment.