Pith. sign in

REVIEW

Conjugate-gradient-based Adam for stochastic optimization and its application to deep learning

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2003.00231 v2 pith:LDOCD6SJ submitted 2020-02-29 math.OC cs.LG

Conjugate-gradient-based Adam for stochastic optimization and its application to deep learning

classification math.OC cs.LG
keywords adamalgorithmclassificationconjugate-gradient-baseddeepoptimizationstochasticadaptive
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

This paper proposes a conjugate-gradient-based Adam algorithm blending Adam with nonlinear conjugate gradient methods and shows its convergence analysis. Numerical experiments on text classification and image classification show that the proposed algorithm can train deep neural network models in fewer epochs than the existing adaptive stochastic optimization algorithms can.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.