A systematic empirical study with a new tool, LRBench, evaluates 13 learning rate policies and finds that tuned cyclic schedules can beat framework defaults in accuracy and cost.
On the importance of initialization and momentum in deep learning,
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2019 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Demystifying Learning Rate Policies for High Accuracy Training of Deep Neural Networks
A systematic empirical study with a new tool, LRBench, evaluates 13 learning rate policies and finds that tuned cyclic schedules can beat framework defaults in accuracy and cost.