Mish, a smooth non-monotonic activation function, is proposed and shown to often match or beat ReLU, Swish, and Leaky ReLU on CIFAR-10, ImageNet, and MS-COCO benchmarks.
Large-scale machine learning with stochastic gradient descent
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2019 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Mish: A Self Regularized Non-Monotonic Activation Function
Mish, a smooth non-monotonic activation function, is proposed and shown to often match or beat ReLU, Swish, and Leaky ReLU on CIFAR-10, ImageNet, and MS-COCO benchmarks.