REVIEW 2 cited by
SMU: smooth activation function for deep networks using smoothing maximum technique
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Deep learning researchers have a keen interest in proposing two new novel activation functions which can boost network performance. A good choice of activation function can have significant consequences in improving network performance. A handcrafted activation is the most common choice in neural network models. ReLU is the most common choice in the deep learning community due to its simplicity though ReLU has some serious drawbacks. In this paper, we have proposed a new novel activation function based on approximation of known activation functions like Leaky ReLU, and we call this function Smooth Maximum Unit (SMU). Replacing ReLU by SMU, we have got 6.22% improvement in the CIFAR100 dataset with the ShuffleNet V2 model.
Forward citations
Cited by 2 Pith papers
-
The GAN is dead; long live the GAN! A Modern GAN Baseline
A minimalist GAN with a regularized relativistic loss and modern backbone matches or beats StyleGAN2 and several diffusion models on standard FID benchmarks.
-
emg2pose: A Large and Diverse Benchmark for Surface Electromyographic Hand Pose Estimation
emg2pose introduces the largest public sEMG hand pose dataset, 193 users with motion-capture labels, plus baselines and held-out user/stage generalization tasks.
Discussion (0). Continue with ORCID to comment.