REVIEW 1 cited by
Generalized Dropout
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Deep Neural Networks often require good regularizers to generalize well. Dropout is one such regularizer that is widely used among Deep Learning practitioners. Recent work has shown that Dropout can also be viewed as performing Approximate Bayesian Inference over the network parameters. In this work, we generalize this notion and introduce a rich family of regularizers which we call Generalized Dropout. One set of methods in this family, called Dropout++, is a version of Dropout with trainable parameters. Classical Dropout emerges as a special case of this method. Another member of this family selects the width of neural network layers. Experiments show that these methods help in improving generalization performance over Dropout.
Forward citations
Cited by 1 Pith paper
-
Feature Preserving Shrinkage on Bayesian Neural Networks via the R2D2 Prior
Applying the R2D2 shrinkage prior to Bayesian neural network weights, with a variational Gibbs inference scheme, improves prediction and out-of-distribution detection in image tasks.
Discussion (0). Continue with ORCID to comment.