Dropout as a Bayesian Approximation: Appendix
read the original abstract
We show that a neural network with arbitrary depth and non-linearities, with dropout applied before every weight layer, is mathematically equivalent to an approximation to a well known Bayesian model. This interpretation might offer an explanation to some of dropout's key properties, such as its robustness to over-fitting. Our interpretation allows us to reason about uncertainty in deep learning, and allows the introduction of the Bayesian machinery into existing deep learning frameworks in a principled way. This document is an appendix for the main paper "Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning" by Gal and Ghahramani, 2015.
This paper has not been read by Pith yet.
Forward citations
Cited by 2 Pith papers
-
PolyGraphPy: A unified Python framework for atomistic simulation and machine learning-driven polymer design
PolyGraphPy automates DFTB calculations for datasets of monomers and copolymers, uses Bayesian GNNs for property prediction with uncertainty quantification, and applies SELFIES-GPT and BRICS-based GA for de novo polym...
-
Bayesian Neural Networks: An Introduction and Survey
A survey introducing Bayesian Neural Networks and comparing approximate inference methods to enable uncertainty quantification in neural network predictions.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.