Data-Dependent Path Normalization in Neural Networks
classification
💻 cs.LG
keywords
frameworkneuralnormalizationoptimizationacrossbatch-normalizationconnectiondata
read the original abstract
We propose a unified framework for neural net normalization, regularization and optimization, which includes Path-SGD and Batch-Normalization and interpolates between them across two different dimensions. Through this framework we investigate issue of invariance of the optimization, data dependence and the connection with natural gradients.
This paper has not been read by Pith yet.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.