An Essay on Optimization Mystery of Deep Learning
classification
💻 cs.LG
stat.ML
keywords
learningdeepmysteryessayoptimizationconcerningconnectionsdespite
read the original abstract
Despite the huge empirical success of deep learning, theoretical understanding of neural networks learning process is still lacking. This is the reason, why some of its features seem "mysterious". We emphasize two mysteries of deep learning: generalization mystery, and optimization mystery. In this essay we review and draw connections between several selected works concerning the latter.
This paper has not been read by Pith yet.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.