Lottery Tickets in Linear Models: An Analysis of Iterative Magnitude Pruning
classification
💻 cs.LG
stat.ML
keywords
pruningfeaturesiterativelinearlotterymagnitudemodelsanalyse
read the original abstract
We analyse the pruning procedure behind the lottery ticket hypothesis arXiv:1803.03635v5, iterative magnitude pruning (IMP), when applied to linear models trained by gradient flow. We begin by presenting sufficient conditions on the statistical structure of the features under which IMP prunes those features that have smallest projection onto the data. Following this, we explore IMP as a method for sparse estimation.
This paper has not been read by Pith yet.
Forward citations
Cited by 1 Pith paper
-
Man, Machine, and Mathematics
A high-level outline is given for a unified theory that reduces learning to a small set of ideas from dynamical systems, geometry, and physics via definitions of solvable problems and parametrized methods.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.