An iterative block-coordinate-descent version of the Combinatorial Brain Surgeon outperforms one-shot Wanda pruning on DeiT and Mistral-7b, but without code release or error bars.
Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Scalable iterative pruning of large language and vision models using block coordinate descent
An iterative block-coordinate-descent version of the Combinatorial Brain Surgeon outperforms one-shot Wanda pruning on DeiT and Mistral-7b, but without code release or error bars.