PGB prunes BERT in a single pass by permuting weight matrices into block-diagonal groups of important weights and removing all other weights, matching or beating iterative baselines on GLUE and SQuAD.
Gomez, Lukasz Kaiser, and Illia Polosukhin, Attention is All you Need, Advances in Neural Information Processing Systems
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
background 1
citation-polarity summary
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
PGB: One-Shot Pruning for BERT via Weight Grouping and Permutation
PGB prunes BERT in a single pass by permuting weight matrices into block-diagonal groups of important weights and removing all other weights, matching or beating iterative baselines on GLUE and SQuAD.