Projected Compression trains projections over frozen base model weights to produce a smaller standard transformer, outperforming hard pruning with retraining on high-token models.
A survey of sustainability in large language models: Applications, economics, and challenges
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
background 1
citation-polarity summary
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
Projected Compression: Trainable Projection for Efficient Transformer Compression
Projected Compression trains projections over frozen base model weights to produce a smaller standard transformer, outperforming hard pruning with retraining on high-token models.