Gradual Binary Search over per-projection clipping ratios, combined with Hadamard rotations and dimension expansion, enables 3-bit WAKV quantization with better benchmark accuracy than QuaRot.
QuIP: 2-Bit Quantization of Large Language Models With Guarantees
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Gradual Binary Search and Dimension Expansion : A general method for activation quantization in LLMs
Gradual Binary Search over per-projection clipping ratios, combined with Hadamard rotations and dimension expansion, enables 3-bit WAKV quantization with better benchmark accuracy than QuaRot.