LoRDBA replaces LoRA low-rank factors with binary sign carriers and channel-wise scales, matching fp16 LoRA quality in some regimes with over 10x smaller adapter size and at most 8% prefill latency overhead.
More than bits: Multi-envelope double binary factorization for extreme quantization
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Signs Beat Floats: Low-Rank Double-Binary Adaptation for On-Device Fine-Tuning
LoRDBA replaces LoRA low-rank factors with binary sign carriers and channel-wise scales, matching fp16 LoRA quality in some regimes with over 10x smaller adapter size and at most 8% prefill latency overhead.