At 4-bit inference quantization, CodeLlama-7b generates more accurate SQL and activates a planted backdoor far less often, while Llama-2-7b is hardly affected, across two training seeds.
Integer quantization for deep learning inference: Principles and empirical evaluation,
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.SE 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Capturing the Effects of Quantization on Trojans in Code LLMs
At 4-bit inference quantization, CodeLlama-7b generates more accurate SQL and activates a planted backdoor far less often, while Llama-2-7b is hardly affected, across two training seeds.