No single LLM quantization method dominates performance, energy, and quality; the best choice depends on task, request length, load, parallelism, and GPU type.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.PF 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Systematic Characterization of LLM Quantization: A Performance, Energy, and Quality Perspective
No single LLM quantization method dominates performance, energy, and quality; the best choice depends on task, request length, load, parallelism, and GPU type.