A systematic review identifies eight anti-patterns in LLM inference evaluation and proposes a checklist, with a speculative decoding case study demonstrating how conventional metrics mislead.
Parameter T uning (✓) In our judgment, the baselines don’t need parameter tuning
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
On Evaluating Performance of LLM Inference Serving Systems
A systematic review identifies eight anti-patterns in LLM inference evaluation and proposes a checklist, with a speculative decoding case study demonstrating how conventional metrics mislead.