The Capability Frontier shows standard LLM benchmarks underestimate performance by 82% by ignoring model specialization across questions and the benefits of multiple generations per query.
arXiv preprint arXiv:2412.04692 , url=
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.AI 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
The Capability Frontier: Benchmarks Miss 82% of Model Performance
The Capability Frontier shows standard LLM benchmarks underestimate performance by 82% by ignoring model specialization across questions and the benefits of multiple generations per query.