Frontier AI benchmarks lose discriminatory power as models saturate easy items, concentrating valid signal in scarce expert-authored hard-tail items whose replacement cost rises convexly with capability.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CY 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
The Benchmark Ceiling: Human Judgment, Evaluation Scarcity, and the Political Economy of AI Capability Measurement
Frontier AI benchmarks lose discriminatory power as models saturate easy items, concentrating valid signal in scarce expert-authored hard-tail items whose replacement cost rises convexly with capability.