An option-level item response model for LLMs shows that the identity of wrong multiple-choice answers carries substantial information about model ability, improving ranking and enabling 770x benchmark compression.
Measurement: Interdisciplinary Research and Perspectives , year =
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Every Wrong Answer Counts: Option-Level Psychometrics for LLM Multiple-Choice Benchmarks
An option-level item response model for LLMs shows that the identity of wrong multiple-choice answers carries substantial information about model ability, improving ranking and enabling 770x benchmark compression.