A model's accuracy on questions it generates about its own explanations correlates with MMLU-Pro only at r = 0.361, and the paper claims this can serve as a test-set-free ranking proxy.
On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, pp.\ 610--623, 2021
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Explain-Query-Test: Self-Evaluating LLMs Via Explanation and Comprehension Discrepancy
A model's accuracy on questions it generates about its own explanations correlates with MMLU-Pro only at r = 0.361, and the paper claims this can serve as a test-set-free ranking proxy.