CodeRQ-Bench and VERA enable evaluation of LLM reasoning quality in coding tasks beyond output correctness, with VERA improving AUCROC by up to 0.26 over baselines.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.SE 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Beyond Output Correctness: Benchmarking and Evaluating Large Language Model Reasoning in Coding Tasks
CodeRQ-Bench and VERA enable evaluation of LLM reasoning quality in coding tasks beyond output correctness, with VERA improving AUCROC by up to 0.26 over baselines.