Reasoning Jury aggregates independent defect judgments from a jury of LLMs through consolidation or moderated deliberation, beating frontier single-model judges on Hard2Verify and DeltaBench at a fraction of the cost.
Claude opus 4.6 system card
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.AI 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Reasoning Jury: Multi-Model Consensus for Evaluating Reasoning Traces
Reasoning Jury aggregates independent defect judgments from a jury of LLMs through consolidation or moderated deliberation, beating frontier single-model judges on Hard2Verify and DeltaBench at a fraction of the cost.