Compiling rubrics into typed evaluation graphs before seeing responses improves LLM judge agreement on four pointwise and two pairwise benchmarks over Prometheus-style and checklist baselines.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.AI 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Graph-Structured Rubrics: Compiling Rubrics into Typed Evaluation Graphs for LLM Judges
Compiling rubrics into typed evaluation graphs before seeing responses improves LLM judge agreement on four pointwise and two pairwise benchmarks over Prometheus-style and checklist baselines.