oab-bench provides 105 graded Brazilian Bar Exam writing questions and an LLM-judge pipeline; Claude 3.5 Sonnet scores highest under the o1 judge, but judge-human agreement is validated on only three approved exams.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Automatic Legal Writing Evaluation of LLMs
oab-bench provides 105 graded Brazilian Bar Exam writing questions and an LLM-judge pipeline; Claude 3.5 Sonnet scores highest under the o1 judge, but judge-human agreement is validated on only three approved exams.