Out-of-the-box LLMs can match or beat top human candidates on Italian bar and judge essay exams but all fail the notary exam, which requires constrained legal drafting and planning.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CY 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
What out-of-the-box LLMs can(t) do in law? A Turing test in Italian exams for lawyers, judges and notaries
Out-of-the-box LLMs can match or beat top human candidates on Italian bar and judge essay exams but all fail the notary exam, which requires constrained legal drafting and planning.