In a small human-scored evaluation of 10 LLMs on 26 legal cases, o1-preview received the highest overall human score (3.96/5), while ROUGE and BLEU scores did not track human preference.
The judge, the ai, and the crown: a collusive network,
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2024 1verdicts
REJECT 1representative citing papers
citing papers explorer
-
Legal Evalutions and Challenges of Large Language Models
In a small human-scored evaluation of 10 LLMs on 26 legal cases, o1-preview received the highest overall human score (3.96/5), while ROUGE and BLEU scores did not track human preference.