BenGER is a new benchmark dataset and evaluation of 12 LLMs on German legal reasoning tasks with human validation of LLM judges.
100 Odysseas S Chlapanis and others, 'GreekBarBench: A Challenging Benchmark for Free-Text Legal Reasoning and Citations' (2025) arXiv:2505.17267
3 Pith papers cite this work. Polarity classification is still indexing.
3
Pith papers citing it
years
2026 3representative citing papers
Magis-Bench is a new benchmark of 74 magistrate-level legal writing tasks from Brazilian exams where the strongest LLMs reach only 6.97/10, showing judicial reasoning remains difficult for current models.
No benchmark exists for doctrinal legal reasoning in LLMs, leaving the EU AI Act's accuracy mandate for judicial AI without an operational test.
citing papers explorer
-
BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law
BenGER is a new benchmark dataset and evaluation of 12 LLMs on German legal reasoning tasks with human validation of LLM judges.
-
Magis-Bench: Evaluating LLMs on Magistrate-Level Legal Tasks
Magis-Bench is a new benchmark of 74 magistrate-level legal writing tasks from Brazilian exams where the strongest LLMs reach only 6.97/10, showing judicial reasoning remains difficult for current models.
-
The Measurement Gap in the Automation of EU Law: Benchmarking Doctrinal Legal Reasoning under the EU AI Act
No benchmark exists for doctrinal legal reasoning in LLMs, leaving the EU AI Act's accuracy mandate for judicial AI without an operational test.