BenGER is a new benchmark dataset and evaluation of 12 LLMs on German legal reasoning tasks with human validation of LLM judges.
Middle (≈8–11): individual definitions / norms are imprecise; scholarly debates are schematic or patchy, but not wrong in a case-decisive way
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law
BenGER is a new benchmark dataset and evaluation of 12 LLMs on German legal reasoning tasks with human validation of LLM judges.