Across EQE pre-exam legal questions, OpenAI o1 reached the highest accuracy (0.82), but no tested LLM reached the 0.90 threshold the authors set for passing, and human patent experts found systematic flaws in the models' legal justifications.
Claude-3 Model Card
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CY 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Can Large Language Models Understand As Well As Apply Patent Regulations to Pass a Hands-On Patent Attorney Test?
Across EQE pre-exam legal questions, OpenAI o1 reached the highest accuracy (0.82), but no tested LLM reached the 0.90 threshold the authors set for passing, and human patent experts found systematic flaws in the models' legal justifications.