Domain-trained small language model Olava Extract outperforms frontier LLMs on structured contract extraction with macro F1 0.812, micro F1 0.842, highest precision, and 78-97% lower inference cost.
Better call gpt, comparing large language models against lawyers
2 Pith papers cite this work, alongside 10 external citations. Polarity classification is still indexing.
2
Pith papers citing it
10
external citations · external index
fields
cs.CL 2verdicts
UNVERDICTED 2representative citing papers
An 8B Llama model with RAG and prompt engineering scores 60.08% on the All-India Bar Examination, slightly above GPT-3.5 Turbo while claiming 22 times greater parameter efficiency via a new PEI metric.
citing papers explorer
-
A Few Good Clauses: Comparing LLMs vs Domain-Trained Small Language Models on Structured Contract Extraction
Domain-trained small language model Olava Extract outperforms frontier LLMs on structured contract extraction with macro F1 0.812, micro F1 0.842, highest precision, and 78-97% lower inference cost.
-
Lightweight Domain Adaptation of a Large Language Model for Legal Assistance in the Indian Context
An 8B Llama model with RAG and prompt engineering scores 60.08% on the All-India Bar Examination, slightly above GPT-3.5 Turbo while claiming 22 times greater parameter efficiency via a new PEI metric.