A judge-trained 'I Know' classifier, fed the first 32 tokens of a model's answer, can skip retrieval for over half of queries on several QA datasets without lowering judge-scored answer quality.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Let your LLM generate a few tokens and you will reduce the need for retrieval
A judge-trained 'I Know' classifier, fed the first 32 tokens of a model's answer, can skip retrieval for over half of queries on several QA datasets without lowering judge-scored answer quality.