CO-LMLM externalizes factual knowledge into a vector-indexed text database during pretraining, retrieving via hidden-state queries, achieving higher factuality and lower perplexity than prior LMLMs and standard LMs at 135M–360M scale.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Co-LMLM: Continuous-Query Limited Memory Language Models
CO-LMLM externalizes factual knowledge into a vector-indexed text database during pretraining, retrieving via hidden-state queries, achieving higher factuality and lower perplexity than prior LMLMs and standard LMs at 135M–360M scale.