Training LLMs on self-generated, diverse 'active reading' materials improves factual recall by 160-312% and scales to a 1T-token Wikipedia expert model.
Transfer learning in biomedical natural language processing: An evaluation of bert and elmo on ten benchmarking datasets.BioNLP 2019, page 58,
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Learning Facts at Scale with Active Reading
Training LLMs on self-generated, diverse 'active reading' materials improves factual recall by 160-312% and scales to a 1T-token Wikipedia expert model.