EWC during Lithuanian continual pretraining of Gemma2 reduces catastrophic forgetting of English and improves Lithuanian fluency and accuracy on 5 of 7 knowledge benchmarks.
Bring Your Own Knowledge: A Survey of Methods for LLM Knowledge Expansion, 2025
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Full-Parameter Continual Pretraining of Gemma2: Insights into Fluency and Domain Knowledge
EWC during Lithuanian continual pretraining of Gemma2 reduces catastrophic forgetting of English and improves Lithuanian fluency and accuracy on 5 of 7 knowledge benchmarks.