Training a tiny BERT first on Simple Wikipedia and then on everyday Wikipedia improves perplexity, while difficulty heuristics such as sentence length, word rarity, and Flesch score give no consistent gain over random order.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Beyond Shallow Heuristics: Leveraging Human Intuition for Curriculum Learning
Training a tiny BERT first on Simple Wikipedia and then on everyday Wikipedia improves perplexity, while difficulty heuristics such as sentence length, word rarity, and Flesch score give no consistent gain over random order.