Training a tiny BERT first on Simple Wikipedia and then on everyday Wikipedia improves perplexity, while difficulty heuristics such as sentence length, word rarity, and Flesch score give no consistent gain over random order.
Title resolution pending
1 Pith paper cite this work, alongside 85 external citations. Polarity classification is still indexing.
1
Pith paper citing it
85
external citations · OpenAlex
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Beyond Shallow Heuristics: Leveraging Human Intuition for Curriculum Learning
Training a tiny BERT first on Simple Wikipedia and then on everyday Wikipedia improves perplexity, while difficulty heuristics such as sentence length, word rarity, and Flesch score give no consistent gain over random order.