Masked-token prediction errors in BERT reveal clusters of interchangeable, semantically related tokens, and the average per-token accuracy increases through the transformer layers and correlates with fine-tuning accuracy.
Lu, Full-text federated search in peer-to-peer networks, 2007
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
background 1
citation-polarity summary
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
Learning Mechanism Underlying NLP Pre-Training and Fine-Tuning
Masked-token prediction errors in BERT reveal clusters of interchangeable, semantically related tokens, and the average per-token accuracy increases through the transformer layers and correlates with fine-tuning accuracy.