Across SQuAD and QuAC, RoBERTa and DistilBERT are generally more stable under Monte Carlo dropout, while ALBERT and BERT-Base are less consistent, and paraphrase perturbation changes the ranking.
BERT: Pre-training of deep bidirectional transformers for language un- derstanding
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Assessing Reliability of BERT-Based Models on Question Answering Tasks
Across SQuAD and QuAC, RoBERTa and DistilBERT are generally more stable under Monte Carlo dropout, while ALBERT and BERT-Base are less consistent, and paraphrase perturbation changes the ranking.