Adding word-order and sentence-order reconstruction tasks to BERT pre-training improves performance on GLUE, SNLI, and SQuAD v1.1 benchmarks.
A bottom-up approach to sentence ordering for multi-document summarization
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2019 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding
Adding word-order and sentence-order reconstruction tasks to BERT pre-training improves performance on GLUE, SNLI, and SQuAD v1.1 benchmarks.