Fine-tuning BERT-base-uncased on a hand-cleaned Lang-8 subset yields F1 0.91 on that same distribution, but the result is not benchmarked against standard GED tests.
Advancements in Arabic Grammatical Error Detection and Correction: An Empirical Investigation
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Grammatical error correction (GEC) is a well-explored problem in English with many existing models and datasets. However, research on GEC in morphologically rich languages has been limited due to challenges such as data scarcity and language complexity. In this paper, we present the first results on Arabic GEC using two newly developed Transformer-based pretrained sequence-to-sequence models. We also define the task of multi-class Arabic grammatical error detection (GED) and present the first results on multi-class Arabic GED. We show that using GED information as an auxiliary input in GEC models improves GEC performance across three datasets spanning different genres. Moreover, we also investigate the use of contextual morphological preprocessing in aiding GEC systems. Our models achieve SOTA results on two Arabic GEC shared task datasets and establish a strong benchmark on a recently created dataset. We make our code, data, and pretrained models publicly available.
fields
cs.CL 1years
2024 1verdicts
REJECT 1representative citing papers
citing papers explorer
-
Enhancing Grammatical Error Detection using BERT with Cleaned Lang-8 Dataset
Fine-tuning BERT-base-uncased on a hand-cleaned Lang-8 subset yields F1 0.91 on that same distribution, but the result is not benchmarked against standard GED tests.