A new Sinhala text simplification dataset with 3,000 human-written simplifications is released, and intermediate-task transfer learning on mT5/mBART beats prior zero-resource baselines.
Leveraging Auxiliary Domain Parallel Data in Intermediate Task Fine-tuning for Low-resource Translation
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
NMT systems trained on Pre-trained Multilingual Sequence-Sequence (PMSS) models flounder when sufficient amounts of parallel data is not available for fine-tuning. This specifically holds for languages missing/under-represented in these models. The problem gets aggravated when the data comes from different domains. In this paper, we show that intermediate-task fine-tuning (ITFT) of PMSS models is extremely beneficial for domain-specific NMT, especially when target domain data is limited/unavailable and the considered languages are missing or under-represented in the PMSS model. We quantify the domain-specific results variations using a domain-divergence test, and show that ITFT can mitigate the impact of domain divergence to some extent.
citation-role summary
background 1
citation-polarity summary
fields
cs.CL 1years
2024 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
SiTSE: Sinhala Text Simplification Dataset and Evaluation
A new Sinhala text simplification dataset with 3,000 human-written simplifications is released, and intermediate-task transfer learning on mT5/mBART beats prior zero-resource baselines.