xTower: A Multilingual LLM for Explaining and Correcting Translation Errors
read the original abstract
While machine translation (MT) systems are achieving increasingly strong performance on benchmarks, they often produce translations with errors and anomalies. Understanding these errors can potentially help improve the translation quality and user experience. This paper introduces xTower, an open large language model (LLM) built on top of TowerBase designed to provide free-text explanations for translation errors in order to guide the generation of a corrected translation. The quality of the generated explanations by xTower are assessed via both intrinsic and extrinsic evaluation. We ask expert translators to evaluate the quality of the explanations across two dimensions: relatedness towards the error span being explained and helpfulness in error understanding and improving translation quality. Extrinsically, we test xTower across various experimental setups in generating translation corrections, demonstrating significant improvements in translation quality. Our findings highlight xTower's potential towards not only producing plausible and helpful explanations of automatic translations, but also leveraging them to suggest corrected translations.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
LQM: Linguistically Motivated Multidimensional Quality Metrics for Machine Translation
LQM introduces a six-level linguistically motivated error taxonomy for MT evaluation and applies it via expert annotation to LLM outputs on a new 3,850-sentence multi-dialect Arabic corpus.
-
Smarter edits? Post-editing with error highlights and translation suggestions
User study with professional En-Nl translators found LLM-based error highlights and APE correction suggestions did not improve productivity or quality over standard post-editing but were better received and enhanced u...
-
Smarter edits? Post-editing with error highlights and translation suggestions
User study finds no productivity or quality gains from APE-derived error highlights and suggestions over regular post-editing, but better user reception and experience.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.