REVIEW 3 major objections 5 minor 117 references
Beyond the Sentence: A Survey on Context-Aware Machine Translation with Large Language Models
T0 review · 3 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read A structured survey maps context-aware machine translation with LLMs into prompting, fine-tuning, and post-editing/agent approaches, and finds prompting is a solid baseline.
desk verdict A useful map of a young subfield, but the headline comparison of commercial vs open-source LLMs is mislabeled and unsupported. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The organising device is a three-branch taxonomy—prompt-based, fine-tuning-based, and other applications—rendered in three tables that list each surveyed work's LLM and language pair. The taxonomy carries the argument because it turns papers with different models, languages, and evaluation styles into comparable strategy families, and the survey's qualitative conclusions (prompts as baselines, commercial models ahead in prompting, fine-tuning closing the gap) are drawn from reading across those rows. The supporting concepts are the context window, meaning the number of previous sentences available to the model, and the distinction between automatic sentence-level metrics and context-aware evaluation.
What would settle it
Run the same set of document-level prompts on a commercial model like ChatGPT and an open-source model like Llama, with the same test documents and the same automatic and human error metrics, then repeat with fine-tuned versions of the open model; if open models match or beat commercial models in the prompting setting, or if fine-tuning fails to narrow the gap, the survey's central observations would need revision.
Extended reading notes
Core claim
The paper's central claim is that context-aware translation with LLMs is a distinct, early-stage research area whose scattered results can be organised into three strategy families. In prompting, zero-shot and few-shot in-context learning let an LLM translate documents with surrounding context, and the surveyed papers show that how much context is given and how examples are selected changes quality. In fine-tuning, adapting open LLMs on document-level corpora, often with parameter-efficient methods and instruction-style data, produces the strongest and most consistent gains, and in the reported comparisons it lets open models like Llama and Bloom nearly match closed models like ChatGPT and Tower. A third set of works applies LLMs to automatic post-editing of existing MT output and to agent-based translation frameworks with memory or multi-stage refinement. The survey also claims that standard sentence-level metrics are poorly suited to measuring context quality, and it flags low-resource language translation, translation agents, and context-aware evaluation as the priorities for future work.
Load-bearing premise
The survey's headline comparison—commercial chat models beat open-source models when translating with prompts—is built from papers that use different datasets, metrics, prompts, and model versions, and the survey does not run a controlled head-to-head test to verify it.
Editorial extensions
If this is right
- A newcomer can establish a strong document-translation baseline with prompting alone, before spending compute on fine-tuning.
- Fine-tuning open-source LLMs is a viable route to document-level translation quality near commercial systems, which lowers the cost of private or domain-specific deployment.
- The scarcity of document-level parallel corpora matters less than it once did, because prompting with context and fine-tuning on smaller instruction-style corpora can compensate.
- Translation agents and automatic post-editing deserve attention as under-explored mechanisms for consistency and fluency across long documents.
- Evaluation of context-aware translation should move beyond sentence-level BLEU toward structured, interpretable metrics, including LLM-based judging.
Reading between the lines
- Beyond the paper, if the survey's map is right, the commercial-versus-open gap in prompting may be largely a gap in instruction-following and prompt robustness rather than raw translation capacity; a fair test would hold prompts and compute fixed across model families.
- The repeated finding that multi-turn or conversation-style translation caches context suggests a natural engineering extension: combine an open fine-tuned model with a memory-augmented agent, which the survey's own future-directions section already gestures toward.
- The survey's comparison is qualitative, so a controlled re-benchmark of all three strategy families on one document-level test set would be the next step; this is our inference, not something the paper itself reports.
- Because LLM-based post-editing of NMT output shows gains, a testable extension is to use fine-tuned open models as post-editors for their own prompt-based translations, potentially closing the gap to commercial models further.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper is a literature survey of context-aware machine translation with large language models. It organizes recent work into prompt-based approaches (zero-shot prompting and in-context learning), fine-tuning-based approaches, and other applications such as automatic post-editing, translation agents, and evaluation/context-usage analysis, providing three overview tables that list models, language pairs, and tasks. The paper also presents several synthesized observations, most notably that commercial/closed-source LLMs outperform open-source LLMs in prompt-based settings and that prompting serves as a good baseline, and it closes with future research directions. The survey's contribution is primarily taxonomic and organizational rather than experimental.
Significance. If the comparative observations were accurately scoped, this survey would be a useful entry point for researchers new to context-aware LLM translation. Its strengths include recent coverage through 2025, a clear three-part taxonomy, summary tables of covered works, and attention to automatic post-editing and agentic frameworks that are often absent from earlier surveys. The paper does not present new experimental results or formal claims, but its value as a map depends on the reliability of its summary statements. The headline commercial-versus-open comparison is currently internally inconsistent because Tower LLM is classified as commercial despite the paper's own reference describing it as open, and the comparison is drawn from heterogeneous evaluations without systematic aggregation. These issues reduce the reliability of the survey's most visible conclusions and need to be corrected before the paper can serve as a dependable reference.
major comments (3)
- [Abstract; Section 5] The abstract and the conclusion describe Tower LLM as a commercial/closed-source model ('such as ChatGPT and Tower LLM') and state that it outperforms open-source LLMs in prompt-based approaches. This is inconsistent with the paper's own reference list: Alves et al. (2024) is titled 'Tower: An open multilingual large language model for translation-related tasks,' and in Section 3 Tower-Chat is discussed as a fine-tuning system (Pombal et al., 2024), not a prompt-based method. Tower also does not appear in Table 1, which lists the prompt-based works covered. Since this comparison is one of the survey's headline findings, the classification must be corrected and the claim it supports must be re-qualified or removed.
- [Abstract; Section 5] The comparative claim that commercial/closed-source LLMs outperform open-source LLMs in prompt-based approaches is not supported by a controlled or systematic comparison. The cited studies differ in datasets (WMT, literary texts, chat, news), evaluation metrics (BLEU, COMET, ChrF, MQM, human evaluation), prompting schemes (zero-shot, few-shot, multi-turn), and model families. Some discussed works, such as Cui et al. (2024a), report that zero-shot prompting performs comparably to their proposed context-aware prompting, and several prompt-based studies use only open models. Without an aggregation table or an explicit methodology for combining these heterogeneous results, this observation should be presented as a tentative trend rather than a definitive finding.
- [Section 5] The statement that 'fine-tuning Llama or Bloom LLMs achieved nearly the same performance as ChatGPT or Tower LLM' is not tied to a specific supporting comparison in the survey. The paper's own Section 3 discussion reports mixed evidence: Wu et al. (2024a) find GPT-4-Turbo best across language pairs, Wang et al. (2024a) find GPT-4 best except in the Novels domain, and Zafar et al. (2024) report that NLLB outperforms their fine-tuned Llama-3. The conclusion should either name which works support the 'nearly the same performance' claim or soften it to reflect the heterogeneous findings presented in the body of the survey.
minor comments (5)
- [Section 3] In the paragraph on Wu et al. (2024a), the phrase 'close-source models' should be 'closed-source models.'
- [References] The references list Xu et al. (2023) and Xu et al. (2024a) as separate entries, but both point to the same arXiv identifier (arXiv:2309.11674) and the same title; this duplication should be removed.
- [Section 4; Table 3] The text for Wang et al. (2024b) says the experiments used GPT-3.5, GPT-4, and Qwen, while Table 3 lists GPT-3.5-Turbo, GPT-4o-mini, and Qwen2; these entries should be harmonized.
- [Section 1] The survey does not state its literature search and inclusion criteria (e.g., venues, time window, keyword sources). Adding a short methodology note would make the coverage boundaries explicit and improve reproducibility for readers.
- [References] Several author names contain unusual spacing, such as 'V oita' and 'V olume,' presumably from LaTeX source; these should be corrected in the final formatting.
Circularity Check
No circularity: this is a survey that aggregates external works; the Tower labeling error is a factual inconsistency, not a self-referential derivation.
full rationale
This paper is a literature survey, not a derivation chain. Its central claims are the taxonomy of prompt-based, fine-tuning-based, and other approaches, plus qualitative observations about the surveyed works. Those observations are summaries of externally cited papers whose results were produced independently of this survey, and each summarized work is attributed to its own authors and tables. There is no equation in the paper, no fitted parameter renamed as a prediction, and no result that is asserted solely on the authority of the authors' own prior work. The self-citations (Appicharla et al., 2023, 2024; Gain et al., 2025) appear only as background references when situating the survey relative to earlier document-level MT and LLM-based MT surveys; they are not load-bearing for the taxonomy or for any synthesized claim. The abstract and conclusion state that commercial LLMs such as ChatGPT and Tower outperform open-source LLMs such as Llama and Bloom, but the paper's own reference list identifies Tower as open (Alves et al., 2024: 'Tower: An open multilingual large language model'), and the cited Pombal et al. (2024) work fine-tunes Tower-Chat rather than using it in a prompt-based setting. This is a substantive accuracy problem for the survey's headline comparison, but it is not circularity: the comparison is an aggregation of external results, not a claim that is made true by the survey's own definitions or by self-citation. No 'uniqueness theorem' or ansatz is imported from the authors' prior work, and no quantity is defined in terms of another quantity it is supposed to predict. The paper is self-contained as a review relative to external benchmarks, so the honest finding is no significant circularity.
Assumptions & free parameters
assumptions (3)
- domain assumption Faithful representation of cited works
- domain assumption Representative literature coverage
- domain assumption Comparability of heterogeneous evaluations
Cite this review
Pith. "Pith review of Beyond the Sentence: A Survey on Context-Aware Machine Translation with Large Language Models." pith.science (2026). https://pith.science/paper/NODTR4C4
@misc{pith2026250607583,
author = {Pith},
title = {Pith review of: Beyond the Sentence: A Survey on Context-Aware Machine Translation with Large Language Models},
year = {2026},
howpublished = {\url{https://pith.science/paper/NODTR4C4}},
note = {Machine review of arXiv:2506.07583}
}
read the original abstract
Despite the popularity of the large language models (LLMs), their application to machine translation is relatively underexplored, especially in context-aware settings. This work presents a literature review of context-aware translation with LLMs. The existing works utilise prompting and fine-tuning approaches, with few focusing on automatic post-editing and creating translation agents for context-aware machine translation. We observed that the commercial LLMs (such as ChatGPT and Tower LLM) achieved better results than the open-source LLMs (such as Llama and Bloom LLMs), and prompt-based approaches serve as good baselines to assess the quality of translations. Finally, we present some interesting future directions to explore.
Figures
Reference graph
Works this paper leans on
-
[1]
Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, and 1 others. 2023. Gpt-4 technical report. arXiv preprint arXiv:2303.08774
arXiv 2023
-
[2]
Ruchit Agrawal, Marco Turchi, and Matteo Negri. 2018. https://aclanthology.org/2018.eamt-main.1/ Contextual handling in neural machine translation: Look behind, ahead and on both sides . In Proceedings of the 21st Annual Conference of the European Association for Machine Translation, pages 31--40, Alicante, Spain
2018
-
[3]
Sweta Agrawal, Amin Farajian, Patrick Fernandes, Ricardo Rei, and Andr \'e F. T. Martins. 2024. https://doi.org/10.1162/tacl_a_00700 Assessing the role of context in chat translation evaluation: Is context helpful and under what conditions? Transactions of the Association for Computational Linguistics, 12:1250--1267
-
[4]
Duarte M. Alves, José Pombal, Nuno M. Guerreiro, Pedro H. Martins, João Alves, Amin Farajian, Ben Peters, Ricardo Rei, Patrick Fernandes, Sweta Agrawal, Pierre Colombo, José G. C. de Souza, and André F. T. Martins. 2024. https://arxiv.org/abs/2402.17733 Tower: An open multilingual large language model for translation-related tasks . Preprint, arXiv:2402.17733
arXiv 2024
-
[5]
Ramakrishna Appicharla, Baban Gain, Santanu Pal, and Asif Ekbal. 2023. https://aclanthology.org/2023.mtsummit-research.14/ A case study on context encoding in multi-encoder based document-level neural machine translation . In Proceedings of Machine Translation Summit XIX, Vol. 1: Research Track, pages 160--172, Macau SAR, China. Asia-Pacific Association f...
2023
-
[6]
Ramakrishna Appicharla, Baban Gain, Santanu Pal, Asif Ekbal, and Pushpak Bhattacharyya. 2024. https://aclanthology.org/2024.eamt-1.21/ A case study on context-aware neural machine translation with multi-task learning . In Proceedings of the 25th Annual Conference of the European Association for Machine Translation (Volume 1), pages 246--257, Sheffield, UK...
2024
-
[7]
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473
arXiv 2014
-
[8]
Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, and 1 others. 2023. Qwen technical report. arXiv preprint arXiv:2309.16609
arXiv 2023
Show all 117 references
-
[9]
Guangsheng Bao, Yue Zhang, Zhiyang Teng, Boxing Chen, and Weihua Luo. 2021. https://doi.org/10.18653/v1/2021.acl-long.267 G -transformer for document-level machine translation . In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the ...
2021 doi
-
[10]
Rachel Bawden, Rico Sennrich, Alexandra Birch, and Barry Haddow. 2018. https://doi.org/10.18653/v1/N18-1118 Evaluating discourse phenomena in neural machine translation . In Proceedings of the 2018 Conference of the North A merican Chapter of the Association for Computational ...
2018 doi
-
[11]
Rachel Bawden and Fran c ois Yvon. 2023. https://aclanthology.org/2023.eamt-1.16/ Investigating the translation performance of a large multilingual language model: the case of BLOOM . In Proceedings of the 24th Annual Conference of the European Association for Machine Translat...
2023
-
[12]
Sid Black, Leo Gao, Phil Wang, Connor Leahy, and Stella Biderman. 2021. https://doi.org/10.5281/zenodo.5297715 GPT-Neo: Large Scale Autoregressive Language Modeling with Mesh-Tensorflow . If you use this software, please cite it using these metadata
2021 doi
-
[13]
Eleftheria Briakou, Jiaming Luo, Colin Cherry, and Markus Freitag. 2024. https://doi.org/10.18653/v1/2024.wmt-1.123 Translating step-by-step: Decomposing the translation process for improved translation quality of long-form texts . In Proceedings of the Ninth Conference on Mac...
2024 doi
-
[14]
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey W...
2020
-
[15]
Gonzalez, Ion Stoica, and Eric P
Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. 2023. https://lmsys.org/blog/2023-03-30-vicuna/ Vicuna: An open-source chatbot impressing gpt-4 with 90\
2023
-
[16]
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vino...
2023
-
[17]
Marta R Costa-Juss \`a , James Cross, Onur C elebi, Maha Elbayad, Kenneth Heafield, Kevin Heffernan, Elahe Kalbassi, Janice Lam, Daniel Licht, Jean Maillard, and 1 others. 2022. No language left behind: Scaling human-centered machine translation. arXiv preprint arXiv:2207.04672
2022 arXiv
-
[18]
Menglong Cui, Jiangcun Du, Shaolin Zhu, and Deyi Xiong. 2024 a . https://doi.org/10.18653/v1/2024.findings-acl.646 Efficiently exploring large language models for document-level machine translation with in-context learning . In Findings of the Association for Computational Lin...
2024 doi
-
[19]
Yiming Cui, Ziqing Yang, and Xin Yao. 2024 b . https://arxiv.org/abs/2304.08177 Efficient and effective text encoding for chinese llama and alpaca . Preprint, arXiv:2304.08177
2024 arXiv
-
[20]
Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, and Luke Zettlemoyer. 2023. Qlora: Efficient finetuning of quantized llms. Advances in neural information processing systems, 36:10088--10115
2023
-
[21]
Domenic Donato, Lei Yu, and Chris Dyer. 2021. https://doi.org/10.18653/v1/2021.acl-long.104 Diverse pretrained context encodings improve document translation . In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International...
2021 doi
-
[22]
Yichen Dong, Xinglin Lyu, Junhui Li, Daimeng Wei, Min Zhang, Shimin Tao, and Hao Yang. 2025. https://arxiv.org/abs/2504.05614 Two intermediate translations are better than one: Fine-tuning llms for document-level translation refinement . Preprint, arXiv:2504.05614
2025 arXiv
-
[23]
Bryan Eikema and Wilker Aziz. 2020. https://doi.org/10.18653/v1/2020.coling-main.398 Is MAP decoding all you need? the inadequacy of the mode in neural machine translation . In Proceedings of the 28th International Conference on Computational Linguistics, pages 4506--4520, Bar...
2020 doi
-
[24]
Denis Elshin, Nikolay Karpachev, Boris Gruzdev, Ilya Golovanov, Georgy Ivanov, Alexander Antonov, Nickolay Skachkov, Ekaterina Latypova, Vladimir Layner, Ekaterina Enikeeva, Dmitry Popov, Anton Chekashev, Vladislav Negodin, Vera Frantsuzova, Alexander Chernyshev, and Kirill De...
2024 doi
-
[25]
Maxim Enis and Mark Hopkins. 2024. From llm to nmt: Advancing low-resource machine translation with claude. arXiv preprint arXiv:2404.13813
2024 arXiv
-
[26]
Patrick Fernandes, Ant \'o nio Farinhas, Ricardo Rei, Jos \'e G. C. de Souza, Perez Ogayo, Graham Neubig, and Andre Martins. 2022. https://doi.org/10.18653/v1/2022.naacl-main.100 Quality-aware decoding for neural machine translation . In Proceedings of the 2022 Conference of t...
2022 doi
-
[27]
Javier Ferrando, Gerard I G \'a llego, Ioannis Tsiamas, and Marta R Costa-juss \`a . 2023. Explaining how transformers use context to build predictions. arXiv preprint arXiv:2305.12535
2023 arXiv
-
[28]
Markus Freitag, George Foster, David Grangier, Viresh Ratnakar, Qijun Tan, and Wolfgang Macherey. 2021. Experts, errors, and context: A large-scale study of human evaluation for machine translation. Transactions of the Association for Computational Linguistics, 9:1460--1474
2021
-
[29]
Markus Freitag, David Grangier, Qijun Tan, and Bowen Liang. 2022. https://doi.org/10.1162/tacl_a_00491 High quality rather than high model probability: Minimum B ayes risk decoding with neural metrics . Transactions of the Association for Computational Linguistics, 10:811--825
2022 doi
-
[30]
Baban Gain, Dibyanayan Bandyopadhyay, and Asif Ekbal. 2025. https://arxiv.org/abs/2504.01919 Bridging the linguistic divide: A survey on leveraging large language models for machine translation . Preprint, arXiv:2504.01919
2025 arXiv
-
[31]
Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Alex Vaughan, and 1 others. 2024. The llama 3 herd of models. arXiv preprint arXiv:2407.21783
2024 arXiv
-
[32]
Jiaxin Guo, Yuanchang Luo, Daimeng Wei, Ling Zhang, Zongyao Li, Hengchao Shang, Zhiqiang Rao, Shaojun Li, Jinlong Yang, Zhanglin Wu, and 1 others. 2025. Doc-guided sent2sent++: A sent2sent++ agent with doc-guided memory for document-level machine translation. arXiv preprint ar...
2025 arXiv
-
[33]
Jiaxin Guo, Hao Yang, Zongyao Li, Daimeng Wei, Hengchao Shang, and Xiaoyu Chen. 2024. https://doi.org/10.18653/v1/2024.findings-naacl.42 A novel paradigm boosting translation capabilities of large language models . In Findings of the Association for Computational Linguistics: ...
2024 doi
-
[34]
Amr Hendy, Mohamed Abdelrehim, Amr Sharaf, Vikas Raunak, Mohamed Gabr, Hitokazu Matsushita, Young Jin Kim, Mohamed Afify, and Hany Hassan Awadalla. 2023. How good are gpt models at machine translation? a comprehensive evaluation. arXiv preprint arXiv:2302.09210
2023 arXiv
-
[35]
Christian Herold, Yingbo Gao, Mohammad Zeineldeen, and Hermann Ney. 2023. https://doi.org/10.18653/v1/2023.findings-acl.444 Improving language model integration for neural machine translation . In Findings of the Association for Computational Linguistics: ACL 2023, pages 7114-...
2023 doi
-
[36]
Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, and 1 others. 2022. Lora: Low-rank adaptation of large language models. ICLR, 1(2):3
2022
-
[37]
Hanxu Hu, Jannis Vamvas, and Rico Sennrich. 2025. Source-primed multi-turn conversation helps large language models translate documents. arXiv preprint arXiv:2503.10494
2025 arXiv
-
[38]
Jingjing Huo, Christian Herold, Yingbo Gao, Leonard Dahlmann, Shahram Khadivi, and Hermann Ney. 2020. https://aclanthology.org/2020.wmt-1.71/ Diving deep into context-aware neural machine translation . In Proceedings of the Fifth Conference on Machine Translation, pages 604--6...
2020
-
[39]
Aaron Hurst, Adam Lerer, Adam P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, and 1 others. 2024. Gpt-4o system card. arXiv preprint arXiv:2410.21276
2024 arXiv
-
[40]
Albert Q. Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, Lélio Renard Lavaud, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas ...
2023 arXiv
-
[41]
Marcin Junczys-Dowmunt. 2019. https://doi.org/10.18653/v1/W19-5321 M icrosoft translator at WMT 2019: Towards large-scale document-level neural machine translation . In Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1), pages 225...
2019 doi
-
[42]
Marzena Karpinska and Mohit Iyyer. 2023. https://doi.org/10.18653/v1/2023.wmt-1.41 Large language models effectively leverage document-level context for literary translation, but critical errors persist . In Proceedings of the Eighth Conference on Machine Translation, pages 41...
2023 doi
-
[43]
Yunsu Kim, Duc Thanh Tran, and Hermann Ney. 2019. https://doi.org/10.18653/v1/D19-6503 When and why is document-level context useful in neural machine translation? In Proceedings of the Fourth Workshop on Discourse in Machine Translation (DiscoMT 2019), pages 24--34, Hong Kong...
2019 doi
-
[44]
Philipp Koehn and Rebecca Knowles. 2017. https://doi.org/10.18653/v1/W17-3204 Six challenges for neural machine translation . In Proceedings of the First Workshop on Neural Machine Translation, pages 28--39, Vancouver. Association for Computational Linguistics
2017 doi
-
[45]
Sai Koneru, Miriam Exel, Matthias Huck, and Jan Niehues. 2024. https://doi.org/10.18653/v1/2024.naacl-long.148 Contextual refinement of translations: Large language models for sentence and document-level post-editing . In Proceedings of the 2024 Conference of the North America...
2024 doi
-
[46]
Keito Kudo, Hiroyuki Deguchi, Makoto Morishita, Ryo Fujii, Takumi Ito, Shintaro Ozaki, Koki Natsumi, Kai Sato, Kazuki Yano, Ryosuke Takahashi, Subaru Kimura, Tomomasa Hara, Yusuke Sakai, and Jun Suzuki. 2024. https://doi.org/10.18653/v1/2024.wmt-1.14 Document-level translation...
2024 doi
-
[47]
Bei Li, Hui Liu, Ziyang Wang, Yufan Jiang, Tong Xiao, Jingbo Zhu, Tongran Liu, and Changliang Li. 2020. https://doi.org/10.18653/v1/2020.acl-main.322 Does multi-encoder help? a case study on context-aware neural machine translation . In Proceedings of the 58th Annual Meeting o...
2020 doi
-
[48]
Jiwei Li, Will Monroe, and Dan Jurafsky. 2016. Understanding neural networks through representation erasure. arXiv preprint arXiv:1612.08220
2016 arXiv
-
[49]
Xiang Lisa Li and Percy Liang. 2021. Prefix-tuning: Optimizing continuous prompts for generation. arXiv preprint arXiv:2101.00190
2021 arXiv
-
[50]
Yachao Li, Junhui Li, Jing Jiang, Shimin Tao, Hao Yang, and Min Zhang. 2023. P-transformer: Towards better document-to-document neural machine translation. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 31:3859--3870
2023
-
[51]
Yachao Li, Junhui Li, Jing Jiang, and Min Zhang. 2024. Enhancing document-level translation of large language model via translation mixed-instructions. arXiv preprint arXiv:2401.08088
2024 arXiv
-
[52]
Zongyao Li, Zhiqiang Rao, Hengchao Shang, Jiaxin Guo, Shaojun Li, Daimeng Wei, and Hao Yang. 2025. https://aclanthology.org/2025.coling-main.591/ Enhancing large language models for document-level translation post-editing using monolingual data . In Proceedings of the 31st Int...
2025
-
[53]
Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, and 1 others. 2021. Few-shot learning with multilingual language models. arXiv preprint arXiv:2112.10668
2021 arXiv
-
[54]
Xiao Liu, Kaixuan Ji, Yicheng Fu, Weng Lam Tam, Zhengxiao Du, Zhilin Yang, and Jie Tang. 2021. P-tuning v2: Prompt tuning can be comparable to fine-tuning universally across scales and tasks. arXiv preprint arXiv:2110.07602
2021 arXiv
-
[55]
Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, and Luke Zettlemoyer. 2020. https://doi.org/10.1162/tacl_a_00343 Multilingual denoising pre-training for neural machine translation . Transactions of the Association for Computational...
2020 doi
-
[56]
Amin Farajian, Rachel Bawden, Michael Zhang, and Andr \'e F
Ant \'o nio Lopes, M. Amin Farajian, Rachel Bawden, Michael Zhang, and Andr \'e F. T. Martins. 2020. https://aclanthology.org/2020.eamt-1.24/ Document-level neural MT : A systematic comparison . In Proceedings of the 22nd Annual Conference of the European Association for Machi...
2020
-
[57]
Yuanchang Luo, Jiaxin Guo, Daimeng Wei, Hengchao Shang, Zongyao Li, Zhanglin Wu, Zhiqiang Rao, Shaojun Li, Jinlong Yang, and Hao Yang. 2024. https://doi.org/10.18653/v1/2024.wmt-1.97 Context-aware and style-related incremental decoding framework for discourse-level literary tr...
2024 doi
-
[58]
Wong, and Longyue Wang
Chenyang Lyu, Zefeng Du, Jitao Xu, Yitao Duan, Minghao Wu, Teresa Lynn, Alham Fikri Aji, Derek F. Wong, and Longyue Wang. 2024 a . https://aclanthology.org/2024.lrec-main.120/ A paradigm shift: The future of machine translation lies with large language models . In Proceedings ...
2024
-
[59]
Xinglin Lyu, Junhui Li, Yanqing Zhao, Min Zhang, Daimeng Wei, Shimin Tao, Hao Yang, and Min Zhang. 2024 b . https://doi.org/10.18653/v1/2024.emnlp-main.1131 D e MPT : Decoding-enhanced multi-phase prompt tuning for making LLM s be better context-aware translators . In Proceedi...
2024 doi
-
[60]
Shuming Ma, Dongdong Zhang, and Ming Zhou. 2020. https://doi.org/10.18653/v1/2020.acl-main.321 A simple and effective unified encoder for document-level machine translation . In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 3505...
2020 doi
-
[61]
Sameen Maruf and Gholamreza Haffari. 2018. https://doi.org/10.18653/v1/P18-1118 Document context neural machine translation with memory networks . In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1275--12...
2018 doi
-
[62]
Sameen Maruf, Fahimeh Saleh, and Gholamreza Haffari. 2021. A survey on document-level neural machine translation: Methods and evaluation. ACM Computing Surveys (CSUR), 54(2):1--36
2021
-
[63]
Wafaa Mohammed and Vlad Niculae. 2024. Analyzing context utilization of llms in document-level translation. arXiv preprint arXiv:2410.14391
2024 arXiv
-
[64]
Kelleher, Rejwanul Haque, and Andy Way
Yasmin Moslem, Gianfranco Romani, Mahdi Molaei, John D. Kelleher, Rejwanul Haque, and Andy Way. 2023. https://doi.org/10.18653/v1/2023.wmt-1.82 Domain terminology integration into machine translation: Leveraging large language models . In Proceedings of the Eighth Conference o...
2023 doi
-
[65]
Niklas Muennighoff, Thomas Wang, Lintang Sutawika, Adam Roberts, Stella Biderman, Teven Le Scao, M Saiful Bari, Sheng Shen, Zheng Xin Yong, Hailey Schoelkopf, Xiangru Tang, Dragomir Radev, Alham Fikri Aji, Khalid Almubarak, Samuel Albanie, Zaid Alyafeai, Albert Webson, Edward ...
2023 doi
-
[66]
Mathias M \"u ller, Annette Rios, Elena Voita, and Rico Sennrich. 2018. https://doi.org/10.18653/v1/W18-6307 A large-scale test set for the evaluation of context-aware pronoun translation in neural machine translation . In Proceedings of the Third Conference on Machine Transla...
2018 doi
-
[67]
Santanu Pal, Sudip Kumar Naskar, Mihaela Vela, and Josef van Genabith. 2016. https://doi.org/10.18653/v1/P16-2046 A neural network based approach to automatic post-editing . In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: S...
2016 doi
-
[68]
Jianhui Pang, Fanghua Ye, Derek Fai Wong, Dian Yu, Shuming Shi, Zhaopeng Tu, and Longyue Wang. 2025. https://doi.org/10.1162/tacl_a_00730 Salute the classic: Revisiting challenges of machine translation in the age of large language models . Transactions of the Association for ...
2025 doi
-
[69]
Ziqian Peng, Rachel Bawden, and Fran c ois Yvon. 2024. Handling Very Long Contexts in Neural Machine Translation: a Survey. Ph.D. thesis, Projet ANR MaTOS
2024
-
[70]
Frithjof Petrick, Christian Herold, Pavel Petrushkov, Shahram Khadivi, and Hermann Ney. 2023. https://doi.org/10.18653/v1/2023.wmt-1.39 Document-level language models for machine translation . In Proceedings of the Eighth Conference on Machine Translation, pages 375--391, Sing...
2023 doi
-
[71]
Jose Pombal, Sweta Agrawal, and Andr \'e Martins. 2024. https://doi.org/10.18653/v1/2024.wmt-1.100 Improving context usage for translating bilingual customer support chat with large language models . In Proceedings of the Ninth Conference on Machine Translation, pages 993--100...
2024 doi
-
[72]
Matt Post and Marcin Junczys-Dowmunt. 2023. Escaping the sentence-level paradigm in machine translation. arXiv preprint arXiv:2304.12959
2023 arXiv
-
[73]
Ricardo Rei, Jos \'e G. C. de Souza, Duarte Alves, Chrysoula Zerva, Ana C Farinha, Taisiya Glushkova, Alon Lavie, Luisa Coheur, and Andr \'e F. T. Martins. 2022. https://aclanthology.org/2022.wmt-1.52/ COMET -22: Unbabel- IST 2022 submission for the metrics shared task . In Pr...
2022
-
[74]
Nils Reimers and Iryna Gurevych. 2019. https://doi.org/10.18653/v1/D19-1410 Sentence- BERT : Sentence embeddings using S iamese BERT -networks . In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference...
2019 doi
-
[75]
Suzanna Sia and Kevin Duh. 2023. https://aclanthology.org/2023.mtsummit-research.15/ In-context learning as maintaining coherency: A study of on-the-fly machine translation using large language models . In Proceedings of Machine Translation Summit XIX, Vol. 1: Research Track, ...
2023
-
[76]
Yirong Sun, Dawei Zhu, Yanjun Chen, Erjia Xiao, Xinghao Chen, and Xiaoyu Shen. 2025. https://aclanthology.org/2025.naacl-srw.1/ Fine-grained and multi-dimensional metrics for document-level machine translation . In Proceedings of the 2025 Conference of the Nations of the Ameri...
2025
-
[77]
Zewei Sun, Mingxuan Wang, Hao Zhou, Chengqi Zhao, Shujian Huang, Jiajun Chen, and Lei Li. 2022. https://doi.org/10.18653/v1/2022.findings-acl.279 Rethinking document-level neural machine translation . In Findings of the Association for Computational Linguistics: ACL 2022, page...
2022 doi
-
[78]
Mingi Sung, Seungmin Lee, Jiwon Kim, and Sejoon Kim. 2024. https://doi.org/10.18653/v1/2024.wmt-1.102 Context-aware LLM translation system using conversation summarization and dialogue history . In Proceedings of the Ninth Conference on Machine Translation, pages 1011--1015, M...
2024 doi
-
[79]
Ilya Sutskever, Oriol Vinyals, and Quoc V Le. 2014. Sequence to sequence learning with neural networks. In Advances in neural information processing systems, pages 3104--3112
2014
-
[80]
Hashimoto
Rohan Taori, Ishaan Gulrajani, Tianyi Zhang, Yann Dubois, Xuechen Li, Carlos Guestrin, Percy Liang, and Tatsunori B. Hashimoto. 2023. Stanford alpaca: An instruction-following llama model. https://github.com/tatsu-lab/stanford_alpaca
2023
-
[81]
Gemini Team, Petko Georgiev, Ving Ian Lei, Ryan Burnell, Libin Bai, Anmol Gulati, Garrett Tanzer, Damien Vincent, Zhufeng Pan, Shibo Wang, and 1 others. 2024 a . Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context. arXiv preprint arXiv:2403.05530
2024 arXiv
-
[82]
Gemma Team, Morgane Riviere, Shreya Pathak, Pier Giuseppe Sessa, Cassidy Hardin, Surya Bhupatiraju, Léonard Hussenot, Thomas Mesnard, Bobak Shahriari, Alexandre Ramé, Johan Ferret, Peter Liu, Pouya Tafti, Abe Friesen, Michelle Casbon, Sabela Ramos, Ravin Kumar, Charline Le Lan...
2024 arXiv
-
[83]
Katherine Thai, Marzena Karpinska, Kalpesh Krishna, Bill Ray, Moira Inghilleri, John Wieting, and Mohit Iyyer. 2022. https://doi.org/10.18653/v1/2022.emnlp-main.672 Exploring document-level literary machine translation with parallel paragraphs from world literature . In Procee...
2022 doi
-
[84]
J \"o rg Tiedemann and Yves Scherrer. 2017. https://doi.org/10.18653/v1/W17-4811 Neural machine translation with extended context . In Proceedings of the Third Workshop on Discourse in Machine Translation, pages 82--92, Copenhagen, Denmark. Association for Computational Linguistics
2017 doi
-
[85]
Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timoth \'e e Lacroix, Baptiste Rozi \`e re, Naman Goyal, Eric Hambro, Faisal Azhar, and 1 others. 2023 a . Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971
2023 arXiv
-
[86]
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, and 1 others. 2023 b . Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288
2023 arXiv
-
[87]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems, pages 5998--6008
2017
-
[88]
Elena Voita, Rico Sennrich, and Ivan Titov. 2019. https://doi.org/10.18653/v1/P19-1116 When a good translation is wrong in context: Context-aware machine translation improves on deixis, ellipsis, and lexical cohesion . In Proceedings of the 57th Annual Meeting of the Associati...
2019 doi
-
[89]
Elena Voita, Pavel Serdyukov, Rico Sennrich, and Ivan Titov. 2018. https://doi.org/10.18653/v1/P18-1117 Context-aware neural machine translation learns anaphora resolution . In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: L...
2018 doi
-
[90]
Longyue Wang, Zefeng Du, Wenxiang Jiao, Chenyang Lyu, Jianhui Pang, Leyang Cui, Kaiqiang Song, Derek Wong, Shuming Shi, and Zhaopeng Tu. 2024 a . https://doi.org/10.18653/v1/2024.findings-acl.428 Benchmarking and improving long-text translation with large language models . In ...
2024 doi
-
[91]
Longyue Wang, Siyou Liu, Mingzhou Xu, Linfeng Song, Shuming Shi, and Zhaopeng Tu. 2023 a . https://doi.org/10.18653/v1/2023.acl-long.187 A survey on zero pronoun translation . In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1:...
2023 doi
-
[92]
Longyue Wang, Chenyang Lyu, Tianbo Ji, Zhirui Zhang, Dian Yu, Shuming Shi, and Zhaopeng Tu. 2023 b . https://doi.org/10.18653/v1/2023.emnlp-main.1036 Document-level machine translation with large language models . In Proceedings of the 2023 Conference on Empirical Methods in N...
2023 doi
-
[93]
Yutong Wang, Jiali Zeng, Xuebo Liu, Derek F Wong, Fandong Meng, Jie Zhou, and Min Zhang. 2024 b . Delta: An online document-level translation agent based on multi-level memory. arXiv preprint arXiv:2410.08143
2024 arXiv
-
[94]
Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, and 1 others. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, 35:24824--24837
2022
-
[95]
BigScience Workshop, Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick, Suzana Ili \'c , Daniel Hesslow, Roman Castagn \'e , Alexandra Sasha Luccioni, Fran c ois Yvon, and 1 others. 2022. Bloom: A 176b-parameter open-access multilingual language model. arXiv preprint...
2022 arXiv
-
[96]
Minghao Wu, Thuy-Trang Vu, Lizhen Qu, George Foster, and Gholamreza Haffari. 2024 a . Adapting large language models for document-level machine translation. arXiv preprint arXiv:2401.06468
2024 arXiv
-
[97]
Minghao Wu, Yufei Wang, George Foster, Lizhen Qu, and Gholamreza Haffari. 2024 b . https://aclanthology.org/2024.eacl-long.44/ Importance-aware data augmentation for document-level neural machine translation . In Proceedings of the 18th Conference of the European Chapter of th...
2024
-
[98]
Minghao Wu, Yulin Yuan, Gholamreza Haffari, and Longyue Wang. 2024 c . (perhaps) beyond human translation: Harnessing multi-agent collaboration for translating ultra-long literary texts. arXiv preprint arXiv:2405.11804
2024 arXiv
-
[99]
Yangjian Wu and Gang Hu. 2023. https://doi.org/10.18653/v1/2023.wmt-1.15 Exploring prompt engineering with GPT language models for document-level machine translation: Insights and findings . In Proceedings of the Eighth Conference on Machine Translation, pages 166--169, Singap...
2023 doi
-
[100]
Zhanglin Wu, Daimeng Wei, Zongyao Li, Hengchao Shang, Jiaxin Guo, Shaojun Li, Zhiqiang Rao, Yuanchang Luo, Ning Xie, and Hao Yang. 2024 d . https://doi.org/10.18653/v1/2024.wmt-1.9 Choose the final translation from NMT and LLM hypotheses using MBR decoding: HW - TSC `s submiss...
2024 doi
-
[102]
Haoran Xu, Young Jin Kim, Amr Sharaf, and Hany Hassan Awadalla. 2024 a . https://arxiv.org/abs/2309.11674 A paradigm shift in machine translation: Boosting translation performance of large language models . Preprint, arXiv:2309.11674
2024 arXiv
-
[103]
Haoran Xu, Amr Sharaf, Yunmo Chen, Weiting Tan, Lingfeng Shen, Benjamin Van Durme, Kenton Murray, and Young Jin Kim. 2024 b . https://arxiv.org/abs/2401.08417 Contrastive preference optimization: Pushing the boundaries of llm performance in machine translation . Preprint, arXi...
2024 arXiv
-
[104]
Aiyuan Yang, Bin Xiao, Bingning Wang, Borong Zhang, Ce Bian, Chao Yin, Chenxu Lv, Da Pan, Dian Wang, Dong Yan, and 1 others. 2023. Baichuan 2: Open large-scale language models. arXiv preprint arXiv:2309.10305
2023 arXiv
-
[105]
An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, and 1 others. 2024 a . Qwen2. 5 technical report. arXiv preprint arXiv:2412.15115
2024 arXiv
-
[106]
Xinye Yang, Yida Mu, Kalina Bontcheva, and Xingyi Song. 2024 b . https://doi.org/10.18653/v1/2024.wmt-1.101 Optimising LLM -driven machine translation with context-aware sliding windows . In Proceedings of the Ninth Conference on Machine Translation, pages 1004--1010, Miami, F...
2024 doi
-
[107]
Maria Zafar, Antonio Castaldo, Prashanth Nayak, Rejwanul Haque, and Andy Way. 2024. https://doi.org/10.18653/v1/2024.wmt-1.104 The SETU - ADAPT submissions to WMT 2024 chat translation tasks . In Proceedings of the Ninth Conference on Machine Translation, pages 1023--1030, Mia...
2024 doi
-
[108]
Aohan Zeng, Xiao Liu, Zhengxiao Du, Zihan Wang, Hanyu Lai, Ming Ding, Zhuoyi Yang, Yifan Xu, Wendi Zheng, Xiao Xia, and 1 others. 2022. Glm-130b: An open bilingual pre-trained model. arXiv preprint arXiv:2210.02414
2022 arXiv
-
[109]
Biao Zhang, Ankur Bapna, Melvin Johnson, Ali Dabirmoghaddam, Naveen Arivazhagan, and Orhan Firat. 2022 a . https://doi.org/10.18653/v1/2022.acl-long.287 Multilingual document-level translation enables zero-shot transfer from sentences to documents . In Proceedings of the 60th ...
2022 doi
-
[110]
Biao Zhang, Barry Haddow, and Alexandra Birch. 2023 a . Prompting large language model for machine translation: A case study. In International Conference on Machine Learning, pages 41092--41110. PMLR
2023
-
[111]
Jiacheng Zhang, Huanbo Luan, Maosong Sun, Feifei Zhai, Jingfang Xu, Min Zhang, and Yang Liu. 2018. https://doi.org/10.18653/v1/D18-1049 Improving the transformer translation model with document-level context . In Proceedings of the 2018 Conference on Empirical Methods in Natur...
2018 doi
-
[112]
Pei Zhang, Boxing Chen, Niyu Ge, and Kai Fan. 2020. https://doi.org/10.18653/v1/2020.emnlp-main.81 Long-short term masking transformer: A simple but effective baseline for document-level neural machine translation . In Proceedings of the 2020 Conference on Empirical Methods in...
2020 doi
-
[113]
Shaolei Zhang, Qingkai Fang, Zhuocheng Zhang, Zhengrui Ma, Yan Zhou, Langlin Huang, Mengyu Bu, Shangtong Gui, Yunji Chen, Xilin Chen, and Yang Feng. 2023 b . https://arxiv.org/abs/2306.10968 Bayling: Bridging cross-lingual alignment and instruction following through interactiv...
2023 arXiv
-
[114]
Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, and 1 others. 2022 b . Opt: Open pre-trained transformer language models. arXiv preprint arXiv:2205.01068
2022 arXiv
-
[115]
Xuan Zhang, Navid Rajabi, Kevin Duh, and Philipp Koehn. 2023 c . https://doi.org/10.18653/v1/2023.wmt-1.43 Machine translation with large language models: Prompting, few-shot learning, and fine-tuning with QL o RA . In Proceedings of the Eighth Conference on Machine Translatio...
2023 doi
-
[116]
P Xing, Hao Zhang, Joseph E
Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric. P Xing, Hao Zhang, Joseph E. Gonzalez, and Ion Stoica. 2023. https://arxiv.org/abs/2306.05685 Judging llm-as-a-judge with mt-bench and chatbot arena . P...
2023 arXiv
-
[117]
online" 'onlinestring :=
ENTRY address archivePrefix author booktitle chapter edition editor eid eprint eprinttype howpublished institution journal key month note number organization pages publisher school series title type volume year doi pubmed url lastchecked label extra.label sort.label short.list...
-
[118]
write newline
" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 gl...
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.