Pith. sign in

REVIEW 1 cited by

Findings of the WMT 2023 Shared Task on Discourse-Level Literary Translation: A Fresh Orb in the Cosmos of LLMs

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2311.03127 v1 pith:Q2Y4Q2PH submitted 2023-11-06 cs.CL cs.AI

Longyue Wang , Zhaopeng Tu , Yan Gu , Siyou Liu , Dian Yu , Qingsong Ma , Chenyang Lyu , Liting Zhou
show 9 more authors
Chao-Hong Liu Yufeng Ma Weiyu Chen Yvette Graham Bonnie Webber Philipp Koehn Andy Way Yulin Yuan Shuming Shi
This is my paper · ORCID
classification cs.CLcs.AI
keywords literaryhumantranslationdiscourse-levelfindingsfirstreleaseshared
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Translating literary works has perennially stood as an elusive dream in machine translation (MT), a journey steeped in intricate challenges. To foster progress in this domain, we hold a new shared task at WMT 2023, the first edition of the Discourse-Level Literary Translation. First, we (Tencent AI Lab and China Literature Ltd.) release a copyrighted and document-level Chinese-English web novel corpus. Furthermore, we put forth an industry-endorsed criteria to guide human evaluation process. This year, we totally received 14 submissions from 7 academia and industry teams. We employ both automatic and human evaluations to measure the performance of the submitted systems. The official ranking of the systems is based on the overall human judgments. In addition, our extensive analysis reveals a series of interesting findings on literary and discourse-aware MT. We release data, system outputs, and leaderboard at http://www2.statmt.org/wmt23/literary-translation-task.html.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. A 2-step Framework for Automated Literary Translation Evaluation: Its Promises and Pitfalls

    cs.CL 2024-12 conditional novelty 6.0 of 10

    A rubric-plus-question-answering LLM framework for literary translation evaluation beats traditional MT metrics but still trails human agreement, especially on Korean honorifics.

Pith tools