pith. sign in

arxiv: 2407.19884 · v1 · pith:P253ZE6Cnew · submitted 2024-07-29 · 💻 cs.CL

Preliminary WMT24 Ranking of General MT Systems and LLMs

Tom Kocmi , Eleftherios Avramidis , Rachel Bawden , Ondrej Bojar , Anton Dvorkovich , Christian Federmann , Mark Fishel , Markus Freitag
show 13 more authors
Thamme Gowda Roman Grundkiewicz Barry Haddow Marzena Karpinska Philipp Koehn Benjamin Marie Kenton Murray Masaaki Nagata Martin Popel Maja Popovic Mariya Shmatova Stein{\th}\'or Steingr\'imsson Vil\'em Zouhar
This is my paper
classification 💻 cs.CL
keywords rankinggeneralpreliminaryautomaticsystemswmt24duringevaluation
0
0 comments X
read the original abstract

This is the preliminary ranking of WMT24 General MT systems based on automatic metrics. The official ranking will be a human evaluation, which is superior to the automatic ranking and supersedes it. The purpose of this report is not to interpret any findings but only provide preliminary results to the participants of the General MT task that may be useful during the writing of the system submission.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. MADE: Beyond Scoring via a Multilingual Agentic Diagnosing Engine for Fine-Grained Evaluation Insights

    cs.CL 2026-06 unverdicted novelty 6.0

    MADE is a new multilingual agentic diagnosing engine that produces higher-quality diagnostic reports (47% better than baseline) on a large-scale evaluation substrate covering 33 model families and 26 languages.