Pith. sign in

REVIEW

TeCS: A Dataset and Benchmark for Tense Consistency of Machine Translation

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2305.13740 v1 pith:P5766KDG submitted 2023-05-23 cs.CL

classification cs.CL
keywords tensebenchmarkmachinetranslationconsistencypredictiontestable
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Tense inconsistency frequently occurs in machine translation. However, there are few criteria to assess the model's mastery of tense prediction from a linguistic perspective. In this paper, we present a parallel tense test set, containing French-English 552 utterances. We also introduce a corresponding benchmark, tense prediction accuracy. With the tense test set and the benchmark, researchers are able to measure the tense consistency performance of machine translation systems for the first time.

Discussion (0). Sign in to comment.

Pith tools