JESC: Japanese-English Subtitle Corpus

Dan Jurafsky; Denny Britz; Reid Pryzant; Yongjoo Chung

arxiv: 1710.10639 · v4 · pith:LST3EQYAnew · submitted 2017-10-29 · 💻 cs.CL

JESC: Japanese-English Subtitle Corpus

Reid Pryzant , Yongjoo Chung , Dan Jurafsky , Denny Britz This is my paper

classification 💻 cs.CL

keywords corpusjapanese-englishjescsubtitleaccuratealigningalignmentsassembled

0 comments

read the original abstract

In this paper we describe the Japanese-English Subtitle Corpus (JESC). JESC is a large Japanese-English parallel corpus covering the underrepresented domain of conversational dialogue. It consists of more than 3.2 million examples, making it the largest freely available dataset of its kind. The corpus was assembled by crawling and aligning subtitles found on the web. The assembly process incorporates a number of novel preprocessing elements to ensure high monolingual fluency and accurate bilingual alignments. We summarize its contents and evaluate its quality using human experts and baseline machine translation (MT) systems.

This paper has not been read by Pith yet.

discussion (0)

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

Findings of the First Shared Task on Machine Translation Robustness
cs.CL 2019-06 unverdicted novelty 6.0

The first shared task on MT robustness received 23 submissions showing up to +22.33 BLEU gains on noisy Reddit data, with strong human-BLEU correlation.