REVIEW 2 cited by
VISA: An Ambiguous Subtitles Dataset for Visual Scene-Aware Machine Translation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Existing multimodal machine translation (MMT) datasets consist of images and video captions or general subtitles, which rarely contain linguistic ambiguity, making visual information not so effective to generate appropriate translations. We introduce VISA, a new dataset that consists of 40k Japanese-English parallel sentence pairs and corresponding video clips with the following key features: (1) the parallel sentences are subtitles from movies and TV episodes; (2) the source subtitles are ambiguous, which means they have multiple possible translations with different meanings; (3) we divide the dataset into Polysemy and Omission according to the cause of ambiguity. We show that VISA is challenging for the latest MMT system, and we hope that the dataset can facilitate MMT research. The VISA dataset is available at: https://github.com/ku-nlp/VISA.
Forward citations
Cited by 2 Pith papers
-
TopicVD: A Topic-Based Dataset of Video-Guided Multimodal Machine Translation for Documentaries
This paper builds TopicVD, a topic-based documentary video-subtitle translation dataset, and shows with a cross-modal attention model that visual and contextual information improve BLEU scores.
-
Interactive Text-to-SQL via Expected Information Gain for Disambiguation
An interactive text-to-SQL framework selects clarification questions by expected information gain over a distribution of candidate SQL queries.
Discussion (0). Continue with ORCID to comment.