pith. sign in

arxiv: 1509.08639 · v1 · pith:6XQBCO5Knew · submitted 2015-09-29 · 💻 cs.CL · cs.AI· cs.DS

Tuned and GPU-accelerated parallel data mining from comparable corpora

classification 💻 cs.CL cs.AIcs.DS
keywords translationdatadomainslimitedminingparallelqualitytext
0
0 comments X
read the original abstract

The multilingual nature of the world makes translation a crucial requirement today. Parallel dictionaries constructed by humans are a widely-available resource, but they are limited and do not provide enough coverage for good quality translation purposes, due to out-of-vocabulary words and neologisms. This motivates the use of statistical translation systems, which are unfortunately dependent on the quantity and quality of training data. Such has a very limited availability especially for some languages and very narrow text domains. Is this research we present our improvements to Yalign mining methodology by reimplementing the comparison algorithm, introducing a tuning scripts and by improving performance using GPU computing acceleration. The experiments are conducted on various text domains and bi-data is extracted from the Wikipedia dumps.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.