The reviewed record of science sign in
Pith

arxiv: 2004.07737 · v2 · pith:67DHYZFE · submitted 2020-04-16 · cs.CL

Cross-lingual Contextualized Topic Models with Zero-shot Learning

Federico Bianchi , Silvia Terragni , Dirk Hovy , Debora Nozza , Elisabetta Fersini This is my paper

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:67DHYZFErecord.jsonopen to challenge →

classification cs.CL
keywords languagestopicmodelscross-lingualdifferentherelearningmodel
0
0 comments X
read the original abstract

Many data sets (e.g., reviews, forums, news, etc.) exist parallelly in multiple languages. They all cover the same content, but the linguistic differences make it impossible to use traditional, bag-of-word-based topic models. Models have to be either single-language or suffer from a huge, but extremely sparse vocabulary. Both issues can be addressed by transfer learning. In this paper, we introduce a zero-shot cross-lingual topic model. Our model learns topics on one language (here, English), and predicts them for unseen documents in different languages (here, Italian, French, German, and Portuguese). We evaluate the quality of the topic predictions for the same document in different languages. Our results show that the transferred topics are coherent and stable across languages, which suggests exciting future research directions.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Graph-Augmented LLMs for Swiss MP Ideology Prediction

    cs.CL 2026-05 unverdicted novelty 5.0

    Graph-augmented LLMs using a political knowledge graph improve ideology prediction accuracy for Swiss MPs by incorporating relational data beyond text alone.