REVIEW 11 cited by
EuroLLM: Multilingual Language Models for Europe
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
The quality of open-weight LLMs has seen significant improvement, yet they remain predominantly focused on English. In this paper, we introduce the EuroLLM project, aimed at developing a suite of open-weight multilingual LLMs capable of understanding and generating text in all official European Union languages, as well as several additional relevant languages. We outline the progress made to date, detailing our data collection and filtering process, the development of scaling laws, the creation of our multilingual tokenizer, and the data mix and modeling configurations. Additionally, we release our initial models: EuroLLM-1.7B and EuroLLM-1.7B-Instruct and report their performance on multilingual general benchmarks and machine translation.
Forward citations
Cited by 11 Pith papers
-
EsBBQ and CaBBQ: The Spanish and Catalan Bias Benchmarks for Question Answering
EsBBQ and CaBBQ are new Spanish and Catalan bias benchmarks for multiple-choice QA, built with survey-validated stereotypes from Spain and evaluated on 17 language models.
-
Comparing and Modeling Argumentation in German Political Communication across Arenas
In a new 17k-sentence corpus of German COVID-19 political discourse, evidence-based expert justifications are proportionally most frequent in press conferences, not in health committee meetings.
-
KletterMix: Climbing Toward High-Quality German Pretraining Data - The Full Report
KletterMix is a translated German corpus from English pretraining data that yields measurable gains on German downstream tasks in controlled pretraining experiments.
-
How Important is `Perfect' English for Machine Translation Prompts?
For LLM machine translation, prompt choice affects output quality more than realistic user errors, with spelling errors hurting most and phrase-level errors often harmless.
-
Training-free LLM Merging for Multi-task Learning
Hi-Merging merges two task-specialized LLMs by pruning and scaling delta vectors at model and layer level, reporting gains over prior merging and multi-task fine-tuning on English and Chinese MCQA and QA tasks.
-
NAVER LABS Europe Submission to the Instruction-following Track
A separately-trained speech projector and text LoRA can be merged with only 1K steps of multimodal fine-tuning to yield a competitive ASR, ST, and spoken QA system.
-
A Sovereign, Open-Source Foundation Model for German and English
Soofi S 30B-A3B, a hybrid Mamba-MoE model pretrained on ~27T tokens with deliberately up-weighted German, reports the highest English and German aggregate scores among fully open base models in its comparison while ma...
-
Assessing the Role of Data Quality in Training Bilingual Language Models
A quality filter trained only on English labels can select better French, German, and Chinese pretraining data, improving bilingual model performance and cutting the monolingual-bilingual gap to about 1%.
-
Beyond Text Compression: Evaluating Tokenizers Across Scales
Tokenizer choice matters mostly for multilingual tasks, and 350M-parameter models can predict 2.7B model ranking on translation but not on English benchmarks.
-
Don't Erase, Inform! Detecting and Contextualizing Harmful Language in Cultural Heritage Collections
The authors present a multilingual vocabulary and a detection tool using string matching, NER and LLM disambiguation that flags and contextualizes harmful language in cultural heritage metadata, reporting 87 percent p...
-
Instituto de Telecomunica\c{c}\~oes at IWSLT 2025: Aligning Small-Scale Speech and Language Models for Speech-to-Text Learning
The IT-IST IWSLT 2025 submission shows that a 1.5B language model with a speech encoder can do reasonable ASR after alignment, but struggles with ST and SQA.
Discussion (0). Sign in to comment.