The reviewed record of science sign in
Pith

arxiv: 2504.03312 · v2 · pith:M2L7BJ6X · submitted 2025-04-04 · cs.CL · cs.LG

Evaluating Compact LLMs for Zero-Shot Iberian Language Tasks on End-User Devices

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:M2L7BJ6Xrecord.jsonopen to challenge →

classification cs.CL cs.LG
keywords languagetasksiberianlanguagesperformancecompactdevicesevaluation
0
0 comments X
read the original abstract

Large Language Models have significantly advanced natural language processing, achieving remarkable performance in tasks such as language generation, translation, and reasoning. However, their substantial computational requirements restrict deployment to high-end systems, limiting accessibility on consumer-grade devices. This challenge is especially pronounced for under-resourced languages like those spoken in the Iberian Peninsula, where relatively limited linguistic resources and benchmarks hinder effective evaluation. This work presents a comprehensive evaluation of compact state-of-the-art LLMs across several essential NLP tasks tailored for Iberian languages. The results reveal that while some models consistently excel in certain tasks, significant performance gaps remain, particularly for languages such as Basque. These findings highlight the need for further research on balancing model compactness with robust multilingual performance

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Curation of a Palaeohispanic Dataset for Machine Learning

    cs.CL 2026-03 unverdicted novelty 5.0

    The authors curate a new structured dataset of Palaeohispanic inscriptions formatted for machine learning applications.