Pith. sign in

REVIEW 2 cited by

The State of Multilingual LLM Safety Research: From Measuring the Language Gap to Mitigating It

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2505.24119 v1 pith:V3PYSLA3 submitted 2025-05-30 cs.CL

classification cs.CL
keywords safetyresearchlanguagedirectionsfieldfuturelanguagesmultilingual
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

This paper presents a comprehensive analysis of the linguistic diversity of LLM safety research, highlighting the English-centric nature of the field. Through a systematic review of nearly 300 publications from 2020--2024 across major NLP conferences and workshops at *ACL, we identify a significant and growing language gap in LLM safety research, with even high-resource non-English languages receiving minimal attention. We further observe that non-English languages are rarely studied as a standalone language and that English safety research exhibits poor language documentation practice. To motivate future research into multilingual safety, we make several recommendations based on our survey, and we then pose three concrete future directions on safety evaluation, training data generation, and crosslingual safety generalization. Based on our survey and proposed directions, the field can develop more robust, inclusive AI safety practices for diverse global populations.

Discussion (0). Sign in to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. ROK-FORTRESS: Measuring the Effect of Geopolitical Transcreation for National Security and Public Safety

    cs.CL 2026-05 unverdicted novelty 7.0 of 10

    ROK-FORTRESS shows Korean-language prompts increase LLM safety suppression compared with English, while Korean geopolitical grounding often reduces that suppression, indicating translation-only evaluations miss langua...

  2. The Problem with Safety Classification is not just the Models

    cs.CL 2025-07 conditional novelty 6.0 of 10

    Multilingual safety classifiers perform unevenly across languages, and the evaluation datasets used to test them contain many harmless prompts mislabeled as harmful.

Pith tools