A translate-then-evaluate framework measures cross-lingual consistency and finds that major LLMs give substantially less informative and less empathetic answers in many non-English languages.
We also experimented with using sampling instead of greedy and found that it had little to no affect on degener- ation
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Found in Translation: Measuring Multilingual LLM Consistency as Simple as Translate then Evaluate
A translate-then-evaluate framework measures cross-lingual consistency and finds that major LLMs give substantially less informative and less empathetic answers in many non-English languages.