pith. sign in

arxiv: 2506.02461 · v1 · pith:AKRIN4L5new · submitted 2025-06-03 · 💻 cs.CL

XToM: Exploring the Multilingual Theory of Mind for Large Language Models

classification 💻 cs.CL
keywords acrossllmsmultilinguallinguisticmindtheoryxtomability
0
0 comments X
read the original abstract

Theory of Mind (ToM), the ability to infer mental states in others, is pivotal for human social cognition. Existing evaluations of ToM in LLMs are largely limited to English, neglecting the linguistic diversity that shapes human cognition. This limitation raises a critical question: can LLMs exhibit Multilingual Theory of Mind, which is the capacity to reason about mental states across diverse linguistic contexts? To address this gap, we present XToM, a rigorously validated multilingual benchmark that evaluates ToM across five languages and incorporates diverse, contextually rich task scenarios. Using XToM, we systematically evaluate LLMs (e.g., DeepSeek R1), revealing a pronounced dissonance: while models excel in multilingual language understanding, their ToM performance varies across languages. Our findings expose limitations in LLMs' ability to replicate human-like mentalizing across linguistic contexts.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. HiMed: Incentivizing Hindi Reasoning in Medical LLMs

    cs.CL 2026-05 unverdicted novelty 5.0

    HiMed releases a Hindi medical reasoning corpus and benchmark and shows that training an 8B LLM with decaying scaffolding reward improves Hindi performance and narrows the English-Hindi accuracy gap.