Pith. sign in

REVIEW 4 cited by

mCoT: Multilingual Instruction Tuning for Reasoning Consistency in Language Models

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2406.02301 v2 pith:JNPRRBT2 submitted 2024-06-04 cs.CL

mCoT: Multilingual Instruction Tuning for Reasoning Consistency in Language Models

classification cs.CL
keywords languagesreasoningmultilingualacrossconsistencyllmsmodelscapability
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
Share X Bluesky LinkedIn Reddit HN
read the original abstract

Large language models (LLMs) with Chain-of-thought (CoT) have recently emerged as a powerful technique for eliciting reasoning to improve various downstream tasks. As most research mainly focuses on English, with few explorations in a multilingual context, the question of how reliable this reasoning capability is in different languages is still open. To address it directly, we study multilingual reasoning consistency across multiple languages, using popular open-source LLMs. First, we compile the first large-scale multilingual math reasoning dataset, mCoT-MATH, covering eleven diverse languages. Then, we introduce multilingual CoT instruction tuning to boost reasoning capability across languages, thereby improving model consistency. While existing LLMs show substantial variation across the languages we consider, and especially low performance for lesser resourced languages, our 7B parameter model mCoT achieves impressive consistency across languages, and superior or comparable performance to close- and open-source models even of much larger sizes.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Efficient Multilingual Reasoning Transfer via Progressive Code-Switching

    cs.CL 2026-07 unverdicted novelty 7.0

    PCS transfers English reasoning to other languages in LRMs via code-switched SFT initialization followed by step-level RL curriculum that progressively increases target-language ratio, narrowing the performance gap wi...

  2. Efficient Multilingual Reasoning Transfer via Progressive Code-Switching

    cs.CL 2026-07 conditional novelty 6.0

    A progressive code-switching RL curriculum makes Qwen3 models reason in French, Portuguese, Japanese, Korean, and Thai with 96-99% step-level language consistency, while keeping accuracy close to English.

  3. English is Not All You Need: Systematically Exploring the Role of Multilinguality in LLM Post-Training

    cs.CL 2026-04 unverdicted novelty 6.0

    Systematic experiments demonstrate that multilingual coverage in LLM post-training improves results for all languages and tasks compared to English-only, with low-resource languages gaining most and zero-shot transfer...

  4. The Periodic Table of LLM Reasoning: A Structured Survey of Reasoning Paradigms, Methods, and Failure Modes

    cs.CL 2026-06 unverdicted novelty 4.0

    A literature survey that introduces a taxonomy for LLM reasoning paradigms, analyzes methodological trends, and synthesizes failure modes from over 300 papers.