Pith. sign in

REVIEW 4 cited by

MAPO: Advancing Multilingual Reasoning through Multilingual Alignment-as-Preference Optimization

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2401.06838 v3 pith:VVCDIVX7 submitted 2024-01-12 cs.CL

MAPO: Advancing Multilingual Reasoning through Multilingual Alignment-as-Preference Optimization

classification cs.CL
keywords reasoninglanguagesoptimizationmultilingualabilitiesdominantmapoacross
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
Share X Bluesky LinkedIn Reddit HN
read the original abstract

Though reasoning abilities are considered language-agnostic, existing LLMs exhibit inconsistent reasoning abilities across different languages, e.g., reasoning in the dominant language like English is superior to other languages due to the imbalance of multilingual training data. To enhance reasoning abilities in non-dominant languages, we propose a Multilingual-Alignment-as-Preference Optimization framework (MAPO), aiming to align the reasoning processes in other languages with the dominant language. Specifically, we harness an off-the-shelf translation model for the consistency between answers in non-dominant and dominant languages, which we adopt as the preference for optimization, e.g., Direct Preference Optimization (DPO) or Proximal Policy Optimization (PPO). Experiments show that MAPO stably achieves significant improvements in the multilingual reasoning of various models on all three benchmarks (MSVAMP +16.2%, MGSM +6.1%, and MNumGLUESub +13.3%), with improved reasoning consistency across languages.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Efficient Multilingual Reasoning Transfer via Progressive Code-Switching

    cs.CL 2026-07 unverdicted novelty 7.0

    PCS transfers English reasoning to other languages in LRMs via code-switched SFT initialization followed by step-level RL curriculum that progressively increases target-language ratio, narrowing the performance gap wi...

  2. Efficient Multilingual Reasoning Transfer via Progressive Code-Switching

    cs.CL 2026-07 conditional novelty 6.0

    A progressive code-switching RL curriculum makes Qwen3 models reason in French, Portuguese, Japanese, Korean, and Thai with 96-99% step-level language consistency, while keeping accuracy close to English.

  3. CURE-Med: Curriculum-Informed Reinforcement Learning for Multilingual Medical Reasoning

    cs.AI 2026-01 unverdicted novelty 6.0

    CURE-MED pairs a new 13-language medical reasoning benchmark with curriculum RL to raise logical correctness to 70% and language consistency to 95% at 32B scale while outperforming baselines.

  4. The Periodic Table of LLM Reasoning: A Structured Survey of Reasoning Paradigms, Methods, and Failure Modes

    cs.CL 2026-06 unverdicted novelty 4.0

    A literature survey that introduces a taxonomy for LLM reasoning paradigms, analyzes methodological trends, and synthesizes failure modes from over 300 papers.