Pith. sign in

REVIEW 4 cited by

MWP-BERT: Numeracy-Augmented Pre-training for Math Word Problem Solving

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2107.13435 v2 pith:EP65O6PH submitted 2021-07-28 cs.AI

classification cs.AI
keywords numberreasoningrepresentationsolvingnumericalmwp-bertsymbolicdilemma
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Math word problem (MWP) solving faces a dilemma in number representation learning. In order to avoid the number representation issue and reduce the search space of feasible solutions, existing works striving for MWP solving usually replace real numbers with symbolic placeholders to focus on logic reasoning. However, different from common symbolic reasoning tasks like program synthesis and knowledge graph reasoning, MWP solving has extra requirements in numerical reasoning. In other words, instead of the number value itself, it is the reusable numerical property that matters more in numerical reasoning. Therefore, we argue that injecting numerical properties into symbolic placeholders with contextualized representation learning schema can provide a way out of the dilemma in the number representation issue here. In this work, we introduce this idea to the popular pre-training language model (PLM) techniques and build MWP-BERT, an effective contextual number representation PLM. We demonstrate the effectiveness of our MWP-BERT on MWP solving and several MWP-specific understanding tasks on both English and Chinese benchmarks.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Artificial Intelligence for Mathematical Reasoning: An Integrated Survey of Language Models, Neuro-symbolic Systems, and Verified Discovery

    cs.AI 2026-06 unverdicted novelty 5.0 of 10

    An integrated survey organizing AI mathematical reasoning into informal, formal, discovery, and technique axes while cataloging benchmarks and assessing failure modes.

  2. Empowering Bengali Education with AI: Solving Bengali Math Word Problems through Transformer Models

    cs.CL 2025-01 conditional novelty 5.0 of 10

    Fine-tuning mT5, BanglaT5, mBART50 and a basic Transformer on a newly translated Bengali math word problem dataset yields up to 97.3% solution accuracy on elementary arithmetic problems.

  3. Leveraging Large Language Models for Bengali Math Word Problem Solving with Chain of Thought Reasoning

    cs.CL 2025-05 conditional novelty 4.0 of 10

    A new Bengali math word problem dataset translated from GSM8K is benchmarked with chain-of-thought prompting, yielding 88% accuracy with LLaMA-3.3 70B on a 1,000-sample test subset.

  4. A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challenges

    cs.CL 2024-12 conditional novelty 4.0 of 10

    A survey that structures multimodal large language model research for mathematical reasoning into benchmarks, three methodological paradigms, and seven open challenges, claiming to be the first of its kind.

Pith tools