Pith. sign in

REVIEW 7 cited by

HARDMath: A Benchmark Dataset for Challenging Problems in Applied Mathematics

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2410.09988 v2 pith:YOU3U2EU submitted 2024-10-13 cs.LG cs.AI

classification cs.LGcs.AI
keywords problemsappliedllmsmathematicsbenchmarkdatasetshardmathadvanced
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Advanced applied mathematics problems are underrepresented in existing Large Language Model (LLM) benchmark datasets. To address this, we introduce HARDMath, a dataset inspired by a graduate course on asymptotic methods, featuring challenging applied mathematics problems that require analytical approximation techniques. These problems demand a combination of mathematical reasoning, computational tools, and subjective judgment, making them difficult for LLMs. Our framework auto-generates a large number of problems with solutions validated against numerical ground truths. We evaluate both open- and closed-source LLMs on HARDMath-mini, a sub-sampled test set of 366 problems, as well as on 40 word problems formulated in applied science contexts. Even leading closed-source models like GPT-4 achieve only 43.8% overall accuracy with few-shot Chain-of-Thought prompting, and all models demonstrate significantly lower performance compared to results on existing mathematics benchmark datasets. We additionally conduct a detailed error analysis to gain insights into the failure cases of LLMs. These results demonstrate limitations of current LLM performance on advanced graduate-level applied math problems and underscore the importance of datasets like HARDMath to advance mathematical abilities of LLMs.

Discussion (0). Sign in to comment.

Forward citations

Cited by 7 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. DPrivBench: Benchmarking LLMs' Reasoning for Differential Privacy

    cs.LG 2026-04 unverdicted novelty 7.0 of 10

    DPrivBench shows that top LLMs handle basic differential privacy mechanisms but fail on advanced algorithms, exposing gaps in automated DP reasoning.

  2. DPrivBench: Benchmarking LLMs' Reasoning for Differential Privacy

    cs.LG 2026-04 accept novelty 7.0 of 10

    DPrivBench is a new benchmark for evaluating LLMs on differential privacy reasoning, with results showing good performance on textbook mechanisms but substantial failures on advanced algorithms.

  3. Do LLMs Overthink Basic Math Reasoning? Benchmarking the Accuracy-Efficiency Tradeoff in Language Models

    cs.CL 2025-07 conditional novelty 7.0 of 10

    Evaluations of 53 LLMs on 14 basic math tasks show reasoning models use ~18x more tokens with sometimes lower accuracy, non-monotonic gains from extended budgets, and sharp performance drops under token constraints.

  4. AdvancedMathBench: A Benchmark Suite for Advanced Mathematical Proof Generation and Verification

    cs.CL 2026-07 conditional novelty 6.5 of 10

    A 245-problem advanced proof benchmark plus 888 expert-labeled trajectories shows frontier LLMs remain far from reliable advanced proof generation and verification.

  5. SPM-Bench: Benchmarking Large Language Models for Scanning Probe Microscopy

    cs.AI 2026-02 reject novelty 6.0 of 10

    A new benchmark of 2,703 automatically generated multimodal questions for scanning probe microscopy, plus a modified F1 metric that penalizes over-selection and labels model 'personalities'.

  6. EngTrace: A Symbolic Benchmark for Verifiable Process Supervision of Engineering Reasoning

    cs.CL 2025-11 conditional novelty 6.0 of 10

    EngTrace, a 1,350-instance symbolic engineering benchmark with gold reasoning traces, shows frontier LLMs outperform math-specialized small models and that trace verification reveals a complexity cliff.

  7. ECHO-2: A Large-Scale Distributed Rollout Framework for Cost-Efficient Reinforcement Learning

    cs.LG 2026-02 conditional novelty 5.0 of 10

    Distributed rollout workers under a bounded-staleness budget can keep a centralized learner saturated and cut LLM post-training cost by roughly a third at matched reward.

Pith tools