Pith. sign in

REVIEW 29 cited by

Accessing GPT-4 level Mathematical Olympiad Solutions via Monte Carlo Tree Self-refine with LLaMa-3 8B

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2406.07394 v2 pith:XYFEDSJV submitted 2024-06-11 cs.AI

classification cs.AI
keywords llmsmathematicalself-refinecarlomctsrmontereasoningtree
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

This paper introduces the MCT Self-Refine (MCTSr) algorithm, an innovative integration of Large Language Models (LLMs) with Monte Carlo Tree Search (MCTS), designed to enhance performance in complex mathematical reasoning tasks. Addressing the challenges of accuracy and reliability in LLMs, particularly in strategic and mathematical reasoning, MCTSr leverages systematic exploration and heuristic self-refine mechanisms to improve decision-making frameworks within LLMs. The algorithm constructs a Monte Carlo search tree through iterative processes of Selection, self-refine, self-evaluation, and Backpropagation, utilizing an improved Upper Confidence Bound (UCB) formula to optimize the exploration-exploitation balance. Extensive experiments demonstrate MCTSr's efficacy in solving Olympiad-level mathematical problems, significantly improving success rates across multiple datasets, including GSM8K, GSM Hard, MATH, and Olympiad-level benchmarks, including Math Odyssey, AIME, and OlympiadBench. The study advances the application of LLMs in complex reasoning tasks and sets a foundation for future AI integration, enhancing decision-making accuracy and reliability in LLM-driven applications.

Discussion (0). Sign in to comment.

Forward citations

Cited by 29 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Optimizing CUDA like a Human: Micro-Profiling Tools as Expert Surrogates for LLM-Based GPU Kernel Optimization

    cs.LG 2026-06 conditional novelty 7.0 of 10

    KernelPro combines LLM code generation, roofline-guided tool orchestration, and domain-adapted MCTS to produce GPU kernels that outperform prior automated and some hand-tuned baselines on KernelBench and VeOmni workloads.

  2. Step-by-Step Optimization-like Reasoning in LLMs over Expanding Search Spaces

    cs.AI 2026-06 unverdicted novelty 7.0 of 10

    Introduces OPT* tasks and two training regimes (solver-guided online policy optimization with rank-based reward shaping and search-based offline RL) plus a theoretical link between search success and information extra...

  3. Alpha-RTL: Test-Time Training for RTL Hardware Optimization

    cs.LG 2026-06 unverdicted novelty 7.0 of 10

    TTT-RTL performs per-design test-time RL on an LLM policy with EDA-derived PPA rewards and an adaptive KL controller, reducing geometric-mean PPA product by 65.1% on RTLLM v2.0 and ADP by 59.4% on an industrial FPU unit.

  4. Regulating Branch Parallelism in LLM Serving

    cs.DC 2026-05 unverdicted novelty 7.0 of 10

    TAPER regulates LLM branch parallelism by admitting extra branches opportunistically when predicted externality fits slack, delivering 1.48-1.77x higher goodput than eager or fixed-cap baselines on Qwen3-32B while kee...

  5. On the Overscaling Curse of Parallel Thinking: System Efficacy Contradicts Sample Efficiency

    cs.LG 2026-01 unverdicted novelty 7.0 of 10

    Parallel thinking in LLMs suffers from overscaling where fixed global budgets waste samples; LanBo predicts per-sample budgets from latent states to raise utilization without hurting accuracy.

  6. Fishing Out Free Riders: Shapley-Based Reward Attribution for Parallel Reasoning via Reinforcement Learning

    cs.AI 2026-07 conditional novelty 6.0 of 10

    Rewarding each parallel reasoning path by Monte-Carlo-Shapley marginal contribution, scored by a generative reward model, lifts Pass@16 on AIME24/AIME25/AMC23 by 4-90% relative over Parallel-R1 with a fifth of the tra...

  7. Online Self-Calibration Against Hallucination in Vision-Language Models

    cs.CV 2026-05 unverdicted novelty 6.0 of 10

    OSCAR exploits the generative-discriminative gap in LVLMs to build online preference data with MCTS and dual-granularity rewards for DPO-based calibration, claiming SOTA hallucination reduction and improved multimodal...

  8. When to Vote, When to Rewrite: Disagreement-Guided Strategy Routing for Test-Time Scaling

    cs.AI 2026-04 unverdicted novelty 6.0 of 10

    A disagreement-guided routing framework dynamically selects among resolution, voting, and rewriting strategies for test-time scaling, delivering 3-7% accuracy gains with lower sampling cost on mathematical benchmarks.

  9. Adaptive Test-Time Compute Allocation for Reasoning LLMs via Constrained Policy Optimization

    cs.LG 2026-04 unverdicted novelty 6.0 of 10

    A Lagrangian-relaxation plus imitation-learning pipeline adaptively allocates test-time compute to LLMs, outperforming uniform baselines by up to 12.8% relative accuracy on MATH while staying within a fixed average budget.

  10. ProbeLLM: Automating Principled Diagnosis of LLM Failures

    cs.CL 2026-02 conditional novelty 6.0 of 10

    An automated LLM probing pipeline using hierarchical Monte Carlo Tree Search, tool-based verification, and failure clustering to discover structured failure modes beyond static benchmarks.

  11. Chain-in-Tree: Back to Sequential Reasoning in LLM Tree Search

    cs.AI 2025-09 conditional novelty 6.0 of 10

    Chain-in-Tree cuts token use, model calls, and runtime by 75-85% in LLM tree search on GSM8K and Math500 by using simple branching-necessity checks, with little accuracy loss in most cases.

  12. DeepSearch: Overcome the Bottleneck of Reinforcement Learning with Verifiable Rewards via Monte Carlo Tree Search

    cs.AI 2025-09 unverdicted novelty 6.0 of 10

    DeepSearch embeds MCTS into RLVR training with global frontier selection, entropy guidance, and adaptive replay to achieve 62.95% average accuracy on math reasoning benchmarks while using 5.7x fewer GPU hours than ext...

  13. AdsQA: Towards Advertisement Video Understanding

    cs.CV 2025-09 conditional novelty 6.0 of 10

    AdsQA adds an ad-video question-answering benchmark and ReAd-R, a GRPO-trained model that beats 7B baselines but not larger closed models.

  14. Parallel-R1: Towards Parallel Thinking via Reinforcement Learning

    cs.CL 2025-09 conditional novelty 6.0 of 10

    Parallel-R1 uses SFT cold-start on easy math plus GRPO on hard math to instill parallel thinking in Qwen3-4B, reporting 8.4% average accuracy gains and a 42.9% AIME25 gain from a parallel-exploration scaffold.

  15. A Simple "Try Again" Can Elicit Multi-Turn LLM Reasoning

    cs.LG 2025-07 conditional novelty 6.0 of 10

    Multi-turn RL with only unary 'try again' feedback improves multi-turn reasoning accuracy by up to 14% while preserving single-turn performance.

  16. Efficient Multi-Agent System Training with Data Influence-Oriented Tree Search

    cs.CL 2025-02 unverdicted novelty 6.0 of 10

    DITS replaces Q-value guidance in MCTS with influence scores for synthetic data synthesis in multi-agent LLM training, claiming better efficiency and performance on eight datasets.

  17. Scientific discovery as meta-optimization: a combinatorial optimization case study

    cs.AI 2026-06 unverdicted novelty 5.0 of 10

    Introduces consensus objective aggregation for meta-optimization of scientific discovery and reports improved scaling and speedup for 3-SAT algorithm discovery using digital MemComputing machines.

  18. When to Vote, When to Rewrite: Disagreement-Guided Strategy Routing for Test-Time Scaling

    cs.AI 2026-04 conditional novelty 5.0 of 10

    A disagreement-based router that decides per math problem whether to accept, majority-vote, or rewrite improves accuracy by 3–7% with fewer samples than fixed test-time scaling methods.

  19. Bilevel Optimization of Agent Skills via Monte Carlo Tree Search

    cs.AI 2026-04 unverdicted novelty 5.0 of 10

    Bilevel optimization with outer-loop MCTS for skill structure and inner-loop LLM refinement improves agent accuracy on an operations-research question-answering dataset.

  20. Automatically Generating Hard Math Problems from Hypothesis-Driven Error Analysis

    cs.AI 2026-04 unverdicted novelty 5.0 of 10

    A hypothesis-driven pipeline generates targeted hard math problems that drop Llama-3.3-70B-Instruct accuracy from 77% on MATH to as low as 45%.

  21. Can Large Models Teach Student Models to Solve Mathematical Problems Like Human Beings? A Reasoning Distillation Method via Multi-LoRA Interaction

    cs.CL 2025-08 unverdicted novelty 5.0 of 10

    A multi-LoRA distillation method with knowledge generation, deep reasoning, and iterative consistency checking improves small-model math reasoning accuracy on GSM8K.

  22. Beyond Surface-Level Detection: Towards Cognitive-Driven Defense Against Jailbreak Attacks via Meta-Operations Reasoning

    cs.AI 2025-08 unverdicted novelty 5.0 of 10

    A jailbreak defense that reasons about hidden manipulations in attack prompts, trained with supervised fine-tuning plus entropy-guided reinforcement learning, generalizes to attacks never seen in training.

  23. EduFlow: Advancing MLLMs' Problem-Solving Proficiency through Multi-Stage, Multi-Perspective Critique

    cs.AI 2025-07 conditional novelty 5.0 of 10

    A multi-stage framework (data filtering, MCTS-guided trajectory construction, PRM-based reranking) improves Qwen MLLMs' accuracy on K-12 multimodal science benchmarks.

  24. Boosting LLM's Molecular Structure Elucidation with Knowledge Enhanced Tree Search Reasoning

    cs.CL 2025-06 conditional novelty 5.0 of 10

    K-MSE adds a substructure knowledge base, a learned molecule-spectrum scorer, and Monte Carlo tree search, lifting LLM exact-match accuracy on MolPuzzle from 3.7% to 27.3% (GPT-4o-mini) and from 27.8% to 57.8% (GPT-4o).

  25. Iterative Zoom-In: Temporal Interval Exploration for Long Video Understanding

    cs.CV 2025-06 conditional novelty 5.0 of 10

    A confidence-guided iterative zoom-in framework improves long-video question answering for multimodal LLMs without any training.

  26. Efficient Graph Understanding with LLMs via Structured Context Injection

    cs.AI 2025-08 conditional novelty 4.0 of 10

    Giving LLMs graph inputs whose nodes are named after Game of Thrones characters, with relationship weights, raises accuracy on four graph-reasoning tasks using a single prompt.

  27. Step-level Verifier-guided Hybrid Test-Time Scaling for Large Language Models

    cs.CL 2025-07 reject novelty 4.0 of 10

    A step-level verifier-guided hybrid of Best-of-N sampling, Monte Carlo tree search, and conditional self-refinement improves reasoning in small instruction-tuned LLMs, claiming up to 28.6-point gains.

  28. Position: How can Graphs Help Large Language Models?

    cs.AI 2026-05 unverdicted novelty 3.0 of 10

    Graphs can help LLMs reduce hallucinations, boost reasoning via prompting techniques, and better process structured data.

  29. From System 1 to System 2: A Survey of Reasoning Large Language Models

    cs.AI 2025-02 accept novelty 3.0 of 10

    The survey organizes the shift of LLMs toward deliberate System 2 reasoning, covering model construction techniques, performance on math and coding benchmarks, and future research directions.

Pith tools