Pith. sign in

REVIEW 5 cited by

SciAgent: Tool-augmented Language Models for Scientific Reasoning

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2402.11451 v2 pith:V4AUPFAZ submitted 2024-02-18 cs.CL cs.AI

Yubo Ma , Zhibin Gou , Junheng Hao , Ruochen Xu , Shuohang Wang , Liangming Pan , Yujiu Yang , Yixin Cao
show 3 more authors
Aixin Sun Hany Awadalla Weizhu Chen
This is my paper
classification cs.CLcs.AI
keywords llmsscientificreasoningsciagentsettingtool-augmentedlanguagemathfunc
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Scientific reasoning poses an excessive challenge for even the most advanced Large Language Models (LLMs). To make this task more practical and solvable for LLMs, we introduce a new task setting named tool-augmented scientific reasoning. This setting supplements LLMs with scalable toolsets, and shifts the focus from pursuing an omniscient problem solver to a proficient tool-user. To facilitate the research of such setting, we construct a tool-augmented training corpus named MathFunc which encompasses over 30,000 samples and roughly 6,000 tools. Building on MathFunc, we develop SciAgent to retrieve, understand and, if necessary, use tools for scientific problem solving. Additionally, we craft a benchmark, SciToolBench, spanning five scientific domains to evaluate LLMs' abilities with tool assistance. Extensive experiments on SciToolBench confirm the effectiveness of SciAgent. Notably, SciAgent-Mistral-7B surpasses other LLMs with the same size by more than 13% in absolute accuracy. Furthermore, SciAgent-DeepMath-7B shows much superior performance than ChatGPT.

Discussion (0). Sign in to comment.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. NNStar: An end-to-end AI agent for nuclear matter and neutron star physics

    nucl-th 2026-07 conditional novelty 6.0 of 10

    NNStar packages the RMF-to-neutron-star pipeline as a portable LLM-agent skill, validated on TM1/NL3/FSU-δ6.7 and demonstrated by an autonomous σ6-extended TM1 fit.

  2. SciAgentGym: Benchmarking Multi-Step Scientific Tool-use in LLM Agents

    cs.CL 2026-02 conditional novelty 6.0 of 10

    SciAgent-8B, fine-tuned on trajectories synthesized from a tool dependency graph, outperforms Qwen3-VL-235B-Instruct on SciAgentBench, a new 259-task benchmark for multi-step scientific tool-use.

  3. An Auditable Agent Platform For Automated Molecular Optimisation

    cs.LG 2025-08 conditional novelty 5.0 of 10

    A hierarchical multi-agent LLM platform with recorded provenance improved average predicted binding affinity for AKT1 by 31%, while single-agent runs favored drug-likeness.

  4. CheMatAgent: Enhancing LLMs for Chemistry and Materials Science through Tree-Search Based Tool Learning

    cs.LG 2025-06 conditional novelty 5.0 of 10

    CheMatAgent uses hierarchical Monte Carlo tree search with separate policy and execution models, plus trained reward models, to improve tool selection and parameter filling on a new chemistry benchmark, ChemToolBench.

  5. Toward Efficient Agents: Memory, Tool learning, and Planning

    cs.AI 2026-01 conditional novelty 3.0 of 10

    A survey that organizes efficiency techniques for LLM agents into memory, tool learning, and planning, and consolidates benchmarks and metrics for measuring cost-performance trade-offs.

Pith tools