Pith. sign in

REVIEW 2 major objections 1 minor 1 cited by

DataPRM improves data analysis agents by detecting silent errors through direct environment interaction and ternary rewards that separate fixable mistakes from fatal ones.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

T0 review · grok-4.3

2026-07-01 09:10 UTC pith:NJVNSFNV

load-bearing objection DataPRM adds environment probing and ternary reflection rewards to handle silent errors and exploration in data analysis agents, with reported lifts on several benchmarks, but the abstract supplies almost no experimental controls or validation details. the 2 major comments →

arxiv 2604.24198 v2 pith:NJVNSFNV submitted 2026-04-27 cs.CL cs.AIcs.CEcs.LGcs.MA

Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysis

Zhisong Qiu , Shuofei Qiao , Kewei Xu , Yuqi Zhu , Lun Du , Ningyu Zhang , Huajun Chen This is my paper
classification cs.CL cs.AIcs.CEcs.LGcs.MA
keywords process reward modelsdata analysis agentslarge language modelssilent errorsreinforcement learningagentic workflowsbenchmark evaluation
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper establishes that general process reward models fail on data analysis agents because they miss silent errors that produce wrong outputs without exceptions and incorrectly penalize useful exploration steps. It introduces DataPRM as an environment-aware model that actively queries execution states to reveal those errors and applies a reflection-aware three-way reward to guide agents more precisely. Training relies on a pipeline that creates diverse trajectories and annotates steps with domain knowledge to produce over 8,000 instances. When used for selection or reinforcement learning, the model lifts performance on multiple agent benchmarks. This approach matters because reliable step-by-step feedback is needed for agents to handle real scientific data workflows without constant human oversight.

Core claim

DataPRM is an environment-aware generative process reward model that serves as an active verifier by autonomously interacting with the environment to probe intermediate execution states and uncover silent errors, while employing a reflection-aware ternary reward strategy that distinguishes between correctable grounding errors and irrecoverable mistakes, trained via a scalable pipeline of diversity-driven trajectory generation and knowledge-augmented step-level annotation on over 8K instances.

What carries the argument

DataPRM, an active verifier that interacts with the code execution environment to detect silent errors and applies reflection-aware ternary rewards to distinguish recoverable from irrecoverable mistakes.

Load-bearing premise

The 8,000 training instances from diversity-driven trajectory generation and knowledge-augmented annotation represent the full variety of data analysis tasks and transfer across different agents and test-time scaling methods.

What would settle it

Apply DataPRM to a new data analysis benchmark that uses previously unseen libraries, data formats, or task structures outside the original 8K training distribution and measure whether the reported accuracy gains over baselines disappear.

Watch this falsifier — get emailed when new claim-graph text bears on it.

If this is right

  • DataPRM raises downstream policy LLM performance by 7.21 percent on ScienceAgentBench and 11.28 percent on DABStep under Best-of-N inference.
  • A 4B-parameter DataPRM outperforms strong baselines and maintains gains across multiple test-time scaling strategies.
  • Inserting DataPRM into reinforcement learning produces 78.73 percent on DABench and 64.84 percent on TableBench, exceeding outcome-reward baselines.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The environment-interaction technique could apply to other agent settings such as web or code navigation where silent failures are common.
  • The ternary reward distinction may reduce reliance on outcome-only signals when training agents for long-horizon scientific tasks.
  • Scaling the annotation pipeline to larger or more diverse data sources might further improve transfer to entirely new domains.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

2 major / 1 minor

Summary. The paper claims that existing general-domain Process Reward Models (PRMs) fail on dynamic data analysis tasks because they cannot detect silent errors (logical flaws without interpreter exceptions) and incorrectly penalize exploratory actions. It introduces DataPRM, an environment-aware generative PRM that actively interacts with the execution environment to probe intermediate states and applies a reflection-aware ternary reward strategy to distinguish correctable grounding errors from irrecoverable mistakes. A scalable pipeline generates over 8K training instances using diversity-driven trajectory generation and knowledge-augmented step-level annotation. Experiments report that DataPRM improves downstream policy LLMs by 7.21% on ScienceAgentBench and 11.28% on DABStep under Best-of-N inference, outperforms baselines at 4B parameters, generalizes across test-time scaling strategies, and when integrated into RL yields 78.73% on DABench and 64.84% on TableBench, outperforming outcome-reward baselines. Code is released.

Significance. If the reported gains are shown to arise specifically from the environment-aware verification and ternary reward mechanisms rather than implementation details, the work would meaningfully extend process supervision from static domains (e.g., mathematics) to agentic, environment-interacting data analysis. The open release of code supports reproducibility and is a clear strength.

major comments (2)
  1. [Experimental Results / Data Construction pipeline] The central claim of robust transfer and generalizability across ScienceAgentBench, DABStep, DABench, and TableBench (and across Best-of-N and RL scaling) rests on the 8K training instances being representative. The abstract and pipeline description provide no explicit cross-task hold-out validation, external annotation audit, or inter-annotator agreement statistics for the diversity-driven trajectories and knowledge-augmented labels; without these, it remains possible that performance gains reflect in-distribution fit rather than the proposed mechanisms.
  2. [Experimental Results] The abstract states performance numbers (7.21%, 11.28%, 78.73%, 64.84%) but supplies no experimental details on baseline definitions, number of runs, statistical significance tests, or ablation isolating the environment-interaction component versus the ternary reward component. These omissions are load-bearing for attributing gains to DataPRM rather than other factors.
minor comments (1)
  1. [Introduction / Empirical Study] The abstract refers to 'an empirical study' but does not indicate where the failure modes of general-domain PRMs are quantified (e.g., error detection rates or exploration penalty rates); adding a dedicated subsection or table would improve clarity.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the constructive feedback on experimental rigor and data construction. We address each major comment below and will revise the manuscript accordingly to provide the requested details and analyses.

read point-by-point responses

  1. Referee: [Experimental Results / Data Construction pipeline] The central claim of robust transfer and generalizability across ScienceAgentBench, DABStep, DABench, and TableBench (and across Best-of-N and RL scaling) rests on the 8K training instances being representative. The abstract and pipeline description provide no explicit cross-task hold-out validation, external annotation audit, or inter-annotator agreement statistics for the diversity-driven trajectories and knowledge-augmented labels; without these, it remains possible that performance gains reflect in-distribution fit rather than the proposed mechanisms.

    Authors: We agree that the absence of explicit cross-task hold-out validation and annotation quality metrics leaves room for the concern about in-distribution fit. The training pipeline uses diversity-driven trajectory generation across multiple data analysis scenarios and knowledge-augmented annotation, and the evaluation benchmarks originate from distinct sources with different task emphases. However, to directly address the point, the revised manuscript will add: (1) a description of how the 8K instances were partitioned to ensure coverage of task categories, (2) results from a cross-task hold-out experiment (training on a subset of task types and evaluating on held-out categories), and (3) inter-annotator agreement statistics computed on a sampled subset of the knowledge-augmented step-level labels. These additions will help substantiate that gains arise from the environment-aware verification and ternary reward mechanisms. revision: yes

  2. Referee: [Experimental Results] The abstract states performance numbers (7.21%, 11.28%, 78.73%, 64.84%) but supplies no experimental details on baseline definitions, number of runs, statistical significance tests, or ablation isolating the environment-interaction component versus the ternary reward component. These omissions are load-bearing for attributing gains to DataPRM rather than other factors.

    Authors: We acknowledge that the current presentation of results lacks sufficient experimental protocol details to fully isolate the contributions of the proposed mechanisms. The manuscript already compares against general-domain PRMs and outcome-reward baselines, but we will expand the Experiments section in revision to: (1) explicitly define all baselines and their configurations, (2) report the number of independent runs with random seeds, (3) include statistical significance tests (e.g., paired t-tests), and (4) add component ablations that separately ablate the active environment interaction (probe states) and the reflection-aware ternary reward. These ablations will quantify the incremental benefit of each element over a standard PRM baseline. revision: yes

Circularity Check

0 steps flagged

No circularity: empirical ML evaluation with no derivation chain

full rationale

This is an empirical paper reporting benchmark results from training DataPRM on 8K instances generated via diversity-driven trajectories and knowledge-augmented annotation, then measuring gains on ScienceAgentBench (+7.21%), DABStep (+11.28%), DABench (78.73% via RL), and TableBench (64.84% via RL). No equations, first-principles derivations, or predictions are claimed; performance numbers are direct experimental outcomes. No self-citations, fitted inputs renamed as predictions, or ansatzes appear in the provided text. The central claims rest on external benchmark comparisons rather than internal self-definition or reduction to the training pipeline itself.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 1 invented entities

The central claim depends on the assumption that process-level signals learned from generated trajectories will generalize to unseen data analysis tasks and that environment interaction can reliably surface silent errors.

axioms (1)
  • domain assumption Process reward models trained on step-level annotations can provide useful supervision for agent trajectories in dynamic environments
    Invoked when claiming that DataPRM will improve policy LLMs; drawn from prior PRM success in mathematics but extended without new justification in the abstract.
invented entities (1)
  • DataPRM no independent evidence
    purpose: Environment-aware generative process reward model with reflection-aware ternary rewards
    New model introduced to address limitations of general-domain PRMs on data analysis tasks.

pith-pipeline@v0.9.1-grok · 5869 in / 1353 out tokens · 34422 ms · 2026-07-01T09:10:40.895070+00:00 · methodology

0 comments
read the original abstract

Process Reward Models (PRMs) have achieved remarkable success in augmenting the reasoning capabilities of Large Language Models (LLMs) within static domains such as mathematics. However, their potential in dynamic data analysis tasks remains underexplored. In this work, we first present a empirical study revealing that general-domain PRMs struggle to supervise data analysis agents. Specifically, they fail to detect silent errors, logical flaws that yield incorrect results without triggering interpreter exceptions, and erroneously penalize exploratory actions, mistaking necessary trial-and-error exploration for grounding failures. To bridge this gap, we introduce DataPRM, a novel environment-aware generative process reward model that (1) can serve as an active verifier, autonomously interacting with the environment to probe intermediate execution states and uncover silent errors, and (2) employs a reflection-aware ternary reward strategy that distinguishes between correctable grounding errors and irrecoverable mistakes. We design a scalable pipeline to construct over 8K high-quality training instances for DataPRM via diversity-driven trajectory generation and knowledge-augmented step-level annotation. Experimental results demonstrate that DataPRM improves downstream policy LLMs by 7.21% on ScienceAgentBench and 11.28% on DABStep using Best-of-N inference. Notably, with only 4B parameters, DataPRM outperforms strong baselines, and exhibits robust generalizability across diverse Test-Time Scaling strategies. Furthermore, integrating DataPRM into Reinforcement Learning yields substantial gains over outcome-reward baselines, achieving 78.73% on DABench and 64.84% on TableBench, validating the effectiveness of process reward supervision. Code is available at https://github.com/zjunlp/DataMind.

Figures

Figures reproduced from arXiv: 2604.24198 by Huajun Chen, Kewei Xu, Lun Du, Ningyu Zhang, Shuofei Qiao, Yuqi Zhu, Zhisong Qiu.

Figure 1
Figure 1. Figure 1: The Collaborative Pipeline Between Data Analysis Agent and Process Reward Model(PRM). The agent addresses data view at source ↗
Figure 2
Figure 2. Figure 2: (a): General PRMs’ Best-of-N performance on subset of DABStep. (b): General PRMs’ scores on steps with grounding view at source ↗
Figure 3
Figure 3. Figure 3: Overview of DataPRM Framework. (a): A diversity-driven trajectory generation strategy followed by knowledge view at source ↗
Figure 4
Figure 4. Figure 4: Performance of DataPRM evaluated under two ex view at source ↗
Figure 5
Figure 5. Figure 5: Experiment results on RL training and benchmarks. (a): The evaluation results on DABench and TableBench for view at source ↗

Review history (2 revisions) →

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. From Table to Cell: Attention for Better Reasoning with TABALIGN

    cs.AI 2026-05 unverdicted novelty 7.0

    TABALIGN pairs a diffusion language model planner emitting binary cell masks with a trained attention verifier, raising average accuracy 15.76 points over strong baselines on eight table benchmarks while speeding exec...

Reference graph

Works this paper leans on

98 extracted references · 98 canonical work pages · cited by 1 Pith paper · 21 internal anchors

  1. [1]

    Amirhossein Abaskohi, Amrutha Varshini Ramesh, Shailesh Nanisetty, Chirag Goel, David Vázquez, Christopher Pal, Spandana Gella, Giuseppe Carenini, and Issam H. Laradji. 2025. AgentAda: Skill-Adaptive Data Analytics for Tailored Insight Discovery.CoRRabs/2504.07421 (2025). arXiv:2504.07421 doi:10.48550/ ARXIV.2504.07421

    work page arXiv 2025

  2. [2]

    Salaheddin Alzubi, Noah Provenzano, Jaydon Bingham, Weiyuan Chen, and Tu Vu. 2026. EvoSkill: Automated Skill Discovery for Multi-Agent Systems.CoRR abs/2603.02766 (2026). arXiv:2603.02766 doi:10.48550/ARXIV.2603.02766

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2603.02766 2026

  3. [3]

    Shuai Bai, Yuxuan Cai, Ruizhe Chen, Keqin Chen, Xionghui Chen, Zesen Cheng, Lianghao Deng, Wei Ding, Chang Gao, Chunjiang Ge, Wenbin Ge, Zhifang Guo, Qidong Huang, Jie Huang, Fei Huang, Binyuan Hui, Shutong Jiang, Zhaohai Li, Mingsheng Li, Mei Li, Kaixin Li, Zicheng Lin, Junyang Lin, Xuejing Liu, Jiawei Liu, Chenglong Liu, Yang Liu, Dayiheng Liu, Shixuan ...

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2511.21631 2025

  4. [4]

    Hyungjoo Chae, Sunghwan Kim, Junhee Cho, Seungone Kim, Seungjun Moon, Gyeom Hwangbo, Dongha Lim, Minjin Kim, Yeonjun Hwang, Minju Gwak, Dongwook Choi, Minseok Kang, Gwanhoon Im, ByeongUng Cho, Hyojun Kim, Jun Hee Han, Taeyoon Kwon, Minju Kim, Beong-woo Kwak, Dongjin Kang, and Jinyoung Yeo. 2025. Web-Shepherd: Advancing PRMs for Reinforcing Web Agents. CoR...

    work page doi:10.48550/arxiv.2505.15277 2025

  5. [5]

    Jingyi Chai, Shuo Tang, Rui Ye, Yuwen Du, Xinyu Zhu, Mengcheng Zhou, Yan- feng Wang, Weinan E, Yuzhi Zhang, Linfeng Zhang, and Siheng Chen. 2025. SciMaster: Towards General-Purpose Scientific AI Agents, Part I. X-Master as Foundation: Can We Lead on Humanity’s Last Exam?CoRRabs/2507.05241 (2025). arXiv:2507.05241 doi:10.48550/ARXIV.2507.05241

    work page Pith review doi:10.48550/arxiv.2507.05241 2025

  6. [6]

    Jiangjie Chen, Wenxiang Chen, Jiacheng Du, Jinyi Hu, Zhicheng Jiang, Allan Jie, Xiaoran Jin, Xing Jin, Chenggang Li, Wenlei Shi, Zhihong Wang, Mingxuan Wang, Chenrui Wei, Shufa Wei, Huajian Xin, Fan Yang, Weihao Gao, Zheng Yuan, Tianyang Zhan, Zeyu Zheng, Tianxi Zhou, and Thomas Hanwen Zhu. 2025. Seed-Prover 1.5: Mastering Undergraduate-Level Theorem Prov...

    work page arXiv 2025

  7. [7]

    Minghao Chen, Yihang Li, Yanting Yang, Shiyu Yu, Binbin Lin, and Xiaofei He. 2024. AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learning. InAdvances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, NeurIPS 2024, Vancouver, BC, Canada, December 10 - 15,...

    work page 2024

  8. [8]

    Qiguang Chen, Libo Qin, Jinhao Liu, Dengyun Peng, Jiannan Guan, Peng Wang, Mengkang Hu, Yuhang Zhou, Te Gao, and Wanxiang Che. 2025. Towards Reason- ing Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Mod- els.CoRRabs/2503.09567 (2025). arXiv:2503.09567 doi:10.48550/ARXIV.2503.09567

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2503.09567 2025

  9. [9]

    Qiguang Chen, Ming-Hsuan Yang, Libo Qin, Jinhao Liu, Zheng Yan, Jiannan Guan, Dengyun Peng, Yiyan Ji, Hanjing Li, Mengkang Hu, Yimeng Zhang, Yihao Liang, Yu Zhou, Jiaqi Wang, Zhi Chen, and Wanxiang Che. 2025. AI4Research: A Survey of Artificial Intelligence for Scientific Research.CoRRabs/2507.01903 (2025). arXiv:2507.01903 doi:10.48550/ARXIV.2507.01903

    work page doi:10.48550/arxiv.2507.01903 2025

  10. [10]

    Baker, Benjamin Burns, Daniel Adu-Ampratwum, Xuhui Huang, Xia Ning, Song Gao, Yu Su, and Huan Sun

    Ziru Chen, Shijie Chen, Yuting Ning, Qianheng Zhang, Boshi Wang, Botao Yu, Yifei Li, Zeyi Liao, Chen Wei, Zitong Lu, Vishal Dey, Mingyi Xue, Frazier N. Baker, Benjamin Burns, Daniel Adu-Ampratwum, Xuhui Huang, Xia Ning, Song Gao, Yu Su, and Huan Sun. 2025. ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discover...

    work page 2025

  11. [11]

    Ganqu Cui, Lifan Yuan, Zefan Wang, Hanbin Wang, Wendi Li, Bingxiang He, Yuchen Fan, Tianyu Yu, Qixin Xu, Weize Chen, Jiarui Yuan, Huayu Chen, Kaiyan Zhang, Xingtai Lv, Shuo Wang, Yuan Yao, Xu Han, Hao Peng, Yu Cheng, Zhiyuan Liu, Maosong Sun, Bowen Zhou, and Ning Ding. 2025. Process Reinforcement through Implicit Rewards.CoRRabs/2502.01456 (2025). arXiv:2...

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  12. [12]

    DeepSeek-AI. 2025. DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models.CoRRabs/2512.02556 (2025). arXiv:2512.02556 doi:10.48550/ARXIV.2512. 02556

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2512 2025

  13. [13]

    Yuyang Ding, Chi Zhang, Juntao Li, Haibin Lin, Xin Liu, and Min Zhang. 2025. FAPO: Flawed-Aware Policy Optimization for Efficient and Reliable Reasoning. CoRRabs/2510.22543 (2025). arXiv:2510.22543 doi:10.48550/ARXIV.2510.22543

    work page doi:10.48550/arxiv.2510.22543 2025

  14. [15]

    Jiazhan Feng, Shijue Huang, Xingwei Qu, Ge Zhang, Yujia Qin, Baoquan Zhong, Chengquan Jiang, Jinxin Chi, and Wanjun Zhong. 2025. ReTool: Reinforce- ment Learning for Strategic Tool Use in LLMs.CoRRabs/2504.11536 (2025). arXiv:2504.11536 doi:10.48550/ARXIV.2504.11536

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2504.11536 2025

  15. [16]

    Shubham Gandhi, Jason Tsay, Jatin Ganhotra, Kiran Kate, and Yara Rizk. 2025. When Agents go Astray: Course-Correcting SWE Agents with PRMs.CoRR abs/2509.02360 (2025). arXiv:2509.02360 doi:10.48550/ARXIV.2509.02360

    work page doi:10.48550/arxiv.2509.02360 2025

  16. [17]

    Xinyan Guan, Yanjiang Liu, Xinyu Lu, Boxi Cao, Ben He, Xianpei Han, Le Sun, Jie Lou, Bowen Yu, Yaojie Lu, and Hongyu Lin. 2024. Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering.CoRRabs/2411.11504 (2024). arXiv:2411.11504 doi:10.48550/ ARXIV.2411.11504

    work page arXiv 2024

  17. [18]

    Sirui Hong, Yizhang Lin, Bang Liu, Bangbang Liu, Binhao Wu, Ceyao Zhang, Danyang Li, Jiaqi Chen, Jiayi Zhang, Jinlin Wang, Li Zhang, Lingyao Zhang, Min Yang, Mingchen Zhuge, Taicheng Guo, Tuo Zhou, Wei Tao, Robert Tang, Xiangtao Lu, Xiawu Zheng, Xinbing Liang, Yaying Fei, Yuheng Cheng, Yongxin Ni, Zhibin Gou, Zongze Xu, Yuyu Luo, and Chenglin Wu. 2025. Da...

    work page 2025

  18. [19]

    Xueyu Hu, Ziyu Zhao, Shuang Wei, Ziwei Chai, Qianli Ma, Guoyin Wang, Xuwu Wang, Jing Su, Jingjing Xu, Ming Zhu, Yao Cheng, Jianbo Yuan, Jiwei Li, Kun Kuang, Yang Yang, Hongxia Yang, and Fei Wu. 2024. InfiAgent-DABench: Evalu- ating Agents on Data Analysis Tasks. InForty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 2...

    work page 2024

  19. [20]

    Liqiang Jing, Zhehui Huang, Xiaoyang Wang, Wenlin Yao, Wenhao Yu, Kaixin Ma, Hongming Zhang, Xinya Du, and Dong Yu. 2025. DSBench: How Far Are Data Science Agents from Becoming Data Science Experts?. InThe Thirteenth International Conference on Learning Representations, ICLR 2025, Singapore, April 24-28, 2025. OpenReview.net. https://openreview.net/forum?...

    work page 2025

  20. [21]

    Muhammad Khalifa, Rishabh Agarwal, Lajanugen Logeswaran, Jaekyeom Kim, Hao Peng, Moontae Lee, Honglak Lee, and Lu Wang. 2025. Process Reward Models That Think.CoRRabs/2504.16828 (2025). arXiv:2504.16828 doi:10.48550/ ARXIV.2504.16828

    work page arXiv 2025

  21. [22]

    Dawei Li, Yuguang Yao, Zhen Tan, Huan Liu, and Ruocheng Guo. 2026. Tool- PRMBench: Evaluating and Advancing Process Reward Models for Tool-using Agents.arXiv preprint arXiv:2601.12294(2026)

    work page arXiv 2026

  22. [23]

    Qingyao Li, Xinyi Dai, Xiangyang Li, Weinan Zhang, Yasheng Wang, Ruim- ing Tang, and Yong Yu. 2025. CodePRM: Execution Feedback-enhanced Pro- cess Reward Model for Code Generation. InFindings of the Association for Computational Linguistics, ACL 2025, Vienna, Austria, July 27 - August 1, 2025, Wanxiang Che, Joyce Nabende, Ekaterina Shutova, and Mohammad T...

    work page 2025

  23. [24]

    Ahmed, Ali Payani, and Huan Sun

    Yifei Li, Hanane Nour Moussa, Ziru Chen, Shijie Chen, Botao Yu, Mingyi Xue, Benjamin Burns, Tzu-Yao Chiu, Vishal Dey, Zitong Lu, Chen Wei, Qianheng Zhang, Tianyu Zhang, Song Gao, Xuhui Huang, Xia Ning, Nesreen K. Ahmed, Ali Payani, and Huan Sun. 2025. AutoSDT: Scaling Data-Driven Discovery Tasks Toward Open Co-Scientists.CoRRabs/2506.08140 (2025). arXiv:2...

    work page doi:10.48550/arxiv.2506.08140 2025

  24. [25]

    Pan, Guilin Qi, Haofen Wang, and Huajun Chen

    Yuan Liang, Ruobin Zhong, Haoming Xu, Chen Jiang, Yi Zhong, Runnan Fang, Jia-Chen Gu, Shumin Deng, Yunzhi Yao, Mengru Wang, Shuofei Qiao, Xin Xu, Tongtong Wu, Kun Wang, Yang Liu, Zhen Bi, Jungang Lou, Yuchen Eleanor Jiang, Hangcheng Zhu, Gang Yu, Haiwen Hong, Longtao Huang, Hui Xue, Chenxi Wang, Yijun Wang, Zifei Shan, Xi Chen, Zhaopeng Tu, Feiyu Xiong, X...

    work page

  25. [26]

    arXiv preprint arXiv:2603.04448 , year=

    SkillNet: Create, Evaluate, and Connect AI Skills.CoRRabs/2603.04448 (2026). arXiv:2603.04448 doi:10.48550/ARXIV.2603.04448

    work page doi:10.48550/arxiv.2603.04448 2026

  26. [27]

    Hunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, and Karl Cobbe. 2024. Let’s Verify Step by Step. InThe Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. OpenReview.net. https://openreview.net/forum?id=v8L0pN6EOi

    work page 2024

  27. [28]

    Jianghao Lin, Yuanyuan Shi, Xin Peng, Renjie Ding, Hairui Wang, Yuxuan Peng, Bizhe Bai, Weixi Song, Fengshuo Bai, Huacan Chai, Weinan Zhang, Fei Huang, and Ying Wen. 2025. ToolPRM: Fine-Grained Inference Scaling of Structured Conference acronym ’XX, June 03–05, 2018, Woodstock, NY Qiu et al. Outputs for Function Calling.CoRRabs/2510.14703 (2025). arXiv:25...

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2510.14703 2025

  28. [29]

    Runze Liu, Junqi Gao, Jian Zhao, Kaiyan Zhang, Xiu Li, Biqing Qi, Wanli Ouyang, and Bowen Zhou. 2025. Can 1B LLM Surpass 405B LLM? Rethinking Compute- Optimal Test-Time Scaling.CoRRabs/2502.06703 (2025). arXiv:2502.06703 doi:10. 48550/ARXIV.2502.06703

    work page arXiv 2025

  29. [30]

    Shicheng Liu, Yucheng Jiang, Sajid Farook, Camila Nicollier Sanchez, David Fernando Castro Pena, and Monica S. Lam. 2026. DataSTORM: Deep Research on Large-Scale Databases using Exploratory Data Analysis and Data Storytelling. https://api.semanticscholar.org/CorpusID:287248168

    work page 2026

  30. [31]

    Wei Liu, Peijie Yu, Michele Orini, Yali Du, and Yulan He. 2026. Hunt Instead of Wait: Evaluating Deep Data Research on Large Language Models.arXiv preprint arXiv:2602.02039(2026)

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  31. [32]

    Xiaoqian Liu, Ke Wang, Yuchuan Wu, Fei Huang, Yongbin Li, Junge Zhang, and Jianbin Jiao. 2025. Agentic Reinforcement Learning with Implicit Step Rewards. CoRRabs/2509.19199 (2025). arXiv:2509.19199 doi:10.48550/ARXIV.2509.19199

    work page doi:10.48550/arxiv.2509.19199 2025

  32. [34]

    Liangchen Luo, Yinxiao Liu, Rosanne Liu, Samrat Phatale, Harsh Lara, Yunxuan Li, Lei Shu, Yun Zhu, Lei Meng, Jiao Sun, and Abhinav Rastogi. 2024. Improve Mathematical Reasoning in Language Models by Automated Process Supervision. CoRRabs/2406.06592 (2024). arXiv:2406.06592 doi:10.48550/ARXIV.2406.06592

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2406.06592 2024

  33. [35]

    Thang Luong, Dawsen Hwang, Hoang H. Nguyen, Golnaz Ghiasi, Yuri Cher- vonyi, Insuk Seo, Junsu Kim, Garrett Bingham, Jonathan Lee, Swaroop Mishra, Alex Zhai, Clara Huiyi Hu, Henryk Michalewski, Jimin Kim, Jeonghyun Ahn, Junhwi Bae, Xingyou Song, Trieu H. Trinh, Quoc V. Le, and Junehyuk Jung. 2025. Towards Robust Mathematical Reasoning. InProceedings of the...

    work page doi:10.18653/v1/2025.emnlp-main.1794 2025

  34. [36]

    Pingchuan Ma, Rui Ding, Shuai Wang, Shi Han, and Dongmei Zhang. 2023. In- sightPilot: An LLM-Empowered Automated Data Exploration System. InProceed- ings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023 - System Demonstrations, Singapore, December 6-10, 2023, Yansong Feng and Els Lefever (Eds.). Association for Comput...

    work page doi:10.18653/v1/2023.emnlp-demo.31 2023

  35. [37]

    Jaehyun Nam, Jinsung Yoon, Jiefeng Chen, and Tomas Pfister. 2025. DS-STAR: Data Science Agent via Iterative Planning and Verification.CoRRabs/2509.21825 (2025). arXiv:2509.21825 doi:10.48550/ARXIV.2509.21825

    work page doi:10.48550/arxiv.2509.21825 2025

  36. [38]

    Jingwei Ni, Yihao Liu, Xinpeng Liu, Yutao Sun, Mengyu Zhou, Pengyu Cheng, Dexin Wang, Erchao Zhao, Xiaoxi Jiang, and Guanjun Jiang. 2026. Trace2Skill: Dis- till Trajectory-Local Lessons into Transferable Agent Skills.CoRRabs/2603.25158 (2026). arXiv:2603.25158 doi:10.48550/ARXIV.2603.25158

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2603.25158 2026

  37. [39]

    Fan Nie, Junlin Wang, Harper Hua, Federico Bianchi, Yongchan Kwon, Zhenting Qi, Owen Queen, Shang Zhu, and James Zou. 2026. DSGym: A Holistic Framework for Evaluating and Training Data Science Agents.arXiv preprint arXiv:2601.16344 (2026)

    work page arXiv 2026

  38. [40]

    Ruyi Qi, Zhou Liu, and Wentao Zhang. 2026. DataCross: A Unified Benchmark and Agent Framework for Cross-Modal Heterogeneous Data Analysis.ArXiv abs/2601.21403 (2026). https://api.semanticscholar.org/CorpusID:285140426

    work page arXiv 2026

  39. [41]

    Cheng Qian, Emre Can Acikgoz, Qi He, Hongru Wang, Xiusi Chen, Dilek Hakkani- Tür, Gokhan Tur, and Heng Ji. 2025. ToolRL: Reward is All Tool Learning Needs. CoRRabs/2504.13958 (2025). arXiv:2504.13958 doi:10.48550/ARXIV.2504.13958

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2504.13958 2025

  40. [42]

    Shuofei Qiao, Yixin Ou, Ningyu Zhang, Xiang Chen, Yunzhi Yao, Shumin Deng, Chuanqi Tan, Fei Huang, and Huajun Chen. 2023. Reasoning with Language Model Prompting: A Survey. InProceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2023, Toronto, Canada, July 9-14, 2023, Anna Rogers, Jordan L. Bo...

    work page 2023

  41. [43]

    Shuofei Qiao, Yanqiu Zhao, Zhisong Qiu, Xiaobin Wang, Jintian Zhang, Zhao Bin, Ningyu Zhang, Yong Jiang, Pengjun Xie, Fei Huang, and Huajun Chen

    work page

  42. [44]

    arXiv:2509.25084 doi:10.48550/ARXIV.2509.25084

    Scaling Generalist Data-Analytic Agents.CoRRabs/2509.25084 (2025). arXiv:2509.25084 doi:10.48550/ARXIV.2509.25084

    work page doi:10.48550/arxiv.2509.25084 2025

  43. [45]

    Salman Rahman, Sruthi Gorantla, Arpit Gupta, Swastik Roy, Nanyun Peng, and Yang Liu. 2025. SPARK: Stepwise Process-Aware Rewards for Reference-Free Reinforcement Learning.CoRRabs/2512.03244 (2025). arXiv:2512.03244 doi:10. 48550/ARXIV.2512.03244

    work page arXiv 2025

  44. [46]

    Z. Z. Ren, Zhihong Shao, Junxiao Song, Huajian Xin, Haocheng Wang, Wanjia Zhao, Liyue Zhang, Zhe Fu, Qihao Zhu, Dejian Yang, Z. F. Wu, Zhibin Gou, Shirong Ma, Hongxuan Tang, Yuxuan Liu, Wenjun Gao, Daya Guo, and Chong Ruan. 2025. DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decomposition.CoRRabs/2504.2...

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2504.21801 2025

  45. [47]

    Samuel Schmidgall, Yusheng Su, Ze Wang, Ximeng Sun, Jialian Wu, Xiaodong Yu, Jiang Liu, Zicheng Liu, and Emad Barsoum. 2025. Agent Laboratory: Using LLM Agents as Research Assistants.CoRRabs/2501.04227 (2025). arXiv:2501.04227 doi:10.48550/ARXIV.2501.04227

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2501.04227 2025

  46. [48]

    Amrith Setlur, Chirag Nagpal, Adam Fisch, Xinyang Geng, Jacob Eisenstein, Rishabh Agarwal, Alekh Agarwal, Jonathan Berant, and Aviral Kumar. 2025. Rewarding Progress: Scaling Automated Process Verifiers for LLM Reasoning. In The Thirteenth International Conference on Learning Representations, ICLR 2025, Singapore, April 24-28, 2025. OpenReview.net. https:...

    work page 2025

  47. [49]

    Zhihong Shao, Yuxiang Luo, Chengda Lu, Z. Z. Ren, Jiewen Hu, Tian Ye, Zhibin Gou, Shirong Ma, and Xiaokang Zhang. 2025. DeepSeekMath-V2: Towards Self- Verifiable Mathematical Reasoning.CoRRabs/2511.22570 (2025). arXiv:2511.22570 doi:10.48550/ARXIV.2511.22570

    work page doi:10.48550/arxiv.2511.22570 2025

  48. [50]

    Zhihong Shao, Peiyi Wang, Qihao Zhu, Runxin Xu, Junxiao Song, Mingchuan Zhang, Y. K. Li, Y. Wu, and Daya Guo. 2024. DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models.CoRRabs/2402.03300 (2024). arXiv:2402.03300 doi:10.48550/ARXIV.2402.03300

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2402.03300 2024

  49. [51]

    Guangming Sheng, Chi Zhang, Zilingfeng Ye, Xibin Wu, Wang Zhang, Ru Zhang, Yanghua Peng, Haibin Lin, and Chuan Wu. 2025. HybridFlow: A Flexible and Efficient RLHF Framework. InProceedings of the Twentieth European Conference on Computer Systems, EuroSys 2025, Rotterdam, The Netherlands, 30 March 2025 - 3 April 2025. ACM, 1279–1297. doi:10.1145/3689031.3696075

    work page doi:10.1145/3689031.3696075 2025

  50. [52]

    Charlie Snell, Jaehoon Lee, Kelvin Xu, and Aviral Kumar. 2024. Scaling LLM Test- Time Compute Optimally can be More Effective than Scaling Model Parameters. CoRRabs/2408.03314 (2024). arXiv:2408.03314 doi:10.48550/ARXIV.2408.03314

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2408.03314 2024

  51. [53]

    Ji Sun, Guoliang Li, Peiyao Zhou, Yihui Ma, Jingzhe Xu, and Yuan Li. 2025. AgenticData: An Agentic Data Analytics System for Heterogeneous Data.CoRR abs/2508.05002 (2025). arXiv:2508.05002 doi:10.48550/ARXIV.2508.05002

    work page internal anchor Pith review doi:10.48550/arxiv.2508.05002 2025

  52. [55]

    Chenxi Wang, Zhuoyun Yu, Xinghong Xie, Wuguannan Yao, Runnan Fang, Shuofei Qiao, Kexin Cao, Guozhou Zheng, Xiang Qi, Peng Zhang, and Shumin Deng. 2026. SkillX: Automatically Constructing Skill Knowledge Bases for Agents. https://api.semanticscholar.org/CorpusID:287204111

    work page 2026

  53. [56]

    Peiyi Wang, Lei Li, Zhihong Shao, Runxin Xu, Damai Dai, Yifei Li, Deli Chen, Yu Wu, and Zhifang Sui. 2024. Math-Shepherd: Verify and Reinforce LLMs Step- by-step without Human Annotations. InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2024, Bangkok, Thailand, August 11-16, 2024, Lun-...

    work page doi:10.18653/v1/2024.acl-long.510 2024

  54. [57]

    Peiran Wang, Yaoning Yu, Ke Chen, Xianyang Zhan, and Haohan Wang. 2025. Large Language Model-based Data Science Agent: A Survey.CoRRabs/2508.02744 (2025). arXiv:2508.02744 doi:10.48550/ARXIV.2508.02744

    work page doi:10.48550/arxiv.2508.02744 2025

  55. [58]

    Tongyu Wen, Guanting Dong, and Zhicheng Dou. 2026. SmartSearch: Pro- cess Reward-Guided Query Refinement for Search Agents.arXiv preprint arXiv:2601.04888(2026)

    work page arXiv 2026

  56. [59]

    Xianjie Wu, Jian Yang, Linzheng Chai, Ge Zhang, Jiaheng Liu, Xeron Du, Di Liang, Daixin Shu, Xianfu Cheng, Tianzhen Sun, Tongliang Li, Zhoujun Li, and Guanglin Niu. 2025. TableBench: A Comprehensive and Complex Benchmark for Table Question Answering. InAAAI-25, Sponsored by the Association for the Advancement of Artificial Intelligence, February 25 - Marc...

    work page doi:10.1609/aaai.v39i24.34739 2025

  57. [60]

    Zhiheng Xi, Chenyang Liao, Guanyu Li, Yajie Yang, Wenxiang Chen, Zhihao Zhang, Binghai Wang, Senjie Jin, Yuhao Zhou, Jian Guan, Wei Wu, Tao Ji, Tao Gui, Qi Zhang, and Xuanjing Huang. 2025. AgentPRM: Process Reward Models for LLM Agents via Step-Wise Promise and Progress.CoRRabs/2511.08325 (2025). arXiv:2511.08325 doi:10.48550/ARXIV.2511.08325

    work page doi:10.48550/arxiv.2511.08325 2025

  58. [61]

    Wenyi Xu, Yuren Mao, Xiaolu Zhang, Chao Zhang, Xuemei Dong, Mengfei Zhang, and Yunjun Gao. 2025. DAgent: A Relational Database-Driven Data Analysis Report Generation Agent.CoRRabs/2503.13269 (2025). arXiv:2503.13269 doi:10.48550/ARXIV.2503.13269

    work page doi:10.48550/arxiv.2503.13269 2025

  59. [62]

    An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, Chujie Zheng, Dayiheng Liu, Fan Zhou, Fei Huang, Feng Hu, Hao Ge, Haoran Wei, Huan Lin, Jialong Tang, Jian Yang, Jianhong Tu, Jianwei Zhang, Jian Yang, Jiaxi Yang, Jingren Zhou, Junyang Lin, Kai Dang, Keqin Bao, Kexin Yang, Le Yu, Liangha...

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2505.09388 2025

  60. [63]

    Zhiyu Yang, Zihan Zhou, Shuo Wang, Xin Cong, Xu Han, Yukun Yan, Zheng- hao Liu, Zhixing Tan, Pengyuan Liu, Dong Yu, Zhiyuan Liu, Xiaodong Shi, and Maosong Sun. 2024. MatPlotAgent: Method and Evaluation for LLM-Based Agen- tic Scientific Data Visualization. InFindings of the Association for Computational Linguistics, ACL 2024, Bangkok, Thailand and virtual...

    work page doi:10.18653/v1/2024.findings-acl.701 2024

  61. [64]

    Narasimhan, and Yuan Cao

    Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik R. Narasimhan, and Yuan Cao. 2023. ReAct: Synergizing Reasoning and Acting in Language Models. InThe Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net. https://openreview. net/forum?id=WE_vluYUL-X

    work page 2023

  62. [65]

    Ziming You, Yumiao Zhang, Dexuan Xu, Yiwei Lou, Yandong Yan, Wei Wang, Huaming Zhang, and Yu Huang. 2025. DatawiseAgent: A Notebook-Centric LLM Agent Framework for Automated Data Science.CoRRabs/2503.07044 (2025). arXiv:2503.07044 doi:10.48550/ARXIV.2503.07044

    work page doi:10.48550/arxiv.2503.07044 2025

  63. [66]

    Qiying Yu, Zheng Zhang, Ruofei Zhu, Yufeng Yuan, Xiaochen Zuo, Yu Yue, Tiantian Fan, Gaohong Liu, Lingjun Liu, Xin Liu, Haibin Lin, Zhiqi Lin, Bole Ma, Guangming Sheng, Yuxuan Tong, Chi Zhang, Mofan Zhang, Wang Zhang, Hang Zhu, Jinhua Zhu, Jiaze Chen, Jiangjie Chen, Chengyi Wang, Hongli Yu, Weinan Dai, Yuxuan Song, Xiangpeng Wei, Hao Zhou, Jingjing Liu, W...

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2503.14476 2025

  64. [67]

    Zhuohao Yu, Weizheng Gu, Yidong Wang, Zhengran Zeng, Jindong Wang, Wei Ye, and Shikun Zhang. 2024. Outcome-Refining Process Supervision for Code Generation.CoRRabs/2412.15118 (2024). arXiv:2412.15118 doi:10.48550/ARXIV. 2412.15118

    work page internal anchor Pith review doi:10.48550/arxiv 2024

  65. [68]

    Weizhe Yuan, Richard Yuanzhe Pang, Kyunghyun Cho, Xian Li, Sainbayar Sukhbaatar, Jing Xu, and Jason Weston. 2024. Self-Rewarding Language Models. InForty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. OpenReview.net. https://openreview.net/forum?id= 0NphYCmgua

    work page 2024

  66. [69]

    Hanrong Zhang, Shichen Fan, Henry Peng Zou, Yankai Chen, Zhenting Wang, Jiayuan Zhou, Chengze Li, Wei-Chieh Huang, Yifei Yao, Kening Zheng, Xue Liu, Xiaoxiao Li, and Philip S. Yu. 2026. CoEvoSkills: Self-Evolving Agent Skills via Co- Evolutionary Verification. https://api.semanticscholar.org/CorpusID:287071917

    work page 2026

  67. [70]

    Ruiyi Zhang, Peijia Qin, Qi Cao, Eric Xue, and Pengtao Xie. 2026. FunPRM: Function-as-Step Process Reward Model with Meta Reward Correction for Code Generation.arXiv preprint arXiv:2601.22249(2026)

    work page arXiv 2026

  68. [71]

    Shaolei Zhang, Ju Fan, Meihao Fan, Guoliang Li, and Xiaoyong Du. 2025. Deep- Analyze: Agentic Large Language Models for Autonomous Data Science.CoRR abs/2510.16872 (2025). arXiv:2510.16872 doi:10.48550/ARXIV.2510.16872

    work page doi:10.48550/arxiv.2510.16872 2025

  69. [72]

    Shimao Zhang, Xiao Liu, Xin Zhang, Junxiao Liu, Zheheng Luo, Shujian Huang, and Yeyun Gong. 2025. Process-based Self-Rewarding Language Models. InFind- ings of the Association for Computational Linguistics, ACL 2025, Vienna, Austria, July 27 - August 1, 2025, Wanxiang Che, Joyce Nabende, Ekaterina Shutova, and Mohammad Taher Pilehvar (Eds.). Association f...

    work page 2025

  70. [73]

    Wenlin Zhang, Xiaopeng Li, Yingyi Zhang, Pengyue Jia, Yichao Wang, Huifeng Guo, Yong Liu, and Xiangyu Zhao. 2025. Deep Research: A Survey of Autonomous Research Agents.CoRRabs/2508.12752 (2025). arXiv:2508.12752 doi:10.48550/ ARXIV.2508.12752

    work page Pith review arXiv 2025

  71. [74]

    Wenqi Zhang, Yongliang Shen, Weiming Lu, and Yueting Zhuang. 2023. Data- Copilot: Bridging Billions of Data and Humans with Autonomous Workflow. CoRRabs/2306.07209 (2023). arXiv:2306.07209 doi:10.48550/ARXIV.2306.07209

    work page doi:10.48550/arxiv.2306.07209 2023

  72. [75]

    Yuxin Zhang, Meihao Fan, Ju Fan, Mingyang Yi, Yuyu Luo, Jian Tan, and Guoliang Li. 2025. Reward-SQL: Boosting Text-to-SQL via Stepwise Reasoning and Process- Supervised Rewards.CoRRabs/2505.04671 (2025). arXiv:2505.04671 doi:10.48550/ ARXIV.2505.04671

    work page arXiv 2025

  73. [76]

    Zhenru Zhang, Chujie Zheng, Yangzhen Wu, Beichen Zhang, Runji Lin, Bowen Yu, Dayiheng Liu, Jingren Zhou, and Junyang Lin. 2025. The Lessons of Developing Process Reward Models in Mathematical Reasoning. InFindings of the Association for Computational Linguistics, ACL 2025, Vienna, Austria, July 27 - August 1, 2025, Wanxiang Che, Joyce Nabende, Ekaterina S...

    work page 2025

  74. [77]

    Jian Zhao, Runze Liu, Kaiyan Zhang, Zhimu Zhou, Junqi Gao, Dong Li, Jiafei Lyu, Zhouyi Qian, Biqing Qi, Xiu Li, and Bowen Zhou. 2025. GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning.CoRR abs/2504.00891 (2025). arXiv:2504.00891 doi:10.48550/ARXIV.2504.00891

    work page doi:10.48550/arxiv.2504.00891 2025

  75. [78]

    Yuze Zhao, Jintao Huang, Jinghan Hu, Xingjun Wang, Yunlin Mao, Daoze Zhang, Zeyinzi Jiang, Zhikai Wu, Baole Ai, Ang Wang, Wenmeng Zhou, and Yingda Chen. 2025. SWIFT: A Scalable Lightweight Infrastructure for Fine-Tuning. In AAAI-25, Sponsored by the Association for the Advancement of Artificial Intelligence, February 25 - March 4, 2025, Philadelphia, PA, ...

    work page doi:10.1609/aaai.v39i28.35383 2025

  76. [79]

    Congming Zheng, Jiachen Zhu, Zhuoying Ou, Yuxiang Chen, Kangning Zhang, Rong Shan, Zeyu Zheng, Mengyue Yang, Jianghao Lin, Yong Yu, and Weinan Zhang. 2025. A Survey of Process Reward Models: From Outcome Signals to Process Supervisions for Large Language Models.CoRRabs/2510.08049 (2025). arXiv:2510.08049 doi:10.48550/ARXIV.2510.08049

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2510.08049 2025

  77. [80]

    Xing, Hao Zhang, Joseph E

    Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, and Ion Stoica. 2023. Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena. InAdvances in Neural Information Pro- cessing Systems 36: Annual Conference on Neural Information Processing Sys- t...

    work page 2023

  78. [81]

    Yuanchen Zhou, Shuo Jiang, Jie Zhu, Junhui Li, Lifan Guo, Feng Chen, and Chi Zhang. 2025. Fin-PRM: A Domain-Specialized Process Reward Model for Financial Reasoning in Large Language Models.CoRRabs/2508.15202 (2025). arXiv:2508.15202 doi:10.48550/ARXIV.2508.15202

    work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2508.15202 2025

  79. [82]

    Yizhang Zhu, Liangwei Wang, Chenyu Yang, Xiaotian Lin, Boyan Li, Wei Zhou, Xinyu Liu, Zhangyang Peng, Tianqi Luo, Yu Li, Chengliang Chai, Chong Chen, Shimin Di, Ju Fan, Ji Sun, Nan Tang, Fugee Tsung, Jiannan Wang, Chenglin Wu, Yanwei Xu, Shaolei Zhang, Yong Zhang, Xuanhe Zhou, Guoliang Li, and Yuyu Luo

    work page

  80. [83]

    arXiv preprint arXiv:2510.23587 , year=

    A Survey of Data Agents: Emerging Paradigm or Overstated Hype?ArXiv abs/2510.23587 (2025). https://api.semanticscholar.org/CorpusID:282389107

    work page arXiv 2025

Showing first 80 references.