Pith. sign in

REVIEW 5 cited by

AutoKaggle: A Multi-Agent Framework for Autonomous Data Science Competitions

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2410.20424 v3 pith:G6PPFFMF submitted 2024-10-27 cs.AI cs.CL

Ziming Li , Qianbo Zang , David Ma , Jiawei Guo , Tuney Zheng , Minghao Liu , Xinyao Niu , Yue Wang
show 6 more authors
Jian Yang Jiaheng Liu Wanjun Zhong Wangchunshu Zhou Wenhao Huang Ge Zhang
This is my paper
classification cs.AIcs.CL
keywords datascienceautokaggleframeworktaskscodecompetitionscomplex
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Data science tasks involving tabular data present complex challenges that require sophisticated problem-solving approaches. We propose AutoKaggle, a powerful and user-centric framework that assists data scientists in completing daily data pipelines through a collaborative multi-agent system. AutoKaggle implements an iterative development process that combines code execution, debugging, and comprehensive unit testing to ensure code correctness and logic consistency. The framework offers highly customizable workflows, allowing users to intervene at each phase, thus integrating automated intelligence with human expertise. Our universal data science toolkit, comprising validated functions for data cleaning, feature engineering, and modeling, forms the foundation of this solution, enhancing productivity by streamlining common tasks. We selected 8 Kaggle competitions to simulate data processing workflows in real-world application scenarios. Evaluation results demonstrate that AutoKaggle achieves a validation submission rate of 0.85 and a comprehensive score of 0.82 in typical data science pipelines, fully proving its effectiveness and practicality in handling complex data science tasks.

Discussion (0). Sign in to comment.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. SWE-Flow: Synthesizing Software Engineering Data in a Test-Driven Manner

    cs.CL 2025-06 conditional novelty 7.0 of 10

    SWE-Flow synthesizes incremental, test-driven development tasks from real GitHub projects and shows that fine-tuning Qwen2.5-Coder-32B-Instruct on them improves performance on the resulting SWE-Flow-Bench benchmark.

  2. Reinforcement Learning for Machine Learning Engineering Agents

    cs.LG 2025-09 conditional novelty 6.0 of 10

    RL-trained Qwen2.5-3B outperforms prompted Claude-3.5-Sonnet and GPT-4o on 12 MLEBench tasks by an average of 22% and 24%, using two targeted RL modifications.

  3. IFEvalCode: Controlled Code Generation

    cs.CL 2025-07 conditional novelty 6.0 of 10

    A 1,620-sample, 8-language, Chinese/English benchmark separates code correctness from instruction-following and shows instruction compliance is far lower than correctness across 40+ LLMs.

  4. Coding Triangle: How Does Large Language Model Understand Code?

    cs.CL 2025-07 conditional novelty 6.0 of 10

    The Coding Triangle framework evaluates LLMs on editorials, code, and test cases, revealing that models are self-consistent yet lack diversity and that model mixtures improve robustness.

  5. Matryoshka Agent: Unfolding Sub-Agents for Long-Horizon Machine Learning Engineering

    cs.AI 2026-07 conditional novelty 5.0 of 10

    Matryoshka Agent’s orchestrator–sub-agent hierarchy plus tree-ranked RL raises MLE-Dojo HumanRank, letting a 4B orchestrator approach o4-mini and giving a 30B coder up to 36.7% relative gain.

Pith tools