Pith. sign in

REVIEW 22 cited by

Data Interpreter: An LLM Agent For Data Science

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2402.18679 v4 pith:GHUAI744 submitted 2024-02-28 cs.AI cs.LG

Data Interpreter: An LLM Agent For Data Science

classification cs.AI cs.LG
keywords datainterpretersciencegenerationperformanceproblemstasksachieves
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Large Language Model (LLM)-based agents have shown effectiveness across many applications. However, their use in data science scenarios requiring solving long-term interconnected tasks, dynamic data adjustments and domain expertise remains challenging. Previous approaches primarily focus on individual tasks, making it difficult to assess the complete data science workflow. Moreover, they struggle to handle real-time changes in intermediate data and fail to adapt dynamically to evolving task dependencies inherent to data science problems. In this paper, we present Data Interpreter, an LLM-based agent designed to automatically solve various data science problems end-to-end. Our Data Interpreter incorporates two key modules: 1) Hierarchical Graph Modeling, which breaks down complex problems into manageable subproblems, enabling dynamic node generation and graph optimization; and 2) Programmable Node Generation, a technique that refines and verifies each subproblem to iteratively improve code generation results and robustness. Extensive experiments consistently demonstrate the superiority of Data Interpreter. On InfiAgent-DABench, it achieves a 25% performance boost, raising accuracy from 75.9% to 94.9%. For machine learning and open-ended tasks, it improves performance from 88% to 95%, and from 60% to 97%, respectively. Moreover, on the MATH dataset, Data Interpreter achieves remarkable performance with a 26% improvement compared to state-of-the-art baselines. The code is available at https://github.com/geekan/MetaGPT.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 22 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. ASAP: Agent-System Co-Design for Wall-Clock-Centered Auto HPO Research for ML Experiments

    cs.LG 2026-06 unverdicted novelty 7.0

    ASAP integrates an LLM agent over a pool of HPO tools and adds system-level optimizations (prefix-stable prompts, speculation parallelism, Self-Tuner) to improve end-to-end wall-clock performance on diverse HPO tasks.

  2. Figures as Interfaces: Toward LLM-Native Artifacts for Scientific Discovery

    cs.HC 2026-04 unverdicted novelty 7.0

    LLM-native figures embed provenance and enable direct LLM interaction with scientific visualizations to accelerate discovery and improve reproducibility.

  3. A Task-Driven and Quality-Assured Agent Framework for SAR Data Generation

    eess.IV 2026-06 unverdicted novelty 6.0

    SAGA is a schema-grounded agent framework that extracts facts, validates schemas, plans augmentation strategies, and evaluates generated SAR samples for quality and downstream utility.

  4. Trustworthy Self-Composable Big-Data-as-a-Service: An LLM-Orchestrated Multi-Agent Framework for Automated Data Engineering, AutoML, MLOps Deployment, and Drift-Aware Lifecycle Optimization

    cs.MA 2026-06 unverdicted novelty 6.0

    An LLM-orchestrated multi-agent framework for end-to-end BDaaS automation with drift awareness is proposed and evaluated on tabular benchmarks for improved lifecycle reliability over baselines.

  5. OPD-Evolver: Cultivating Holistic Agent Evolver via On-Policy Distillation

    cs.CL 2026-06 unverdicted novelty 6.0

    OPD-Evolver uses on-policy self-distillation in fast interaction and slow attribution loops to build agents with holistic memory competence, outperforming prior systems by up to 11.5% and allowing a 9B model to compet...

  6. CellDX AI Autopilot: Agent-Guided Training and Deployment of Pathology Classifiers

    cs.CV 2026-05 unverdicted novelty 6.0

    CellDX AI Autopilot lets users train pathology classifiers via AI agent skills on a large pre-extracted whole-slide image dataset with automated hyperparameter tuning that claims over 30x cost reduction.

  7. AgentGA: Evolving Code Solutions in Agent-Seed Space

    cs.AI 2026-04 unverdicted novelty 6.0

    AgentGA optimizes agent seeds with genetic algorithms and parent-archive inheritance to improve autonomous code generation, beating a baseline on 15 of 16 Kaggle competitions.

  8. AgentGA: Evolving Code Solutions in Agent-Seed Space

    cs.AI 2026-04 unverdicted novelty 6.0

    AgentGA uses a genetic algorithm to evolve agent seeds and achieves 74.52% human-exceeding performance on tabular AutoML tasks versus 54.15% for the AIDE baseline.

  9. GenoMAS: A Multi-Agent Framework for Scientific Discovery via Code-Driven Gene Expression Analysis

    cs.AI 2025-07 unverdicted novelty 6.0

    GenoMAS deploys six specialized LLM agents with guided planning to preprocess transcriptomic data and identify genes, reaching 89.13% composite similarity and 60.48% F1 on the GenoTEX benchmark while outperforming pri...

  10. MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework

    cs.AI 2023-08 unverdicted novelty 6.0

    MetaGPT embeds human SOPs into LLM prompts to create role-specialized agent teams that produce more coherent solutions on collaborative software engineering tasks than prior chat-based multi-agent systems.

  11. A corrective agentic hybrid RAG and an operations-grounded evaluation for a scientific facility

    physics.acc-ph 2026-07 conditional novelty 5.5

    A deployed hybrid RAG for APS operations improves vital-nugget recall over BM25 mainly via cross-encoder reranking; graph and corrective loops help only marginally on a 50-question facility benchmark.

  12. SCTA: An Agentic Framework for Stable and Interpretable Target Gene Discovery from Single-Cell RNA Sequencing

    cs.LG 2026-07 conditional novelty 5.5

    Decision-centric multi-agent orchestration with structured biological evidence improves repeated-run stability of scRNA-seq therapeutic target gene shortlists versus general agents and ablations.

  13. StarCodex: Dynamic Coding Harness for Starlink Measurement Analysis and Experiment Automation

    eess.SY 2026-07 conditional novelty 5.0

    StarCodex uses Codex with multi-layer validation to convert evolving Starlink measurements into reusable analysis artifacts, matching supervised baselines while automating the workflow.

  14. Agents That Know Too Much: A Data-Centric Survey of Privacy in LLM Agents

    cs.CR 2026-06 unverdicted novelty 5.0

    A data-centric survey finds that only information-flow control covers compositional and cross-session leakage in LLM agents and that no single benchmark tests an agent across all its data surfaces under one policy.

  15. GRACE-DS: a Guarded Reward-guided Agent Correction Environment in Data Science

    cs.CL 2026-06 unverdicted novelty 5.0

    GRACE-DS supplies metrics and a guarded sandbox for end-to-end evaluation of LLM AutoML agents on organization-specific tabular tasks, with flexible iterative interaction outperforming baselines on hidden-test quality...

  16. Towards Persistent Case-Based Memory for Autonomous Data Science: A CBR-Augmented R&D-Agent with a Locally Deployable Small Language Model

    cs.SE 2026-06 unverdicted novelty 5.0

    CBR integration into R&D-Agent with Gemma 4 31B yields directionally higher accuracy and lower variance than baseline on one of two Kaggle competitions.

  17. ProfiliTable: Profiling-Driven Tabular Data Processing via Agentic Workflows

    cs.AI 2026-05 unverdicted novelty 5.0

    ProfiliTable is a profiling-driven multi-agent system that builds semantic context through exploration and closed-loop refinement to produce more reliable tabular data transformations than prior LLM approaches.

  18. ProfiliTable: Profiling-Driven Tabular Data Processing via Agentic Workflows

    cs.AI 2026-05 unverdicted novelty 5.0

    ProfiliTable is a multi-agent system with profiler, generator, and evaluator components that outperforms baselines on 18 tabular task types via dynamic profiling and closed-loop refinement.

  19. AlphaCrafter: Harnessing Multi-Agent Workflows for Cross-Sectional Quantitative Trading

    cs.AI 2026-05 reject novelty 5.0

    A three-agent LLM pipeline for daily cross-sectional equity trading reports robust returns on CSI 300 and S&P 500, but post-hoc trial filtering, best-backbone selection, and missing code/data undermine the headline.

  20. AlphaCrafter: Harnessing Multi-Agent Workflows for Cross-Sectional Quantitative Trading

    cs.AI 2026-05 unverdicted novelty 5.0

    AlphaCrafter deploys Miner, Screener, and Trader agents in a continuously adaptive pipeline that outperforms baselines on CSI 300 and S&P 500 with lower variance in risk-adjusted returns.

  21. Exploring Agentic Workflows for Generating High Quality Math Visual Aids

    cs.AI 2026-07 conditional novelty 4.0

    An exploratory agentic self-improvement loop for TikZ math diagrams yields modest human-rated gains but fails to fix many spatial and coverage errors.

  22. From LLM Reasoning to Autonomous AI Agents: A Comprehensive Review

    cs.AI 2025-04 accept novelty 4.0

    A survey consolidating benchmarks, agent frameworks, real-world applications, and protocols for LLM-based autonomous agents into a proposed taxonomy with recommendations for future research.