Pith. sign in

REVIEW 12 cited by

AutoML-GPT: Automatic Machine Learning with GPT

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2305.02499 v1 pith:FMXL2OYU submitted 2023-05-04 cs.CL cs.AIcs.CVcs.LGstat.ML

Shujian Zhang , Chengyue Gong , Lemeng Wu , Xingchao Liu , Mingyuan Zhou This is my paper
classification cs.CLcs.AIcs.CVcs.LGstat.ML
keywords automl-gptmodelstaskslanguagemodelarchitectureautomaticallycapabilities
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

AI tasks encompass a wide range of domains and fields. While numerous AI models have been designed for specific tasks and applications, they often require considerable human efforts in finding the right model architecture, optimization algorithm, and hyperparameters. Recent advances in large language models (LLMs) like ChatGPT show remarkable capabilities in various aspects of reasoning, comprehension, and interaction. Consequently, we propose developing task-oriented prompts and automatically utilizing LLMs to automate the training pipeline. To implement this concept, we present the AutoML-GPT, which employs GPT as the bridge to diverse AI models and dynamically trains models with optimized hyperparameters. AutoML-GPT dynamically takes user requests from the model and data cards and composes the corresponding prompt paragraph. Ultimately, with this prompt paragraph, AutoML-GPT will automatically conduct the experiments from data processing to model architecture, hyperparameter tuning, and predicted training log. By leveraging {\ours}'s robust language capabilities and the available AI models, AutoML-GPT can tackle numerous intricate AI tasks across various tasks and datasets. This approach achieves remarkable results in computer vision, natural language processing, and other challenging areas. Extensive experiments and ablation studies demonstrate that our method can be general, effective, and beneficial for many AI tasks.

Discussion (0). Sign in to comment.

Forward citations

Cited by 12 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Delta-Based Neural Architecture Search: LLM Fine-Tuning via Code Diffs

    cs.LG 2026-05 unverdicted novelty 7.0 of 10

    Fine-tuned 7B LLMs generating unified diffs for neural architecture refinement achieve 66-75% valid rates and 64-66% mean first-epoch accuracy, outperforming full-generation baselines by large margins while cutting ou...

  2. WizardLM: Empowering large pre-trained language models to follow complex instructions

    cs.CL 2023-04 conditional novelty 7.0 of 10

    WizardLM uses LLM-driven iterative rewriting to generate complex instruction data and fine-tunes LLaMA to reach over 90% of ChatGPT capacity on 17 of 29 evaluated skills.

  3. Agentic Bayesian Optimization through Surrogate-Augmented Autoresearch

    cs.LG 2026-07 conditional novelty 6.0 of 10

    An LLM agent that fully controls a reconfigurable Bayesian-optimization backend preserves standard BO reliability, outperforms LLM-only optimizers, and exploits natural-language priors and mid-run problem reformulation.

  4. LLM-Driven Heuristic Frame-Level Quantization Parameter Adaptation for VVenC

    eess.IV 2026-06 unverdicted novelty 6.0 of 10

    An LLM evolutionary framework generates executable heuristics for frame-level QP adaptation in VVenC that improve rate-distortion performance over fixed-QP and Lagrangian baselines.

  5. iML: Executable, Problem-Grounded, and Broadly Exploratory Code-Driven AutoML

    cs.LG 2026-02 conditional novelty 6.0 of 10

    iML's contract-based modular code generation with runtime verification reports 85% valid submissions and a 45% medal rate on MLE-BENCH, ahead of MLZero, MLE-STAR, and AutoML-Agent.

  6. Reinforcement Learning for Machine Learning Engineering Agents

    cs.LG 2025-09 conditional novelty 6.0 of 10

    RL-trained Qwen2.5-3B outperforms prompted Claude-3.5-Sonnet and GPT-4o on 12 MLEBench tasks by an average of 22% and 24%, using two targeted RL modifications.

  7. EvoVLMA: Evolutionary Vision-Language Model Adaptation

    cs.CV 2025-08 conditional novelty 6.0 of 10

    An LLM-based evolutionary algorithm automatically designs training-free VLM adaptation code, improving few-shot classification accuracy over manually-designed baselines by up to 1.91 points.

  8. Matryoshka Agent: Unfolding Sub-Agents for Long-Horizon Machine Learning Engineering

    cs.AI 2026-07 conditional novelty 5.0 of 10

    Matryoshka Agent’s orchestrator–sub-agent hierarchy plus tree-ranked RL raises MLE-Dojo HumanRank, letting a 4B orchestrator approach o4-mini and giving a 30B coder up to 36.7% relative gain.

  9. ProfiliTable: Profiling-Driven Tabular Data Processing via Agentic Workflows

    cs.AI 2026-05 unverdicted novelty 5.0 of 10

    ProfiliTable is a profiling-driven multi-agent system that builds semantic context through exploration and closed-loop refinement to produce more reliable tabular data transformations than prior LLM approaches.

  10. ProfiliTable: Profiling-Driven Tabular Data Processing via Agentic Workflows

    cs.AI 2026-05 unverdicted novelty 5.0 of 10

    ProfiliTable is a multi-agent system with profiler, generator, and evaluator components that outperforms baselines on 18 tabular task types via dynamic profiling and closed-loop refinement.

  11. Beyond Model Base Retrieval: Weaving Knowledge to Master Fine-grained Neural Network Design

    cs.LG 2025-07 conditional novelty 5.0 of 10

    M-DESIGN frames neural network refinement as retrieval over modification-gain graphs, with a Bayesian online update of task similarity and predictive planners for out-of-distribution cases, and reports reaching search...

  12. Evaluation of Large Language Model-Driven AutoML in Data and Model Management from Human-Centered Perspective

    cs.HC 2025-07 reject novelty 4.0 of 10

    A 15-participant within-subjects study claims LLM-driven AutoML outperforms traditional AutoML on speed, accuracy, and usability, though supporting data are not provided and several numbers conflict.

Pith tools