Pith. sign in

REVIEW 6 cited by

Large Language Models for Constructing and Optimizing Machine Learning Workflows: A Survey

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2411.10478 v2 pith:ZUEB7VGE submitted 2024-11-11 cs.LG cs.AI

classification cs.LGcs.AI
keywords workflowslanguagellmseffectivelargelearningmachinemodels
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Building effective machine learning (ML) workflows to address complex tasks is a primary focus of the Automatic ML (AutoML) community and a critical step toward achieving artificial general intelligence (AGI). Recently, the integration of Large Language Models (LLMs) into ML workflows has shown great potential for automating and enhancing various stages of the ML pipeline. This survey provides a comprehensive and up-to-date review of recent advancements in using LLMs to construct and optimize ML workflows, focusing on key components encompassing data and feature engineering, model selection and hyperparameter optimization, and workflow evaluation. We discuss both the advantages and limitations of LLM-driven approaches, emphasizing their capacity to streamline and enhance ML workflow modeling process through language understanding, reasoning, interaction, and generation. Finally, we highlight open challenges and propose future research directions to advance the effective application of LLMs in ML workflows.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 6 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Reinforcement Learning for Machine Learning Engineering Agents

    cs.LG 2025-09 conditional novelty 6.0 of 10

    RL-trained Qwen2.5-3B outperforms prompted Claude-3.5-Sonnet and GPT-4o on 12 MLEBench tasks by an average of 22% and 24%, using two targeted RL modifications.

  2. Empowering AI to Generate Better AI Code: Guided Generation of Deep Learning Projects with LLMs

    cs.SE 2025-04 conditional novelty 6.0 of 10

    DLCodeGen writes deep learning project code by first predicting a structured solution plan, retrieving similar code and a code template, then using a comparison prompt to merge the best parts.

  3. Optimization Problem Solving Can Transition to Evolutionary Agentic Workflows

    math.OC 2025-05 conditional novelty 5.0 of 10

    An evolutionary loop of foundation-model agents could automate the full optimization pipeline, but the paper's evidence only covers two isolated components.

  4. Large Language Models for Next-Generation Wireless Network Management: A Survey and Tutorial

    cs.NI 2025-09 conditional novelty 4.0 of 10

    A survey and tutorial that organizes LLM-enabled wireless network optimization into formulation, solution, and verification stages, with case studies drawn from the authors' own prior papers.

  5. Evolutionary Computation and Large Language Models: A Survey of Methods, Synergies, and Applications

    cs.NE 2025-05 conditional novelty 4.0 of 10

    A survey that maps bidirectional synergies between evolutionary computation and large language models and proposes a taxonomy plus research gaps.

  6. GPT-HTree: A Decision Tree Framework Integrating Hierarchical Clustering and Large Language Models for Explainable Classification

    cs.LG 2025-01 reject novelty 4.0 of 10

    GPT-HTree combines hierarchical clustering, per-cluster decision trees, and LLM-generated persona descriptions, and claims to identify VC founder clusters with up to 9x success rates, but the claim is not validated ou...

Pith tools