REVIEW 14 cited by
Evolutionary Computation in the Era of Large Language Model: Survey and Roadmap
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Large language models (LLMs) have not only revolutionized natural language processing but also extended their prowess to various domains, marking a significant stride towards artificial general intelligence. The interplay between LLMs and evolutionary algorithms (EAs), despite differing in objectives and methodologies, share a common pursuit of applicability in complex problems. Meanwhile, EA can provide an optimization framework for LLM's further enhancement under black-box settings, empowering LLM with flexible global search capacities. On the other hand, the abundant domain knowledge inherent in LLMs could enable EA to conduct more intelligent searches. Furthermore, the text processing and generative capabilities of LLMs would aid in deploying EAs across a wide range of tasks. Based on these complementary advantages, this paper provides a thorough review and a forward-looking roadmap, categorizing the reciprocal inspiration into two main avenues: LLM-enhanced EA and EA-enhanced LLM. Some integrated synergy methods are further introduced to exemplify the complementarity between LLMs and EAs in diverse scenarios, including code generation, software engineering, neural architecture search, and various generation tasks. As the first comprehensive review focused on the EA research in the era of LLMs, this paper provides a foundational stepping stone for understanding the collaborative potential of LLMs and EAs. The identified challenges and future directions offer guidance for researchers and practitioners to unlock the full potential of this innovative collaboration in propelling advancements in optimization and artificial intelligence. We have created a GitHub repository to index the relevant papers: https://github.com/wuxingyu-ai/LLM4EC.
Forward citations
Cited by 14 Pith papers
-
ELFuzz: Efficient Input Generation via LLM-driven Synthesis Over Fuzzer Space
ELFuzz automatically evolves LLM-written input generators for large programs, outperforming grammar-based fuzzers in coverage and bug finding on seven benchmarks.
-
SPARQ: Synthetic Problem Generation for Reasoning via Quality-Diversity Algorithms
Filtering self-generated math problems by a model's own solve-rate improves that model's MATH accuracy from 38% to 47% and helps out-of-distribution generalization when data is diverse.
-
PhaseNAS: Language-Model Driven Architecture Search with Dynamic Phase Adaptation
PhaseNAS uses dynamic small-to-large LLM switching and a template language to search neural architectures, claiming better accuracy and lower search cost on NAS-Bench-Macro, CIFAR, and COCO.
-
REMoH: A Reflective Evolution of Multi-objective Heuristics approach via Large Language Models
REMoH evolves LLM-written heuristics with NSGA-II and a reflection mechanism, reporting competitive FJSSP results that are weakened by test-set selection.
-
Evolutionary ecology of words
Words as organisms in an AI-judged battle royale evolve toward semantically 'strong' animal names, showing diverse and sometimes punctuated dynamics.
-
Optimization Problem Solving Can Transition to Evolutionary Agentic Workflows
An evolutionary loop of foundation-model agents could automate the full optimization pipeline, but the paper's evidence only covers two isolated components.
-
Language Models for Code Optimization: Survey, Challenges and Future Directions
A systematic review of 53 papers on using large language models for code optimization, with a taxonomy, five challenges, and eight future research directions.
-
Using Large Language Models for Parametric Shape Optimization
An LLM-driven evolutionary search, LLM-PSO, finds near-optimal airfoil and Stokes-flow body shapes on two benchmarks, generally converging faster than classical optimizers.
-
Controlling the Mutation in Large Language Models for the Efficient Evolution of Algorithms
Dynamic mutation prompts sampled from a power-law distribution improve the convergence speed of LLaMEA when driven by GPT-4o, but not GPT-3.5-turbo.
-
Feature Generation Using LLMs: An Evolutionary Algorithm Approach
A funsearch-style evolutionary loop using LLaMA-3.1 7B-generated Python expressions creates new table features and improves F1 in 13 of 16 evaluated classification settings.
-
Position: Scaling LLM Agents Requires Asymptotic Analysis with LLM Primitives
The paper proposes that asymptotic analysis with LLM primitives, treating one forward pass as the cost unit, is the right framework for scaling multi-agent LLM systems.
-
Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language Models
This survey organizes LLM synthetic data research around quality, diversity, and complexity, claiming quality mainly helps in-distribution generalization, diversity mainly helps out-of-distribution generalization, and...
-
An Overview and Discussion on Using Large Language Models for Implementation Generation of Solutions to Open-Ended Problems
A survey and position paper that reviews LLM prompting, RAG, and RL techniques and argues they could support open-ended implementation generation, without presenting new results.
-
Artificial Intelligence for Central Dogma-Centric Multi-Omics: Challenges and Breakthroughs
A literature review that maps AI and deep learning methods for central-dogma-centric multi-omics integration and disease modeling.
Discussion (0). Continue with ORCID to comment.