REVIEW 10 cited by
A Survey on Large Language Models for Software Engineering
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Software Engineering (SE) is the systematic design, development, maintenance, and management of software applications underpinning the digital infrastructure of our modern world. Very recently, the SE community has seen a rapidly increasing number of techniques employing Large Language Models (LLMs) to automate a broad range of SE tasks. Nevertheless, existing information of the applications, effects, and possible limitations of LLMs within SE is still not well-studied. In this paper, we provide a systematic survey to summarize the current state-of-the-art research in the LLM-based SE community. We summarize 62 representative LLMs of Code across three model architectures, 15 pre-training objectives across four categories, and 16 downstream tasks across five categories. We then present a detailed summarization of the recent SE studies for which LLMs are commonly utilized, including 947 studies for 112 specific code-related tasks across five crucial phases within the SE workflow. We also discuss several critical aspects during the integration of LLMs into SE, such as empirical evaluation, benchmarking, security and reliability, domain tuning, compressing and distillation. Finally, we highlight several challenges and potential opportunities on applying LLMs for future SE studies, such as exploring domain LLMs and constructing clean evaluation datasets. Overall, our work can help researchers gain a comprehensive understanding about the achievements of the existing LLM-based SE studies and promote the practical application of these techniques. Our artifacts are publicly available and will be continuously updated at the living repository: https://github.com/iSEngLab/AwesomeLLM4SE.
Forward citations
Cited by 10 Pith papers
-
TraceDev: A Traceability-Driven Multi-agent Framework for Requirement-to-Code Development
A traceability-graph-driven multi-agent framework improves LLM-based repository-level code generation from use cases, reaching 53-57% functional success on ETOUR/SMOS versus 13-25% for ChatDev and MetaGPT.
-
Multi-Agent LLM Collaboration for Unit Test Generation via Human-Testing-Inspired Workflows
A three-agent LLM workflow plus a test-specialized knowledge graph generates unit tests that beat prior LLM and search-based tools on coverage and mutation score.
-
SGAgent: Suggestion-Guided LLM-Based Multi-Agent Framework for Repository-Level Software Repair
A three-agent locate-suggest-fix framework with a knowledge-graph toolkit resolves 154/300 SWE-Bench-Lite issues with Claude-3.5, outperforming same-model baselines by 5-10 points.
-
Seeing is Fixing: Cross-Modal Reasoning with Multimodal LLMs for Visual Software Issue Fixing
GUIRepair, a cross-modal LLM pipeline that converts issue screenshots into reproduction code and rendered patch screenshots into validation feedback, resolves 157/517 SWE-bench M instances with GPT-4o and 175 with o4-mini.
-
LLM-Driven CI-CD Workflow Intelligence for Cyber Systems Engineering
An LLM pipeline over 75k GitHub CI/CD workflows finds reliability-dominated anti-patterns, language/domain stage differences, and best recommendation quality from few-shot prompting.
-
Large Language Models for Software Engineering Diagrams: A Systematic Review of UML and ER modelling
A systematic review of 64 papers finds LLM research on software diagrams is concentrated on UML class-diagram generation, dominated by GPT models, and held back by weak evaluation and scarce shared benchmarks.
-
Single Conversation Methodology: A Human-Centered Protocol for AI-Assisted Software Development
Proposes a structured protocol for LLM-assisted development that keeps requirements, code, and documentation inside a single persistent conversation to preserve human oversight and traceability.
-
Augmenting the Generality and Performance of Large Language Models for Software Engineering
A proposal for augmenting LLM generality in non-code software engineering tasks, with no reported experimental evidence.
-
Curiosity by Design: An LLM-based Coding Assistant Asking Clarification Questions
A fine-tuned classifier and question generator let a small coding assistant detect under-specified prompts and ask for clarification, which users rated better than a baseline in a small study.
-
Domain Specific Benchmarks for Evaluating Multimodal Large Language Models
A review paper that organizes domain-specific MLLM benchmarks into an eight-discipline taxonomy, with summary tables and performance highlights.
Discussion (0). Sign in to comment.