Pith. sign in

REVIEW 4 cited by

Generative Artificial Intelligence for Software Engineering -- A Research Agenda

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2310.18648 v1 pith:UW276GRB submitted 2023-10-28 cs.SE

Generative Artificial Intelligence for Software Engineering -- A Research Agenda

classification cs.SE
keywords softwareengineeringgenairesearchcurrentagendadevelopmentactivities
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
Share X Bluesky LinkedIn Reddit HN
read the original abstract

Generative Artificial Intelligence (GenAI) tools have become increasingly prevalent in software development, offering assistance to various managerial and technical project activities. Notable examples of these tools include OpenAIs ChatGPT, GitHub Copilot, and Amazon CodeWhisperer. Although many recent publications have explored and evaluated the application of GenAI, a comprehensive understanding of the current development, applications, limitations, and open challenges remains unclear to many. Particularly, we do not have an overall picture of the current state of GenAI technology in practical software engineering usage scenarios. We conducted a literature review and focus groups for a duration of five months to develop a research agenda on GenAI for Software Engineering. We identified 78 open Research Questions (RQs) in 11 areas of Software Engineering. Our results show that it is possible to explore the adoption of GenAI in partial automation and support decision-making in all software development activities. While the current literature is skewed toward software implementation, quality assurance and software maintenance, other areas, such as requirements engineering, software design, and software engineering education, would need further research attention. Common considerations when implementing GenAI include industry-level assessment, dependability and accuracy, data accessibility, transparency, and sustainability aspects associated with the technology. GenAI is bringing significant changes to the field of software engineering. Nevertheless, the state of research on the topic still remains immature. We believe that this research agenda holds significance and practical value for informing both researchers and practitioners about current applications and guiding future research.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Exploring Code Analysis: Zero-Shot Insights on Syntax and Semantics with LLMs

    cs.SE 2023-05 unverdicted novelty 7.0

    LLMs achieve strong results on syntax parsing tasks but show limited and variable performance on dynamic reasoning, with a clear performance hierarchy across model scales.

  2. Qiskit Code Migration with LLMs

    cs.SE 2026-06 unverdicted novelty 5.0

    A taxonomy-guided RAG system with LLMs reduces hallucinations and improves migration suggestions for Qiskit code compared to unconstrained retrieval.

  3. The Role of LLMs in Collaborative Software Design

    cs.SE 2026-04 unverdicted novelty 5.0

    Exploratory lab study finds shared LLM use builds shared understanding in design teams while parallel use risks context drift, with professionals reflecting on outputs for insights but sometimes anchoring early.

  4. Exploring Individual Factors in the Adoption of LLMs for Specific Software Engineering Purposes

    cs.SE 2025-04 unverdicted novelty 4.0

    Survey of 188 engineers using SEM finds that UTAUT2 constructs influence LLM adoption differently across five SE purposes, with some factors showing negative effects when examined in isolation.