Across six LLMs, zero-shot generation of GitHub Actions YAML configurations reaches 69% similarity to ground truth but only 3% exact matches, with code-pretrained models performing no better than general-purpose ones.
Usage, costs, and benefits of continuous integration in open-source projects,
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
background 1
citation-polarity summary
fields
cs.SE 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
Can LLMs Write CI? A Study on Automatic Generation of GitHub Actions Configurations
Across six LLMs, zero-shot generation of GitHub Actions YAML configurations reaches 69% similarity to ground truth but only 3% exact matches, with code-pretrained models performing no better than general-purpose ones.