LLM code generators solve most introductory programming assignments but rarely produce fully correct solutions to advanced CS4 and CS5 assignments, often identifying the algorithm while missing problem-specific constraints.
In: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.AI 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Evaluating Code Generation of LLMs in Advanced Computer Science Problems
LLM code generators solve most introductory programming assignments but rarely produce fully correct solutions to advanced CS4 and CS5 assignments, often identifying the algorithm while missing problem-specific constraints.