Buggy code in prompts steers LLMs to write tests that validate the bug, and generating tests from an LLM-written spec docstring instead of the code reduces such misguided tests and increases bug-finding ones.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.SE 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Evaluating and Mitigating the Misguidance Effect of Buggy Code in LLM-Generated Unit Tests
Buggy code in prompts steers LLMs to write tests that validate the bug, and generating tests from an LLM-written spec docstring instead of the code reduces such misguided tests and increases bug-finding ones.