OSS-Bench automatically generates live coding benchmarks from real open-source functions and finds that LLM code edits degrade memory safety far more than compilation or test correctness.
Codelmsec benchmark: Systematically evaluating and finding security vulnerabilities in black-box code language models
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
dataset 1
citation-polarity summary
fields
cs.SE 1years
2025 1verdicts
CONDITIONAL 1roles
dataset 1polarities
background 1representative citing papers
citing papers explorer
-
OSS-Bench: Benchmark Generator for Coding LLMs
OSS-Bench automatically generates live coding benchmarks from real open-source functions and finds that LLM code edits degrade memory safety far more than compilation or test correctness.