OSS-Bench automatically generates live coding benchmarks from real open-source functions and finds that LLM code edits degrade memory safety far more than compilation or test correctness.
Humanevo: An evolution-aware benchmark for more realistic evaluation of repository-level code generation
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
dataset 1
citation-polarity summary
fields
cs.SE 1years
2025 1verdicts
CONDITIONAL 1roles
dataset 1polarities
background 1representative citing papers
citing papers explorer
-
OSS-Bench: Benchmark Generator for Coding LLMs
OSS-Bench automatically generates live coding benchmarks from real open-source functions and finds that LLM code edits degrade memory safety far more than compilation or test correctness.