MRG-Bench is a multi-language, executable repository-level code generation benchmark on which current LLMs and RAG methods perform poorly, with the dominant failure mode being poor understanding of user requirements.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.SE 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation
MRG-Bench is a multi-language, executable repository-level code generation benchmark on which current LLMs and RAG methods perform poorly, with the dominant failure mode being poor understanding of user requirements.