Paper Citation Record · LEDGER

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation

As of 19 August 2026, this Paper Citation Record lists 31 of 31 outbound references and 2 inbound Pith citation observations for arXiv:2508.02998.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.02998 v1

Coverage vector

measured 31 of 31 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T04:49:39.133642Z

measured 33 of 33 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-03T00:28:55.662335Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-06-29T08:13:15.109194Z

Reference resolution

31 of 31 outbound references displayed

verified exact1
verified fuzzy2
unresolved28
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation b2b4e99e-1bc4-4c35-ae24-38032997a2bb · outbound

This paper cites Program Synthesis with Large Language Models.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Program Synthesis with Large Language Models

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:36.283004Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1a72060b-e25a-4fbd-9017-191e7d094253 · outbound

This paper cites Teaching Large Language Models to Self-Debug.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Teaching Large Language Models to Self-Debug

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:36.369265Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 648065fb-e020-4a26-9dd6-0be4e1e20bdc · outbound

This paper cites DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:36.466359Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 55069e9f-4002-48ec-bd27-7fcf9b37a33f · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 4

Resolution: unresolved; raw_fallback, observed 2026-08-06T04:49:41.022049Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation b6b9f691-0118-4d08-9965-05468455e425 · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 5

Resolution: unresolved; raw_fallback, observed 2026-08-06T04:49:40.708589Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 5079ab60-d42e-44f8-9686-e43f8765400e · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:36.799180Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 70d9781f-9b5f-4ae5-9df8-5f79ffc40dbb · outbound

This paper cites ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generation.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generation

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:36.903664Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b63a5f23-dcf4-463d-b0fe-b0b5caa26454 · outbound

This paper cites InCoder: A Generative Model for Code Infilling and Synthesis.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation InCoder: A Generative Model for Code Infilling and Synthesis

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:36.961061Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 61acb26e-8826-4a4c-8fbe-bd1818749853 · outbound

This paper cites 2024.Copilot.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation 2024.Copilot

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T04:49:40.413743Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation fc31b72f-57dc-4c97-a707-afc6474ff3d8 · outbound

This paper cites Code Llama: Open Foundation Models for Code.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Code Llama: Open Foundation Models for Code

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:37.129307Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 34c2ee62-0646-4824-b99f-5dd0228504f6 · outbound

This paper cites DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:37.221809Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 950d70f9-c645-4584-b6d2-97d9523de174 · outbound

This paper cites Measuring Coding Challenge Competence With APPS.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Measuring Coding Challenge Competence With APPS

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:37.331434Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d2c2cf9c-3318-4bda-9c5c-bf9ee34f3c55 · outbound

This paper cites SWE-bench: Can Language Models Resolve Real-World GitHub Issues?.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:37.420182Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 93c84ece-dc59-4842-9f96-dfc0876bb2f4 · outbound

This paper cites xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:37.500595Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 263fcd90-a056-4e3c-bf5c-229343660ffa · outbound

This paper cites Gonzalez, Hao Zhang, and Ion Stoica.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Gonzalez, Hao Zhang, and Ion Stoica

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:37.621792Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3d9385a2-9a13-4627-a475-3fa2e2e8c027 · outbound

This paper cites NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:37.690098Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 810cb445-4df8-4cb3-a01d-0ddf0d83f6e5 · outbound

This paper cites EvoCodeBench: An Evolving Code Generation Benchmark Aligned with Real-World Code Repositories.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation EvoCodeBench: An Evolving Code Generation Benchmark Aligned with Real-World Code Repositories

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:37.791676Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9d896e3d-90cc-48ff-a8f1-7573cef202dd · outbound

This paper cites RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:37.883738Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c9141019-337a-43b9-adae-03a44719535b · outbound

This paper cites StarCoder 2 and The Stack v2: The Next Generation.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation StarCoder 2 and The Stack v2: The Next Generation

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:37.990575Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6cd3db49-b3c7-4f92-b535-9dee159efb59 · outbound

This paper cites CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:38.092818Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d4081a67-03eb-45b1-99f8-db8f22b028f4 · outbound

This paper cites CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:38.225763Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8d1258d9-f5d1-45fb-ac22-0b664ef806f4 · outbound

This paper cites 2024.ChatGPT.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation 2024.ChatGPT

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T04:49:40.186330Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 143da275-38b3-4704-bbb1-423d356617ac · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 23

Resolution: unresolved; raw_fallback, observed 2026-08-06T04:49:39.952384Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 498c2882-7b5b-4b85-9d06-f64a957a8361 · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:38.536580Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 95ec5545-72e3-4110-8292-f2acb7164a0d · outbound

This paper cites Qwen2.5 Technical Report.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Qwen2.5 Technical Report

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:38.645841Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c95dda23-f2e1-4d10-845f-a62bf70a034f · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 26

Resolution: unresolved; raw_fallback, observed 2026-08-06T04:49:39.709343Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 90b9c117-0062-40c9-8a2a-a15032f8c561 · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:38.889520Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2ed9e81d-7cd5-41e0-894a-67fdb1228f0c · outbound

This paper cites CoderUJB: An Executable and Unified Java Benchmark for Practical Programming Scenarios.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation CoderUJB: An Executable and Unified Java Benchmark for Practical Programming Scenarios

Reference 28

Resolution: verified exact; local_arxiv, observed 2026-08-06T04:49:39.355832Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation aa3a215e-c8cc-4a62-b216-909b860b1046 · outbound

This paper cites RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:39.054238Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d4630529-c4f3-46ef-a114-b656493de31c · outbound

This paper cites CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:39.133642Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ee8c051c-8109-4f83-98c9-fec9bf09297a · outbound

This paper cites CodeScore: Evaluating Code Generation by Learning Code Execution.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation CodeScore: Evaluating Code Generation by Learning Code Execution

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-06T04:49:36.719611Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation 9ee78008-d9ef-4a9a-b898-ab8232ccb492 · inbound

DocRetriever: A Plug-and-Play Framework for Multimodal Document Retrieval with Comprehensive Benchmark cites this paper.

DocRetriever: A Plug-and-Play Framework for Multimodal Document Retrieval with Comprehensive Benchmark MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation

Reference 33

Resolution: verified exact; arxiv_id, observed 2026-06-29T08:13:15.110631Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 3eb34cc0-151b-4808-b63b-b28f2b5ba748 · inbound

Repository-Aware Metamorphic Relation Generation for Augmented Reality Applications using Large Language Models cites this paper.

Repository-Aware Metamorphic Relation Generation for Augmented Reality Applications using Large Language Models MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-03T00:28:55.662335Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.