Paper Citation Record · LEDGER

DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories

As of 7 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 6 inbound Pith citation observations for arXiv:2405.19856.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2405.19856 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 6 of 6 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 6 of 6 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-06T21:16:42.331104Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-07-09T00:25:48.479134Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 76680577-cc27-467d-b7de-f5f2725ac86a · inbound

AdaDec: A Uncertainty-Guided Lookahead Decoding Framework for LLM-Based Code Generation cites this paper.

AdaDec: A Uncertainty-Guided Lookahead Decoding Framework for LLM-Based Code Generation DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories

Reference 40

Resolution: verified exact; arxiv_id, observed 2026-05-19T10:22:14.505669Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation e6008267-b874-4237-a2fc-97efca23c204 · inbound

A Hierarchical and Evolvable Benchmark for Fine-Grained Code Instruction Following with Multi-Turn Feedback cites this paper.

A Hierarchical and Evolvable Benchmark for Fine-Grained Code Instruction Following with Multi-Turn Feedback DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-06T21:16:42.331104Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 10d96fcc-3a74-4438-be2a-ed18f855d516 · inbound

Evaluating the Formal Reasoning Capabilities of Large Language Models through Chomsky Hierarchy cites this paper.

Evaluating the Formal Reasoning Capabilities of Large Language Models through Chomsky Hierarchy DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories

Reference 40

Resolution: metadata mismatch; arxiv_id, observed 2026-05-13T19:53:11.756287Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 9b859a4d-0d44-4c97-985a-52ca1e113919 · inbound

ClassEval-Pro: A Cross-Domain Benchmark for Class-Level Code Generation cites this paper.

ClassEval-Pro: A Cross-Domain Benchmark for Class-Level Code Generation DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories

Reference 23

Resolution: verified exact; arxiv_id, observed 2026-05-12T09:31:27.016643Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 34328fde-a18a-4c41-b81d-22c38546b37a · inbound

SetupX: Can LLM Agents Learn from Past Failures in Functionality-Correct Code Repository Setup? cites this paper.

SetupX: Can LLM Agents Learn from Past Failures in Functionality-Correct Code Repository Setup? DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories

Reference 4

Resolution: verified exact; arxiv_id, observed 2026-06-29T21:03:58.917810Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 179aafa3-dcbb-4ca6-bc4a-8c822c689c81 · inbound

Can Large Language Models Generate Observability-Aware Code? cites this paper.

Can Large Language Models Generate Observability-Aware Code? DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories

Reference 32

Resolution: verified exact; local_arxiv, observed 2026-07-09T00:25:48.480418Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.