Paper Citation Record · LEDGER

A Systematic Evaluation of Large Language Models of Code

As of 10 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 8 inbound Pith citation observations for arXiv:2202.13169.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2202.13169 v3

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 8 of 8 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 8 of 8 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T12:29:16.864754Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

17
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 3efa8e46-b716-435c-a173-376385597498 · inbound

InCoder: A Generative Model for Code Infilling and Synthesis cites this paper.

InCoder: A Generative Model for Code Infilling and Synthesis A Systematic Evaluation of Large Language Models of Code

Reference 26

Resolution: verified exact; arxiv_id, observed 2026-05-16T02:21:20.560438Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation b960a8ea-c053-4629-8b23-e0e42833c6e7 · inbound

Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling cites this paper.

Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling A Systematic Evaluation of Large Language Models of Code

Reference 175

Resolution: verified exact; arxiv_id, observed 2026-05-15T17:45:17.649100Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation d5f8dce2-1b94-4d93-9ab4-bb2a1aca3094 · inbound

RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems cites this paper.

RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems A Systematic Evaluation of Large Language Models of Code

Reference 48

Resolution: verified exact; arxiv_id, observed 2026-05-15T22:29:52.560390Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation e4596ce0-fa42-4996-92b4-aeb601408c2d · inbound

Lessons from the Trenches on Reproducible Evaluation of Language Models cites this paper.

Lessons from the Trenches on Reproducible Evaluation of Language Models A Systematic Evaluation of Large Language Models of Code

Reference 75

Resolution: metadata mismatch; arxiv_id, observed 2026-05-16T18:44:49.755441Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation c4698415-2047-49f6-9000-24fd36fb97c4 · inbound

A Blueprint for AI-Driven Software Quality: Integrating LLMs with Established Standards cites this paper.

A Blueprint for AI-Driven Software Quality: Integrating LLMs with Established Standards A Systematic Evaluation of Large Language Models of Code

Reference 23

Resolution: verified exact; arxiv_id, observed 2026-05-22T13:46:36.990589Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation a7abdd35-4b4e-412e-b899-3b8573467071 · inbound

SwiftEval: Developing a Language-Specific Benchmark for LLM-generated Code Evaluation cites this paper.

SwiftEval: Developing a Language-Specific Benchmark for LLM-generated Code Evaluation A Systematic Evaluation of Large Language Models of Code

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-07T12:29:16.864754Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f52ab0a2-1e64-468d-a84c-dc4bf98f0200 · inbound

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems cites this paper.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems A Systematic Evaluation of Large Language Models of Code

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-06T01:07:40.389625Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8d6ba64f-1b22-4469-b172-2bb00136fecb · inbound

Beyond Code Snippets: Benchmarking LLMs on Repository-Level Question Answering cites this paper.

Beyond Code Snippets: Benchmarking LLMs on Repository-Level Question Answering A Systematic Evaluation of Large Language Models of Code

Reference 59

Resolution: metadata mismatch; arxiv_id, observed 2026-05-14T22:28:04.872852Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.