Paper Citation Record · LEDGER

Themisto: Jupyter-Based Runtime Benchmark

As of 23 August 2026, this Paper Citation Record lists 13 of 13 outbound references and 0 inbound Pith citation observations for arXiv:2504.12365.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2504.12365 v1

Coverage vector

measured 13 of 13 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-16T12:39:09.643053Z

measured 13 of 13 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-23T06:30:58.430688+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

13 of 13 outbound references displayed

verified exact0
verified fuzzy1
unresolved12
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 832c0cf8-cec1-4504-a3ce-c870a5acda29 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

Themisto: Jupyter-Based Runtime Benchmark Evaluating Large Language Models Trained on Code

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-16T12:39:09.579743Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3403b63f-cad3-4b34-a036-c1401269f0ff · outbound

This paper cites StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback.

Themisto: Jupyter-Based Runtime Benchmark StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-16T12:39:09.585165Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b0658aa3-3bc2-4258-9d71-83f76a88d5f0 · outbound

This paper cites CRUXEval: A Benchmark for Code Reasoning, Understanding and Execution.

Themisto: Jupyter-Based Runtime Benchmark CRUXEval: A Benchmark for Code Reasoning, Understanding and Execution

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-16T12:39:09.598543Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bcd79c32-272a-4eb2-9596-147b67a80aeb · outbound

This paper cites GPT-4o System Card.

Themisto: Jupyter-Based Runtime Benchmark GPT-4o System Card

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-16T12:39:09.604659Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6a685dc7-db4b-478d-b9bd-658c23c7dd81 · outbound

This paper cites A Survey on Large Language Models for Code Generation.

Themisto: Jupyter-Based Runtime Benchmark A Survey on Large Language Models for Code Generation

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-16T12:39:09.611018Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e6d35992-af30-446a-8df4-0867567516b9 · outbound

This paper cites SWE-bench: Can Language Models Resolve Real-World GitHub Issues?.

Themisto: Jupyter-Based Runtime Benchmark SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-16T12:39:09.616727Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 92c024e0-5ccd-4b64-b69a-c561a6da0a8d · outbound

This paper cites Code Execution with Pre-trained Language Models.

Themisto: Jupyter-Based Runtime Benchmark Code Execution with Pre-trained Language Models

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-16T12:39:09.627010Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 19406df0-d7d9-4216-a76e-c6318820e2bd · outbound

This paper cites DeepSeek-V3 Technical Report.

Themisto: Jupyter-Based Runtime Benchmark DeepSeek-V3 Technical Report

Reference 2004

Resolution: unresolved; no resolver link, observed 2026-08-16T12:39:09.621776Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1bf7ddb4-641d-4829-9d9b-2911d7c98441 · outbound

This paper cites Kgtorrent: A dataset of python jupyter note- books from kaggle.

Themisto: Jupyter-Based Runtime Benchmark Kgtorrent: A dataset of python jupyter note- books from kaggle

Reference 2015

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T12:39:09.927878Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation eb3a88e5-9baa-4425-ba9d-c48ec359878a · outbound

This paper cites Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context.

Themisto: Jupyter-Based Runtime Benchmark Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Reference 2021

Resolution: unresolved; no resolver link, observed 2026-08-16T12:39:09.637666Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cd65e293-366e-4696-91f7-50f144370466 · outbound

This paper cites RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement Learning.

Themisto: Jupyter-Based Runtime Benchmark RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement Learning

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-16T12:39:09.591657Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ca356ac8-4503-48c0-8ee3-fde4e711400c · outbound

This paper cites Reasoning Runtime Behavior of a Program with LLM: How Far Are We?.

Themisto: Jupyter-Based Runtime Benchmark Reasoning Runtime Behavior of a Program with LLM: How Far Are We?

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-16T12:39:09.573317Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9ff98afe-b164-43e9-b5f6-3854c16afd77 · outbound

This paper cites an unresolved cited work.

Themisto: Jupyter-Based Runtime Benchmark Unresolved cited work

Reference 2025

Resolution: unresolved; raw_fallback, observed 2026-08-16T12:39:09.907804Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Pith citing papers

No inbound Pith citation observations are available.