Paper Citation Record · LEDGER

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces

As of 8 August 2026, this Paper Citation Record lists 25 of 25 outbound references and 5 inbound Pith citation observations for arXiv:2503.05703.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2503.05703 v1

Coverage vector

measured 25 of 25 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-08T15:14:54.231723Z

measured 30 of 30 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 5 of 5 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-03T20:51:05.491058Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-20T10:58:14.558812Z

Reference resolution

25 of 25 outbound references displayed

verified exact1
verified fuzzy1
unresolved22
parse uncertain0
malformed identifier0
metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 0e7ca234-2890-480d-bdc7-4e999431cd7d · outbound

This paper cites write newline.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces write newline

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.139227Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9fc8d508-fe7e-40a1-b2b7-1035f2110e01 · outbound

This paper cites To Code, or Not To Code? Exploring Impact of Code in Pre-training.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces To Code, or Not To Code? Exploring Impact of Code in Pre-training

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.143811Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b65287cd-50c3-40d1-b342-a4adb2ed81f4 · outbound

This paper cites Program Synthesis with Large Language Models.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces Program Synthesis with Large Language Models

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.152138Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5a77fec1-d92f-4aa1-8303-33d514706bb3 · outbound

This paper cites Learning to Execute Programs with Instruction Pointer Attention Graph Neural Networks.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces Learning to Execute Programs with Instruction Pointer Attention Graph Neural Networks

Reference 5

Resolution: verified exact; local_arxiv, observed 2026-08-08T15:14:54.571884Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation bdcbe37a-d0c0-4862-bf58-dfda48fca6c5 · outbound

This paper cites Static Prediction of Runtime Errors by Learning to Execute Programs with External Resource Descriptions.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces Static Prediction of Runtime Errors by Learning to Execute Programs with External Resource Descriptions

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.160942Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0a56b7b8-aa62-4d82-9d59-7ac52971b1f8 · outbound

This paper cites Language models are few-shot learners.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces Language models are few-shot learners

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.164642Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dc4ae3c1-5cbd-478b-b18a-646ce880c03f · outbound

This paper cites an unresolved cited work.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces Unresolved cited work

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.168740Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e95b994e-88a4-44ee-98d6-61a674eae814 · outbound

This paper cites Training Verifiers to Solve Math Word Problems.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces Training Verifiers to Solve Math Word Problems

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.171928Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c2879b50-fe09-4e6a-991a-bb96cbbd57de · outbound

This paper cites A note on two problems in connexion with graphs.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces A note on two problems in connexion with graphs

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T15:14:54.607022Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 30c1f437-7657-42c4-97cb-422a91426da7 · outbound

This paper cites SemCoder: Training Code Language Models with Comprehensive Semantics Reasoning.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces SemCoder: Training Code Language Models with Comprehensive Semantics Reasoning

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.179144Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dc6caa27-f836-463c-afaf-bab8fa85f6c5 · outbound

This paper cites Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.182739Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fe87d5a6-9806-4aca-ab77-bac645bc2cff · outbound

This paper cites The Llama 3 Herd of Models.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces The Llama 3 Herd of Models

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.185944Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a991b4b4-4b4a-475e-bf60-0a498b2a2c28 · outbound

This paper cites Differentiable Programs with Neural Libraries.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces Differentiable Programs with Neural Libraries

Reference 14

Resolution: metadata mismatch; local_arxiv, observed 2026-08-08T15:14:54.518030Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 404dd99f-12dc-46b2-bc31-ea15c2f6cafe · outbound

This paper cites RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement Learning.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement Learning

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.193857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 395716c3-8bc5-4c70-a3ee-7739c32865f4 · outbound

This paper cites Neural Turing Machines.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces Neural Turing Machines

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.197188Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5de2ce5c-2112-48d0-b369-824d251c63ce · outbound

This paper cites CRUXEval: A Benchmark for Code Reasoning, Understanding and Execution.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces CRUXEval: A Benchmark for Code Reasoning, Understanding and Execution

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.200707Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0b82dca7-15ed-4cde-af6b-6e096a68c903 · outbound

This paper cites StarCoder 2 and The Stack v2: The Next Generation.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces StarCoder 2 and The Stack v2: The Next Generation

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.203925Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0306d34a-b0c3-4930-b1ed-93fa9187ac2f · outbound

This paper cites NExT: Teaching Large Language Models to Reason about Code Execution.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces NExT: Teaching Large Language Models to Reason about Code Execution

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.207215Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2b4be4e6-dcf0-47ee-8034-a24366039777 · outbound

This paper cites Show Your Work: Scratchpads for Intermediate Computation with Language Models.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces Show Your Work: Scratchpads for Intermediate Computation with Language Models

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.210803Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 173cffdf-3cf1-4c5a-af97-77d7b9ddee7d · outbound

This paper cites GPT-4 Technical Report.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces GPT-4 Technical Report

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.214365Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3dc5d92d-0aa6-44b4-956d-43f25cbd2128 · outbound

This paper cites Code Llama: Open Foundation Models for Code.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces Code Llama: Open Foundation Models for Code

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.217921Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0881eb4c-f2d6-490e-9ae7-d98c0b56d0ca · outbound

This paper cites Learning to Execute.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces Learning to Execute

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.221435Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 02b51c28-fe9e-4169-9fc6-77c78ffeb91d · outbound

This paper cites @esa (Ref.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces @esa (Ref

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.224700Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 80e167dd-9aae-40b5-953b-81ba082b6cc2 · outbound

This paper cites an unresolved cited work.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces Unresolved cited work

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.228556Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1a08814b-9a09-422c-a3a4-18e3cae9f824 · outbound

This paper cites >zKxW7 yCJSN yk6N !t.

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces >zKxW7 yCJSN yk6N !t

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-08T15:14:54.231723Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation a2fbe18a-d0c0-4df5-8992-b7fc3e8dca77 · inbound

Can Large Language Models Reason About Complex Execution Paths? An Empirical Study on Python cites this paper.

Can Large Language Models Reason About Complex Execution Paths? An Empirical Study on Python What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-03T20:51:05.491058Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c4e86127-7ca3-4870-af6d-80e4b09e18f3 · inbound

Generating Verifiable Chain of Thoughts from Exection-Traces cites this paper.

Generating Verifiable Chain of Thoughts from Exection-Traces What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces

Reference 1

Resolution: verified exact; arxiv_id, observed 2026-05-17T05:19:04.865548Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 0463fa6f-ba86-4edd-a9d0-56e9ffdf6e11 · inbound

Teaching LLMs Program Semantics via Symbolic Execution Traces cites this paper.

Teaching LLMs Program Semantics via Symbolic Execution Traces What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces

Reference 3

Resolution: metadata mismatch; arxiv_id, observed 2026-05-11T20:26:14.000349Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 7fb5fcd8-e0e4-4af4-9697-72fef103eb5b · inbound

Code as Agent Harness cites this paper.

Code as Agent Harness What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces

Reference 96

Resolution: verified exact; arxiv_id, observed 2026-05-20T10:58:14.560624Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 53f64989-6a8f-45fb-8bfd-c79695ab0bbf · inbound

Execution-First Synthetic Tool-Use Trace Generation for LLM Agents cites this paper.

Execution-First Synthetic Tool-Use Trace Generation for LLM Agents What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-03T12:17:53.633760Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.