Paper Citation Record · LEDGER

EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions

As of 8 August 2026, this Paper Citation Record lists 9 of 9 outbound references and 1 inbound Pith citation observation for arXiv:2605.24110.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2605.24110 v1

Coverage vector

measured 9 of 9 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-07-11T11:50:26.030339Z

measured 10 of 10 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-26T00:06:14.275732Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-07-04T16:59:57.852362Z

Reference resolution

9 of 9 outbound references displayed

verified exact0
verified fuzzy5
unresolved1
parse uncertain0
malformed identifier0
metadata mismatch3

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 6050f170-bf62-4f9c-8c73-799cdefbad3d · outbound

This paper cites MT -Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models.

EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions MT -Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models

Reference 1

Resolution: metadata mismatch; doi, observed 2026-06-30T16:24:53.881819Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation c6e275ad-ec3e-4325-90da-d6c1b7f0fded · outbound

This paper cites Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces.

EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces

Reference 2

Resolution: metadata mismatch; local_arxiv, observed 2026-06-30T16:24:53.896074Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 23a62907-e910-45b2-bfd9-a07f43494416 · outbound

This paper cites LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset.

EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset

Reference 3

Resolution: metadata mismatch; arxiv_id, observed 2026-06-30T16:24:55.257713Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 6032561f-c8e1-4292-8ed2-02aa055ff176 · outbound

This paper cites No algorithm names, data structure choices, or file organization prescriptions appear in instructions.

EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions No algorithm names, data structure choices, or file organization prescriptions appear in instructions

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-07-08T13:34:54.775035Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 4e92baef-9857-4a8a-964d-607a93c7d34b · outbound

This paper cites They never inspect source code structure, function names, or file organization.

EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions They never inspect source code structure, function names, or file organization

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-07-08T13:34:54.777145Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 3f6f9fa5-e3bb-4e2e-ac30-cc014213c1ae · outbound

This paper cites They can only assume the agent passed the behavioral tests of all prior rounds.

EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions They can only assume the agent passed the behavioral tests of all prior rounds

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-07-08T13:34:54.779158Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation a5dac9a8-11f6-4367-b80f-e0e01a1b15a2 · outbound

This paper cites They check for alternative valid inter- pretations that the tests might not distinguish and for edge cases that the cumulative tests might miss.

EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions They check for alternative valid inter- pretations that the tests might not distinguish and for edge cases that the cumulative tests might miss

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-07-08T13:34:54.773251Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 0049df88-6485-4b55-95a7-fa3439c8f926 · outbound

This paper cites They also verify that no test checks stale requirements that have been superseded by later rounds, which would cause otherwise correct implementations to fail.

EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions They also verify that no test checks stale requirements that have been superseded by later rounds, which would cause otherwise correct implementations to fail

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-07-08T13:34:54.769509Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 59a1c8b5-0a21-4df9-b207-985d59a91679 · outbound

This paper cites an unresolved cited work.

EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions Unresolved cited work

Reference 9

Resolution: unresolved; raw_fallback, observed 2026-07-08T13:34:54.771237Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Pith citing papers

Observation 2f32f8e9-38da-4377-a503-e831068a3c8a · inbound

LemonHarness Technical Report cites this paper.

LemonHarness Technical Report EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions

Reference 11

Resolution: verified exact; local_arxiv, observed 2026-07-04T16:59:57.853708Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.