Pith. sign in

Paper Citation Record · LEDGER

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming

As of 8 August 2026, this Paper Citation Record lists 69 of 69 outbound references and 1 inbound Pith citation observation for arXiv:2505.16667.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.16667 v1

Coverage vector

measured 69 of 69 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:02:55.765520Z

measured 70 of 70 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-12T02:46:48.375901Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-12T07:31:24.581383Z

Reference resolution

69 of 69 outbound references displayed

  • verified exact1
  • verified fuzzy46
  • unresolved21
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 7a25e39c-2331-4d59-8606-ce3716da216c · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:03:07.142889Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:48.228146Z digest=sha256:6242042686e768c03eeeb0116710c6ae974c100221acaef4e90715c7d28368ca

Observation 1fab8258-cc2c-43ac-86bc-17921a4f6b1a · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:03:07.008079Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:48.258795Z digest=sha256:ac24d0737dd6a0310fecc590c891c086fd9922259a59c3660636da972cbecf0f

Observation 96767571-1153-41d1-b3da-5902d0c674ac · outbound

This paper cites Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T15:02:48.062606Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:02:48.062606Z digest=sha256:68f492ebf562bec32431122905491869181d1617536981d7fde6ee2979347879

Observation d1ce9737-673c-4d26-a891-c69aaf18a5f2 · outbound

This paper cites I Need Help! Evaluating LLM's Ability to Ask for Users' Support: A Case Study on Text-to-SQL Generation.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming I Need Help! Evaluating LLM's Ability to Ask for Users' Support: A Case Study on Text-to-SQL Generation

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:02:48.117992Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:02:48.117992Z digest=sha256:f5ce77821e04f0218532f0d6ca378304b25d75686dcfeaec56f7d574064c88ac

Observation a8148796-bf20-4ddd-a12f-3bd7473f8a86 · outbound

This paper cites Code Error Identifications:.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Code Error Identifications:

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:58.305506Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:51.739053Z digest=sha256:cbfa8dade8114d7d50eaa2503cbc95c6582efaeefdfbb0c1dd11ac510bbf432d

Observation 2f07d8ed-3c00-4e2c-bbcf-e0a25267a72e · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:03:06.859520Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:48.333048Z digest=sha256:acafe90c79368e5f491daef4fc8fb2b9a2914d7841bb2b1299c7508cbc17871f

Observation a954b9d6-5bb6-48f2-b71a-3c1aaa90b17f · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:03:06.705457Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:48.479539Z digest=sha256:77cd7468a66613713b4ee02be10fbeb2acbcfe139a915a3a10cd6e5b420c194c

Observation 53f5fdb9-771a-48eb-b400-603068d770e7 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:03:06.560486Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:48.598838Z digest=sha256:eeae24b4693d4ff6293704150e4e61ed14f58909201aa0b44bf049b5e2175715

Observation 6af30ef3-5c35-46a7-9d43-cbe932dce9a1 · outbound

This paper cites Problem Requirements.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Problem Requirements

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:06.368204Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:48.689309Z digest=sha256:55bc7c5b0771cfce93411bed31796c05d5518f3c240dd98d9763ed329f2bf09f

Observation 5249abb5-d134-4278-96af-cf316ca4c229 · outbound

This paper cites - Each test case consists of: - A line containing two integers n (the number of mushrooms) and x (the maximum toxicity level).

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming - Each test case consists of: - A line containing two integers n (the number of mushrooms) and x (the maximum toxicity level)

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:06.272133Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:48.859080Z digest=sha256:eb6c0d5fabf88346232d60cb57b06f9e884978e3113c0451ac58c8d5b7a841ec

Observation be7ec0df-eb46-43f7-b148-35990b9de201 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:03:06.103131Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:49.001571Z digest=sha256:93062f938dcb45186d584f8f312b90912d6d9596043a390b8f27a1e20f42e0a9

Observation e09d626f-2428-4428-ace5-c9516c1ef86d · outbound

This paper cites Functionality:.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Functionality:

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:05.957870Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:49.111844Z digest=sha256:25998810047aebe6c8d06fd7c6966e63552c857a57dd55c03a3b837637f1e8f1

Observation a21960a9-c93d-44f6-8bde-601785c94c0c · outbound

This paper cites - For each test case: - The first line contains two integers n and x (1 ≤ n ≤ 2 × 105, 1 ≤ x ≤ 109) — the number of mushrooms and the maximum toxicity level.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming - For each test case: - The first line contains two integers n and x (1 ≤ n ≤ 2 × 105, 1 ≤ x ≤ 109) — the number of mushrooms and the maximum toxicity level

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:05.802225Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:49.191436Z digest=sha256:54df249b5f0459ee62f8597aee892588418de715208053f971992a15f39e3290

Observation 48d825d2-f05d-41c1-9965-fdc74c7f9398 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:03:05.611786Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:49.274966Z digest=sha256:159f402f15a7c0164a9df7e2149db0a72d248a285af379d940da44a5b678af4f

Observation a7b6918b-dd74-4646-83aa-6a9ea23e66a2 · outbound

This paper cites Problem Requirements.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Problem Requirements

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:05.452759Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:49.355826Z digest=sha256:ebf6920077b1479e46a5de9f4e9442cdcc40f7c0b569149d8604d5c66774b4d9

Observation 9cdd9b5a-9493-4119-b42e-712a6767c977 · outbound

This paper cites Input Format.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Input Format

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:05.232691Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:49.429933Z digest=sha256:610c875a1d99443074f890064b7fde03df514ef31c6ff39bfefa7075facdf820

Observation 8ec99dfe-3890-473a-ac03-955ac647f529 · outbound

This paper cites Output Format.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Output Format

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:05.027439Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:49.487659Z digest=sha256:0216525997c894bf9912e3dade92ba68d1a50cdaa37b10e65d2bd7fc856658e3

Observation 0fed5cda-d266-46a9-bd03-ed0e9667c5ba · outbound

This paper cites Functionality.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Functionality

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:04.878141Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:49.539221Z digest=sha256:92a48e71b0873ddf46f8f0761c106002406b14946ef3ccf281e2fa52058690af

Observation 26090cc2-2531-44b2-b3f6-6972add82a0b · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:03:04.754337Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:49.621478Z digest=sha256:e8938d12b44a46fe6b34f0e475257de64967c27af4f4e2b67d147b12e0504e6e

Observation 1bca4c59-c0ba-47d2-8a32-24bb62499b5f · outbound

This paper cites - While g is greater than x, reduce g by the toxicity level of the mushroom at the start index and increment start.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming - While g is greater than x, reduce g by the toxicity level of the mushroom at the start index and increment start

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:04.562306Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:49.704996Z digest=sha256:fa549d1ee058e4be4c9e494b7d23e865403b236402a43f8ffaf9a2ec2e4303e9

Observation 37752c03-7ebb-4d7a-9356-9a9979739d7f · outbound

This paper cites Unsatisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unsatisfied

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:04.402627Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:49.760772Z digest=sha256:b11f4f6b2456a99a76abcb6f600f7960d5bcbcc489d41da0a6432b282f1d05bf

Observation 4a639408-4021-46b6-8edd-28eb4fa4977a · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:03:04.260502Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:49.800475Z digest=sha256:381fd98720d888574cb5d78005978fb2bebd20f918ad30dbce7a46de5b1bfced

Observation 0a4513df-5120-4842-9a0e-0c192633ee04 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:03:04.139306Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:49.853292Z digest=sha256:3d43a453679ea34f670e3189aceb70d9bf6dd3630e8773799c2eeb4c382739d0

Observation 12273d04-93ed-4818-bbbd-80ad99619088 · outbound

This paper cites The sliding window approach is well-suited for such range-based sum queries, especially when dealing with only positive integers (as toxicity levels ai are ≥ 1).

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming The sliding window approach is well-suited for such range-based sum queries, especially when dealing with only positive integers (as toxicity levels ai are ≥ 1)

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:03.992060Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:49.929648Z digest=sha256:59c30475120c446e0dadaf23b3606ad2c482509f8c73c93dedb3a2f83ba04b24

Observation 9ce68a56-0af9-4c85-b01f-6c198d0fc8e7 · outbound

This paper cites Algorithm.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Algorithm

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:03.844585Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:50.007641Z digest=sha256:4528fe12e26478d052cf627da340e535ad09cd2aeb7adb50db9767233e11b812

Observation 9265f3a5-458a-43d2-a67b-2b020a45fc07 · outbound

This paper cites If it does, we reset ‘g‘ to zero and stop counting subsegments starting from that index.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming If it does, we reset ‘g‘ to zero and stop counting subsegments starting from that index

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:03.544233Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:50.073540Z digest=sha256:ee000675d2e9334c95736bfe42d24d736d49fc3de0265bb2b1846e3a9e2551ff

Observation b90e8e60-3508-4076-a1ce-003bc42d6828 · outbound

This paper cites - Specifically, if the sum goes above ‘x‘, the subsegment is invalid, and we should break out of the loop.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming - Specifically, if the sum goes above ‘x‘, the subsegment is invalid, and we should break out of the loop

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:03.197978Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:50.167579Z digest=sha256:bc911647118959813b9530189f212a6fc6bfcb07e5f1c76ff74793f70cbdf2b0

Observation 4ec26ae2-6ce6-494a-be47-3053bfe9fe78 · outbound

This paper cites For a subsegment to be valid, the cumulative sum should not exceed ‘x‘ at any time.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming For a subsegment to be valid, the cumulative sum should not exceed ‘x‘ at any time

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:02.984627Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:50.262825Z digest=sha256:fd6cb10d16247909a155a71b71fd31f32924749d54743fc0e41dbdb956b3ecd3

Observation a4fda03a-0cac-430d-9cbb-2d8d7034a73e · outbound

This paper cites This allows for fast sum calculation without needing to sum over each range repeatedly.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming This allows for fast sum calculation without needing to sum over each range repeatedly

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:02.701195Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:50.332378Z digest=sha256:3463db9a3083e156691b793f0729571dc1992f9c1d7f15db63f7ca6c0badc0de

Observation 18bbf3f6-e39c-4762-ae19-da3117a2b9c6 · outbound

This paper cites \n".join(map(str, results))) if __name__ ==.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming \n".join(map(str, results))) if __name__ ==

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:02.506426Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:50.374056Z digest=sha256:62ffe89e6361e34265a9f0a4ddf23d3371597f285f5123827055706e585a4d13

Observation 1caaba83-d371-42c1-9825-96c85f8437a3 · outbound

This paper cites This results in a wrong value being returned when reset conditions are not handled correctly.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming This results in a wrong value being returned when reset conditions are not handled correctly

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:02.271197Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:50.403771Z digest=sha256:ce4288d1a24f0087b546b5be8e8133e1d7742d4efe4a4a2b12c8d05618ffbec3

Observation 05b46bcf-e6bd-4d25-bf32-8d34aca1d747 · outbound

This paper cites - **Semantic errors**:.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming - **Semantic errors**:

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:02.128594Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:50.499126Z digest=sha256:1f237e9cd81a480b60a5617ea62b13e437bfee009cffa334b9de7465c3ebe123

Observation 8b67d647-09e0-46cf-8eef-7ae8e61cbef3 · outbound

This paper cites As a result, the toxicity reset logic does not properly skip over invalid ranges.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming As a result, the toxicity reset logic does not properly skip over invalid ranges

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:01.923412Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:50.632933Z digest=sha256:c64393f965588027302735c8ed462a10200b6f3513e78cd67cbdc08de224a9d8

Observation 2f2c6f44-5696-485a-be1e-8235e76f789d · outbound

This paper cites \n".join(map(str, results))) if __name__ ==.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming \n".join(map(str, results))) if __name__ ==

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:01.734466Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:50.691508Z digest=sha256:5df6108cda97c6a7da62c0bacc9a36b29058465e7638eb63ebe5b53bfe9e7ba1

Observation 3dbf22ec-b59f-4884-95ba-64d46627013f · outbound

This paper cites Operation Errors Operation is applied to an inappropriate data type.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Operation Errors Operation is applied to an inappropriate data type

Reference 37

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:01.547502Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:50.722608Z digest=sha256:efaea0f152659966cd203d1f7b47fdd1d61c1f80626b9bfcd25271d5e9a8d799

Observation 099de1e6-8300-4071-83e4-d93ecbce36e4 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 38

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:03:01.350242Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:50.755559Z digest=sha256:96d62e8b6429a2e94c1dc3dc7bfeec0063ef5bd1bc1a9237f2ba45ab7b199161

Observation f6b16ee5-333c-47a2-ab19-9d548675abf9 · outbound

This paper cites Declaration Errors Declaration Error: Incorrect or duplicate declaration of variables or functions.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Declaration Errors Declaration Error: Incorrect or duplicate declaration of variables or functions

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:01.111561Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:50.823781Z digest=sha256:797452ee5369cf8c351f0fde932e79cc16f133b144e22b891137b6ca03dc5bd6

Observation 49b30225-787e-4ee2-800f-5e18114d99b4 · outbound

This paper cites (while, for) Reference Errors 1.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming (while, for) Reference Errors 1

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:00.843386Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:50.882198Z digest=sha256:8f9f03fdc5b4a6b6f9aa88d9c794e6ed4e0c440c80d7588734aaad2294494198

Observation c060cce1-fa54-4712-a5fa-3768d11b22ce · outbound

This paper cites Calculation Errors 1.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Calculation Errors 1

Reference 41

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:00.595016Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:50.966685Z digest=sha256:c9bc2856bc8f76d242c2f9d0ae5f95c932a252cee7639163276de60e93198dc3

Observation e1b81bf5-67df-4b66-8864-4c3d83a20886 · outbound

This paper cites Incomplete Errors Missing essential logical steps: The code generation is incom- plete.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Incomplete Errors Missing essential logical steps: The code generation is incom- plete

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:00.297565Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:51.019376Z digest=sha256:31bed5b1df169da2524d46f009ebf93fd655bfb52e726a82f09b211823d6787b

Observation 5a8f3a5f-85af-40a9-9965-b06fe912bc7e · outbound

This paper cites Problem Requirements.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Problem Requirements

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:58.004128Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:51.890051Z digest=sha256:919c9e2af4faf0db3300f51b61f6e0f4c155b05d65aa8dfed19d9152d943dd8e

Observation 296c533f-d7b2-45cf-b207-51ee47046db3 · outbound

This paper cites Functionality.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Functionality

Reference 56

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:57.823376Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:51.926489Z digest=sha256:fb0b7ee13749fbc30aad0313ecac198502cd22812c7ca68cbf5fb7d431702c04

Observation 2b3a94dc-4e6c-412c-9dd5-90590eb79d5b · outbound

This paper cites Algorithm.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Algorithm

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:57.702961Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:52.010689Z digest=sha256:2f3374e189fff6d6c48d433d47f188d5a837a78f390a0ed0bf2267dd8dbfdfb8

Observation d757e505-5946-4d67-9743-040453a6e5da · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 58

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:02:57.552500Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:52.124394Z digest=sha256:a6533cbeaa3c8f42e3da7e925614489da29995563e2391cd7e2d7f79d63a53c6

Observation 1cc03882-8956-4464-8648-557023f46dd4 · outbound

This paper cites Bug Identification.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Bug Identification

Reference 59

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:57.418899Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:52.215813Z digest=sha256:f2294d6c079a4fee87edb8eb78b96b8113888909727653d8ccd2248b5b94b5fe

Observation 3e236d2d-85fc-4600-a56a-1c5435c93eda · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 61

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:57.279254Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:52.409276Z digest=sha256:15df887c77f841faa44858179a5cd9c0ab95ba265a19f5df238144448d283742

Observation 5ec73366-8783-4b87-b61d-e4b4bf54e600 · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 63

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:57.010478Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:52.588826Z digest=sha256:0b0e61cfcfb975358302d17fddbeca533fa766c476594d6e6476d3794b36470f

Observation 0d2aa046-564e-441e-97d4-4368df5a5726 · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 64

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:56.838570Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:52.635662Z digest=sha256:e551ff62c6ea0a249bdfc8eb06db88f7b9e6a7c1c522350cde6f085147c9f199

Observation fa6d61a8-dd59-4eed-9af1-d546bb2ca321 · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 75

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:56.710264Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:53.685830Z digest=sha256:f1394a919f966a903b7801f27c7409e7ba9faf8519e037019476e45fc9cf3cec

Observation 5c51b3cc-34d7-48db-949c-e535421367c0 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 76

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:02:58.085812Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:53.759262Z digest=sha256:22fa78917a25714016f1d8d75097495202ac2a244b43e73551702e101721a06d

Observation fd91c022-715d-4b5b-946e-40136040bd63 · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 77

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:56.549112Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:53.832831Z digest=sha256:4a74cd1e0fea4dbb5011afaf67cd9dddc0bd0fce63261eb7ba0285425bc0b804

Observation 02f0bdf7-3304-49c4-bc5c-40ff0bdd8b72 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 78

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:02:57.130721Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:53.938695Z digest=sha256:ec18ce17d8fe060d0797551238f7228fa791cb31342d1f375d4716b4a119dccf

Observation 86e30da0-4c92-45f2-93e9-081168f32a3c · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 79

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:56.481253Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:54.043162Z digest=sha256:04cc79f9ce128f3e9f3dd0fe2daa33a555bd6e0cc38fc0d676ee074908e01a25

Observation c13b2ac4-c9fa-4b4f-86c1-13f1d8bcf7e3 · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 80

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:56.370498Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:54.120590Z digest=sha256:a578c87c21bd7ca12099c9c93b4c795616e334948d3378e7fcd1533bb2cbdf4c

Observation 0b36a5a7-6e89-46a5-ae37-b53908c7aa11 · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 91

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:56.251731Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:55.084434Z digest=sha256:f203ba081b43635e4ceeac178887b42e1616417ca22fb5eb20bf5243e1b32d79

Observation 7e7a3dbd-da8e-4ca4-88e2-bb3b40ca319b · outbound

This paper cites Function Call Error: Incorrect function name, wrong arguments, or incorrect method call target.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Function Call Error: Incorrect function name, wrong arguments, or incorrect method call target

Reference 92

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:03:00.015029Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:55.167194Z digest=sha256:4fba18aafd7d355f339850e62acbe8e1833b4b10d3a97812e9a1930978e7baab

Observation 64ac74b3-c3c6-4d8a-a76a-2263f5081a5b · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 93

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:02:59.818367Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:55.249406Z digest=sha256:2904aa3cb35585354e1ed7df0195b20bdd3d350c93fc0fa37913e1d06fa850fe

Observation f839bcd1-eae3-4ee7-a581-0aeb091812f5 · outbound

This paper cites Punctuation Error: Errors in punctuation, such as missing semicolons, commas, or brackets.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Punctuation Error: Errors in punctuation, such as missing semicolons, commas, or brackets

Reference 94

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:59.579407Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:55.319628Z digest=sha256:1b67d75cc449e0abc7ab7d3dea6b2703927f1f2f23be1830c62c73fcaede0310

Observation a7c07968-ab59-410d-9688-01cd770d01bf · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 95

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:02:59.430543Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:55.345029Z digest=sha256:59da7866ba6ca0954ec96c171e4f66772ef84f85e60cde2f01280996b05e24a2

Observation ae06f97c-03fa-49eb-9a6a-c7092ce820ad · outbound

This paper cites **Code Semantic Correctness**: You should concentrate on issues related to control flow, references, calculations, incompleteness, logical direction and suboptimal errors.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming **Code Semantic Correctness**: You should concentrate on issues related to control flow, references, calculations, incompleteness, logical direction and suboptimal errors

Reference 96

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:59.285983Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:55.378932Z digest=sha256:0e938fbcbfe7c14ab7e76f2b89bf88dcb81d291a8b4b2cc0916a50aee16220fa

Observation ecf0fecb-a3f1-4be5-bf1a-3ef6313aeac2 · outbound

This paper cites Loop Error: Error leading to infinite loops or incorrect loop exits.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Loop Error: Error leading to infinite loops or incorrect loop exits

Reference 97

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:59.128212Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:55.423765Z digest=sha256:76767f1822ed7ad03d2b8fc1e026cf671b5275fefbebf965241b7f3da606cba6

Observation 76b148af-74d1-4b90-9d20-d535da386f7c · outbound

This paper cites Wrong Variable: Calling the wrong variable.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Wrong Variable: Calling the wrong variable

Reference 98

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:58.973388Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:55.483451Z digest=sha256:1fa23fd4c222479d9f31163ad153949ed24050fb1951eb7cf37d1e2fc7ade5c9

Observation 01d29579-5ac5-4729-9915-4cd34818c450 · outbound

This paper cites Incorrect Comparison Operation.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Incorrect Comparison Operation

Reference 99

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:58.781077Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:55.550545Z digest=sha256:c2a9e023a06ae4a1979aee7799c2ee5b98d30b89552b064e92119f7a8e630606

Observation 38b0a65c-0b52-4d73-81c0-de582409c783 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 100

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:02:58.598700Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:55.622966Z digest=sha256:dd524be29e0446be7e98c8a1cda624483c06acab7ef719b7c4aafc01f11df463

Observation e51c7753-69c5-44bd-93ae-431133803676 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 101

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:02:58.419166Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:55.670969Z digest=sha256:0f9c077b0c745d0cf8d7d73c7e163c40bd24bc22c90b3c079f2d3c07cf6ee9ff

Observation 9f6f7f39-bb0a-4bb8-bdce-c75105260479 · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 102

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:02:56.158821Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:55.765520Z digest=sha256:f17f406d6e624b5ef9c73195285c4de5e7b0e0a195d03d9ba2f180ddb51d9e07

Observation b953cf99-8413-4401-a79a-cafdede46ebb · outbound

This paper cites Code Llama: Open Foundation Models for Code.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Code Llama: Open Foundation Models for Code

Reference 2003

Resolution
unresolved
no resolver link, observed 2026-08-07T15:02:47.998947Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:02:47.998947Z digest=sha256:5a2cc31680be0e1afe4d1774648c89d6d37d2b68df5d9865cb7de3929469b239

Observation e7469eab-ea21-4a10-9f36-544021202550 · outbound

This paper cites A Survey of Large Language Models for Code: Evolution, Benchmarking, and Future Trends.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming A Survey of Large Language Models for Code: Evolution, Benchmarking, and Future Trends

Reference 2023

Resolution
malformed identifier
no resolver link, observed 2026-08-07T15:02:48.170023Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:02:48.170023Z digest=sha256:291f011cf0a5d71bd014329fb5d25978dc79b7628ed6a4daa16bb89a4c328a9e

Observation 1f56b17c-eda8-49a1-a261-4261d07e08b0 · outbound

This paper cites Coffee-Gym: An Environment for Evaluating and Improving Natural Language Feedback on Erroneous Code.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Coffee-Gym: An Environment for Evaluating and Improving Natural Language Feedback on Erroneous Code

Reference 2024

Resolution
verified exact
local_arxiv, observed 2026-08-07T15:02:56.047744Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:02:47.946607Z digest=sha256:7ba9811e32c8a43f9e8bef77e15a67c82c54ef25dd08381aece72f1b8cf4f4b1

Pith citing papers

Observation e265146a-2671-4599-ae69-af2b76872885 · inbound

When Independent Sampling Outperforms Agentic Reasoning cites this paper.

When Independent Sampling Outperforms Agentic Reasoning ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming

Reference 21

Resolution
verified exact
arxiv_id, observed 2026-05-12T07:31:24.585979Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-05-12T02:46:48.375901Z digest=sha256:0f9ceaeb700778bdf563114d81e272ccba8b1cda382963aa58d2b27aeef61704