Pith. sign in

Paper Citation Record · LEDGER

Investigating Data Contamination in Modern Benchmarks for Large Language Models

As of 19 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 24 inbound Pith citation observations for arXiv:2311.09783.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2311.09783 v2

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 24 of 24 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 24 of 24 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-16T05:12:22.817274Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

9
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation ec73b96e-3e48-43e5-844d-8cc1f4d85384 · inbound

Benchmark Data Contamination of Large Language Models: A Survey cites this paper.

Benchmark Data Contamination of Large Language Models: A Survey Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 33

Resolution
verified exact
arxiv_id, observed 2026-05-22T23:10:40.906325Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-05-22T23:10:40.420241Z digest=sha256:f815e05bad9c5c943549e13184e0d766c9f66550b13d54b863c494307f69c4af

Observation 233cf14c-0080-43bf-9aba-8f16ba7b6c33 · inbound

LiveBench: A Challenging, Contamination-Limited LLM Benchmark cites this paper.

LiveBench: A Challenging, Contamination-Limited LLM Benchmark Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 11

Resolution
verified exact
arxiv_id, observed 2026-05-15T04:48:26.394739Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-05-15T04:48:26.303240Z digest=sha256:0a909363f93ba9b4cd0400eaf00c87b4c551a6381a9ea3404949d1d5e324c155

Observation 8f8acda0-c1d7-441f-abfe-ccdd8fbb875e · inbound

A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look cites this paper.

A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-12T21:50:23.956718Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T21:50:23.956718Z digest=sha256:3f6b01244b29ee9538676e2d68b3b9e31131736e4a85435aa15f0a9a42984866

Observation 396bd525-a13b-4500-9158-e533453342e7 · inbound

CODECLEANER: Elevating Standards with A Robust Data Contamination Mitigation Toolkit cites this paper.

CODECLEANER: Elevating Standards with A Robust Data Contamination Mitigation Toolkit Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-12T19:19:26.436599Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T19:19:26.436599Z digest=sha256:18c9bbd0fb1035b85bdd46ea62f283302836d4a0bb7413a6ba9b52ca02731a8e

Observation 3aab1d25-6f1a-44a9-9c83-d91b7b9db2f1 · inbound

Large Language Models show both individual and collective creativity comparable to humans cites this paper.

Large Language Models show both individual and collective creativity comparable to humans Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-11T22:46:58.176067Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T22:46:58.176067Z digest=sha256:0f5966d07797c60994d51828ff0bb40a2c9b3696f4e1ecb55fe4fbf7ccae209b

Observation c29f9d81-4418-49bc-b0a2-ce25fc183b2f · inbound

AntiLeakBench: Preventing Data Contamination by Automatically Constructing Benchmarks with Updated Real-World Knowledge cites this paper.

AntiLeakBench: Preventing Data Contamination by Automatically Constructing Benchmarks with Updated Real-World Knowledge Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-11T12:58:02.012028Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T12:58:02.012028Z digest=sha256:75434405bb861f4c9ce3eb3fafbc9d36ecd23fe795f8f3a211f29f36909318e3

Observation 02230e92-85ab-4b48-af74-053c66d8d60d · inbound

UGMathBench: A Diverse and Dynamic Benchmark for Undergraduate-Level Mathematical Reasoning with Large Language Models cites this paper.

UGMathBench: A Diverse and Dynamic Benchmark for Undergraduate-Level Mathematical Reasoning with Large Language Models Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-10T15:40:39.634533Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T15:40:39.634533Z digest=sha256:a9dce2b28f94df3fec49c061194524c7ea8a0945c45d5f4f28b34919d84f0288

Observation bae075b8-70e2-44e0-8588-2fd85c0e6973 · inbound

MeDiSumQA: Patient-Oriented Question-Answer Generation from Discharge Letters cites this paper.

MeDiSumQA: Patient-Oriented Question-Answer Generation from Discharge Letters Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-09T05:15:41.440652Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-09T05:15:41.440652Z digest=sha256:581bcd0485076eac2c604d4e202dd928910bed373250b1c004501510d011f913

Observation 0e558609-c205-45a7-9d6b-e7a4d63507bd · inbound

PRIMETIME : Limits of LLMs in Temporal Primitives cites this paper.

PRIMETIME : Limits of LLMs in Temporal Primitives Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 16

Resolution
verified exact
arxiv_id, observed 2026-05-22T18:36:59.121794Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-05-22T18:36:48.376877Z digest=sha256:b86c0563d919de3ecf0ea29ae1ed942476f63d9c9ebb4108ec282773b5bf6871

Observation cfe9fe14-5ddc-4dac-b86c-54d81979fc15 · inbound

Confidence in Large Language Model Evaluation: A Bayesian Approach to Limited-Sample Challenges cites this paper.

Confidence in Large Language Model Evaluation: A Bayesian Approach to Limited-Sample Challenges Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-16T05:12:22.817274Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T05:12:22.817274Z digest=sha256:ea000eec45966d43ead7a0ae28bef4b99b00c7d667ee3d69d802985c0e5d8308

Observation 97ab26b4-71d5-4ff2-b03f-f1151be6dd38 · inbound

MedArabiQ: Benchmarking Large Language Models on Arabic Medical Tasks cites this paper.

MedArabiQ: Benchmarking Large Language Models on Arabic Medical Tasks Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-15T23:55:11.765666Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-15T23:55:11.765666Z digest=sha256:78e474b3ee1dac7feb83844eb586335d29a60264c46c0fbc956f7dad34d2765b

Observation ba92cf2e-f29a-4d05-959f-1e1c39d58809 · inbound

AbFlowNet: Optimizing Antibody-Antigen Binding Energy via Diffusion-GFlowNet Fusion cites this paper.

AbFlowNet: Optimizing Antibody-Antigen Binding Energy via Diffusion-GFlowNet Fusion Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-15T20:40:22.275804Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:40:22.275804Z digest=sha256:167993ec6029e2a5f3ac182cb70dd30e8166e67af7f8b0190c78d0a3e8d8dd6a

Observation ebacc265-7c29-422e-9e7c-1ed6523700ef · inbound

Federated In-Context Learning: Iterative Refinement for Improved Answer Quality cites this paper.

Federated In-Context Learning: Iterative Refinement for Improved Answer Quality Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-07T05:42:38.666546Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T05:42:38.666546Z digest=sha256:49532bec0a0b093178468760acca88d1430e89abdbbb0e12afc864525d5892e9

Observation eb8820db-3ad5-485b-a6b4-cb0519f1b63c · inbound

SciDA: Scientific Dynamic Assessor of LLMs cites this paper.

SciDA: Scientific Dynamic Assessor of LLMs Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T00:40:17.481039Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T00:40:17.481039Z digest=sha256:03a76fad32cb0627484247bc425267824b104646221e7d52b705ce615cb03d04

Observation c1a274ae-e16c-4f1c-b373-528e1058307a · inbound

League of LLMs: A Benchmark-Free Paradigm for Mutual Evaluation of Large Language Models cites this paper.

League of LLMs: A Benchmark-Free Paradigm for Mutual Evaluation of Large Language Models Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 15

Resolution
verified exact
arxiv_id, observed 2026-05-19T03:22:01.291053Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-05-19T03:17:06.457421Z digest=sha256:a62eff1657793091d4c3ac410abe64bc70ea6a8e1e753ec6b8766d6bc91458bb

Observation 6a902d75-6f93-4099-86b0-e9a87819967a · inbound

ZoFia: Zero-Shot Fake News Detection with Entity-Guided Retrieval and Multi-LLM Interaction cites this paper.

ZoFia: Zero-Shot Fake News Detection with Entity-Guided Retrieval and Multi-LLM Interaction Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 9

Resolution
verified exact
arxiv_id, observed 2026-05-18T01:50:38.285574Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-05-18T01:47:35.232468Z digest=sha256:ea1915d6aaa785d8257f4baf89a890a843d15e3e34c9b0753953d18a276be138

Observation 91ac6d3a-7590-46fd-9add-094893313853 · inbound

ActuBench: A Multi-Agent LLM Pipeline for Generation and Evaluation of Actuarial Reasoning Tasks cites this paper.

ActuBench: A Multi-Agent LLM Pipeline for Generation and Evaluation of Actuarial Reasoning Tasks Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 4

Resolution
verified exact
arxiv_id, observed 2026-05-11T13:46:05.144360Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-05-10T00:35:24.397273Z digest=sha256:5c1870188d6c5879de3e5d7d0d595499994eb40cd39ffdb91c3894511e08468c

Observation 3d6b53c8-ead6-415c-a590-edb84a71c7a6 · inbound

Coordinates of Capability: A Unified MTMM-Geometric Framework for LLM Evaluation cites this paper.

Coordinates of Capability: A Unified MTMM-Geometric Framework for LLM Evaluation Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 6

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T01:46:14.401063Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-05-12T01:41:42.003483Z digest=sha256:9e489e8804683e4318821f3bed007abd17bca6335ac54189645c5a7a5bb17ca9

Observation 4a340f5a-cdf5-44da-8454-28278d68da5a · inbound

Pretraining Data Exposure in Large Language Models: A Survey of Membership Inference, Data Contamination, and Security Implications cites this paper.

Pretraining Data Exposure in Large Language Models: A Survey of Membership Inference, Data Contamination, and Security Implications Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 11

Resolution
metadata mismatch
arxiv_id, observed 2026-06-30T17:24:56.558582Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-06-30T17:20:16.735285Z digest=sha256:e75f5ea3a317693ae5e9d1eb324285529ea5e25a6b18d1e2c276b5183a3119fa

Observation 4b27821f-d48b-413e-bfa5-d9f344fe198b · inbound

The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection cites this paper.

The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 8

Resolution
metadata mismatch
arxiv_id, observed 2026-07-02T03:36:30.302577Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-06-28T09:48:09.688745Z digest=sha256:310c59c2db5ceab63ed449540a0be3973edc61f9f535c717b1e488cc25eeea1e

Observation 7dfa333e-46d4-421f-90ba-f63ecc16cedb · inbound

The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection cites this paper.

The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 8

Resolution
metadata mismatch
arxiv_id, observed 2026-07-04T00:39:16.485829Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-07-04T00:30:13.665405Z digest=sha256:7ac451176640a273a0c596d72ac6734546c55289cf79d8d3f972f94d3cb24546

Observation 86763adc-0a71-42c0-969b-9498eb69b3d8 · inbound

Breaking the Solver Bottleneck: Training Task Generators at the Learnable Frontier cites this paper.

Breaking the Solver Bottleneck: Training Task Generators at the Learnable Frontier Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 59

Resolution
metadata mismatch
arxiv_id, observed 2026-07-03T08:57:48.182085Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-06-27T10:36:09.211639Z digest=sha256:f99ba2f09d1e1ad5ee61c512264a2cbbf343d8826bfe029ab42ec29b97b47486

Observation b65907d7-b88a-45de-9d53-32fb3f9e9b5d · inbound

SWE-Router: Routing in Multi-turn Agentic Software Engineering Tasks cites this paper.

SWE-Router: Routing in Multi-turn Agentic Software Engineering Tasks Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 40

Resolution
metadata mismatch
arxiv_id, observed 2026-07-02T18:37:16.481985Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-07-02T18:19:43.146102Z digest=sha256:e06045af4f3bac7cfd2faee17ae35063b755ef89ee9baab81f34ff1a87335de3

Observation 832cdfff-61ee-400e-9c61-dcf0b491a644 · inbound

Relay-Bench: Evaluating LLMs on Multi-Domain Reasoning Chains cites this paper.

Relay-Bench: Evaluating LLMs on Multi-Domain Reasoning Chains Investigating Data Contamination in Modern Benchmarks for Large Language Models

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-01T15:29:27.374252Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T15:29:27.374252Z digest=sha256:168e164ac71d5d8a9240e0d20f55cbd5ea44b2f81931fa81bd008f377bb2f891