Paper Citation Record · LEDGER

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators

As of 12 August 2026, this Paper Citation Record lists 26 of 26 outbound references and 0 inbound Pith citation observations for arXiv:2503.04756.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2503.04756 v1

Coverage vector

measured 26 of 26 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-08T16:55:24.036678Z

measured 26 of 26 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

26 of 26 outbound references displayed

verified exact0
verified fuzzy12
unresolved14
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 239bd8ca-8c33-418b-a5ee-433ddf6e1ccb · outbound

This paper cites 45 real-world llm applications and use cases from top companies.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators 45 real-world llm applications and use cases from top companies

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T16:55:24.313635Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation c9de2a6d-db49-47fb-aa19-cca5587c3257 · outbound

This paper cites Training Verifiers to Solve Math Word Problems.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Training Verifiers to Solve Math Word Problems

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-08T16:55:23.945043Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 57a481af-8e65-45b4-9092-787870eb4d1e · outbound

This paper cites Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Models.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Models

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-08T16:55:23.949695Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d1496702-94f2-4232-84be-347638243bb9 · outbound

This paper cites Measuring Massive Multitask Language Understanding.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Measuring Massive Multitask Language Understanding

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-08T16:55:23.953730Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5207ff91-b74b-4dba-ac79-bc998566bbe3 · outbound

This paper cites Not All LLM Reasoners Are Created Equal.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Not All LLM Reasoners Are Created Equal

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-08T16:55:23.957746Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1207aca8-1f3f-409d-8ab5-ab4c4d6f0957 · outbound

This paper cites Hashimoto.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Hashimoto

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T16:55:24.303211Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 06105e76-8e3d-4151-8639-f7341c5102ca · outbound

This paper cites Gemma 2: Improving Open Language Models at a Practical Size.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Gemma 2: Improving Open Language Models at a Practical Size

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-08T16:55:23.965170Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a589bcae-cf43-4269-8d50-cbb55cf2e526 · outbound

This paper cites Transition from online elo rating system to bradley-terry model.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Transition from online elo rating system to bradley-terry model

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T16:55:24.293300Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 4f510c19-0d8c-465c-85ba-c194dde6fe7a · outbound

This paper cites Lmsys org.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Lmsys org

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T16:55:24.282321Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation d5614dd6-14a0-4420-b8ea-a9a2ce931695 · outbound

This paper cites GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-08T16:55:23.976970Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ab331eaf-baa7-4892-999e-b503bddd46e3 · outbound

This paper cites Mistral-7b-v0.3, 2024.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Mistral-7b-v0.3, 2024

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T16:55:24.272663Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 5ffcfe89-3e84-4f25-8e12-14d71f9ffb25 · outbound

This paper cites Usa contests.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Usa contests

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T16:55:24.262528Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 4270e169-fa7e-4639-aa44-edc42768674f · outbound

This paper cites LLM Evaluators Recognize and Favor Their Own Generations.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators LLM Evaluators Recognize and Favor Their Own Generations

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-08T16:55:23.990465Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f0ea56f9-05b1-47b3-a4e7-9a5932d73f89 · outbound

This paper cites Openai valued at \ 157 billion after closing \ 6.6 billion funding round, 10 2024.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Openai valued at \ 157 billion after closing \ 6.6 billion funding round, 10 2024

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T16:55:24.251608Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 1cd6f61b-e2d0-4f95-8fd7-bee9d3006947 · outbound

This paper cites Top 10 real-life applications of large language models.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Top 10 real-life applications of large language models

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T16:55:24.240177Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 182bdf26-23b5-4c64-abe4-724a11f70c6d · outbound

This paper cites Do ImageNet Classifiers Generalize to ImageNet?.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Do ImageNet Classifiers Generalize to ImageNet?

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-08T16:55:24.000946Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1bf4bcb4-c507-4bb6-8ebe-7edfac79ba54 · outbound

This paper cites Nlp evaluation in trouble: On the need to measure llm data contamination for each benchmark.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Nlp evaluation in trouble: On the need to measure llm data contamination for each benchmark

Reference 17

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T16:55:24.230673Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 548c8795-2ba0-4de5-b0d2-e8c9f6077151 · outbound

This paper cites Language model leaderboard.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Language model leaderboard

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T16:55:24.219869Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation bb8dfb1a-fbc5-4478-b537-97008cb3fe87 · outbound

This paper cites Taori et al.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Taori et al

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T16:55:24.210189Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 1a902257-31c0-44aa-a9fb-0da23d5aba01 · outbound

This paper cites MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-08T16:55:24.015104Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9e3ea815-9f67-4265-a480-8e1fb1ce61a1 · outbound

This paper cites Chinese wall, wikipedia.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Chinese wall, wikipedia

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T16:55:24.198672Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 2dda6688-f56f-4220-a0f9-58efe9f38463 · outbound

This paper cites A Careful Examination of Large Language Model Performance on Grade School Arithmetic.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators A Careful Examination of Large Language Model Performance on Grade School Arithmetic

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-08T16:55:24.021886Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b988b621-67d8-4239-beff-005006674baf · outbound

This paper cites write newline.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators write newline

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-08T16:55:24.025418Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 89b84a08-f80e-4956-ada4-a150c8dd851b · outbound

This paper cites @esa (Ref.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators @esa (Ref

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-08T16:55:24.029562Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 915d41d4-33a8-4c29-a72c-8e2329fcec63 · outbound

This paper cites an unresolved cited work.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Unresolved cited work

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-08T16:55:24.033192Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0dbf376f-59eb-4fbc-8e3d-020ce505e295 · outbound

This paper cites an unresolved cited work.

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators Unresolved cited work

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-08T16:55:24.036678Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.