Pith. sign in

Paper Citation Record · LEDGER

Quantifying Ranking Uncertainty in LLM Benchmarks

As of 10 August 2026, this Paper Citation Record lists 14 of 14 outbound references and 0 inbound Pith citation observations for arXiv:2607.16259.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.16259 v1

Coverage vector

measured 14 of 14 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-02T09:45:26.783659Z

measured 14 of 14 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

14 of 14 outbound references displayed

  • verified exact1
  • verified fuzzy0
  • unresolved12
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 0ce2d397-8c5e-43ab-b500-c7fbe4be67dd · outbound

This paper cites Statistical multi-metric evaluation and visualization of LLM system predictive performance.

Quantifying Ranking Uncertainty in LLM Benchmarks Statistical multi-metric evaluation and visualization of LLM system predictive performance

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.654826Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.654826Z digest=sha256:3b87cf55889593f1dc3c7ce32b20dbe79e85015de2ce13c5c7d78dd75cfcf927

Observation 888ac22e-0202-40b4-9ced-e73fb5692a02 · outbound

This paper cites an unresolved cited work.

Quantifying Ranking Uncertainty in LLM Benchmarks Unresolved cited work

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.783659Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.783659Z digest=sha256:ed144042842f8561dd8ae09a75c289d782b21d9dc45e794d192e0770e23d47b9

Observation 952a4649-f56a-446f-8cf2-6448267212b1 · outbound

This paper cites Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations.

Quantifying Ranking Uncertainty in LLM Benchmarks Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.764175Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.764175Z digest=sha256:d64b4c2810d78bed721b4886785f6405e2b8ecef12c16546afe2052bca571e5f

Observation d8bd6428-18df-489c-84c4-6df7bb1d22f2 · outbound

This paper cites Uncertainty in Ranking.

Quantifying Ranking Uncertainty in LLM Benchmarks Uncertainty in Ranking

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.770767Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.770767Z digest=sha256:166f71d64defdd5917bdb3a9a47ab19a2098950499ab049b42878b03884c9164

Observation 0bf3017c-bbcd-4e3f-82ee-4a1bf21a8f54 · outbound

This paper cites and Soares, C.

Quantifying Ranking Uncertainty in LLM Benchmarks and Soares, C

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.773698Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.773698Z digest=sha256:be51c6dfb23781b133eb827e7956d711366d5ebe064b99e9c5b1384f98a9d337

Observation 991caf93-f214-44a3-9db2-ca24810f52b3 · outbound

This paper cites However, the distribution may not be approximately normal, or even symmetric.

Quantifying Ranking Uncertainty in LLM Benchmarks However, the distribution may not be approximately normal, or even symmetric

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.780198Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.780198Z digest=sha256:15045629d43a99090f10c7e8f8b2adb0a1f262bc400abe1f602e0c42754c6a5b

Observation baf7aa5c-d312-466c-a63f-247799544128 · outbound

This paper cites Rank CIs definitions and methods A.1.

Quantifying Ranking Uncertainty in LLM Benchmarks Rank CIs definitions and methods A.1

Reference 1945

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.776655Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.776655Z digest=sha256:9b99d4854621805990ed34305d75fea7b30bc0cb502ad17f9f5221a0ec3fc49c

Observation a7bd5273-8c29-461c-a191-deae2e3f8a1b · outbound

This paper cites and Xie, M.-g.

Quantifying Ranking Uncertainty in LLM Benchmarks and Xie, M.-g

Reference 2005

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.750418Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.750418Z digest=sha256:bdd73a820c6c544e37ff8a6d17e3bdf995984230bee947b28af9af986e245b68

Observation 9e912ea6-43bd-4987-9d89-9cf86f6ff93a · outbound

This paper cites Ranking the scores of algorithms with confidence.

Quantifying Ranking Uncertainty in LLM Benchmarks Ranking the scores of algorithms with confidence

Reference 2006

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.756908Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.756908Z digest=sha256:d476701c2b3ff3e99db0927ed9919b098d6bc77df0084e6cfe34ca2038913fe4

Observation c7959c14-d469-4ead-9123-88fc50639653 · outbound

This paper cites v067.i01.

Quantifying Ranking Uncertainty in LLM Benchmarks v067.i01

Reference 2015

Resolution
malformed identifier
no resolver link, observed 2026-08-02T09:45:26.747218Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.747218Z digest=sha256:47acebe3b61f6f420f4bd46edf70d28d457bf616bcdf274606c5647b08987845

Observation 0e0ff518-4728-4b2e-91b7-ceb05ff3d2c4 · outbound

This paper cites Al Mohamad, D., Goeman, J.

Quantifying Ranking Uncertainty in LLM Benchmarks Al Mohamad, D., Goeman, J

Reference 2021

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.715464Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.715464Z digest=sha256:3e8a2f74c292fb24624167dbefb259368a3402dfa70936bde5944fedd72d1398

Observation 3514908c-2504-42d2-9ea3-a515cef37245 · outbound

This paper cites Statistical Uncertainty Quantification for Aggregate Performance Metrics in Machine Learning Benchmarks.

Quantifying Ranking Uncertainty in LLM Benchmarks Statistical Uncertainty Quantification for Aggregate Performance Metrics in Machine Learning Benchmarks

Reference 2022

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.760955Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.760955Z digest=sha256:5cfd1153e756abb79fcbc7de8ce3ccb028926f3fa028f1b5a0b362aa070cd488

Observation 42b087ab-ed08-4508-8b08-62be75a5da4b · outbound

This paper cites doi: 10.1093/restud/rdad006.

Quantifying Ranking Uncertainty in LLM Benchmarks doi: 10.1093/restud/rdad006

Reference 2024

Resolution
verified exact
doi, observed 2026-08-02T09:48:22.056526Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-02T09:45:26.767692Z digest=sha256:cedfc9a34e66322cebb9eafdd9587c0085c13f9e73316d5b75f6d84a9d8403df

Observation 0d68b735-f2f3-4a20-a2c0-3683e2bae536 · outbound

This paper cites csranks: An R Package for Estimation and Inference Involving Ranks.

Quantifying Ranking Uncertainty in LLM Benchmarks csranks: An R Package for Estimation and Inference Involving Ranks

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.753694Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.753694Z digest=sha256:ab16fad08c44df879d768bb4f1c7fb52e51854697f909a4ade0ce087463d9ea4

Pith citing papers

No inbound Pith citation observations are available.