Pith. sign in

Paper Citation Record · LEDGER

Auditing LLM Benchmarks with Item Response Theory

As of 20 August 2026, this Paper Citation Record lists 3 of 3 outbound references and 1 inbound Pith citation observation for arXiv:2605.30504.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2605.30504 v1

Coverage vector

measured 3 of 3 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-06-29T07:32:32.771146Z

measured 4 of 4 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-15T14:58:40.067379Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-15T14:58:40.858059Z

Reference resolution

3 of 3 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch2

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation ce90103f-09e4-465b-b8e2-40f35029bfc6 · outbound

This paper cites Adaptive Testing for LLM Evaluation: A Psychometric Alternative to Static Benchmarks.

Auditing LLM Benchmarks with Item Response Theory Adaptive Testing for LLM Evaluation: A Psychometric Alternative to Static Benchmarks

Reference 1

Resolution
metadata mismatch
arxiv_id, observed 2026-07-15T01:20:49.385427Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-06-29T07:32:32.771146Z digest=sha256:50c55fea5074da4f5e101c5315f9d1c6006c155951cdb922e12d0d4ea6cc168b

Observation b4c8a0ec-6a87-4080-b871-934a928b56d1 · outbound

This paper cites Detecting Pretraining Data from Large Language Models.

Auditing LLM Benchmarks with Item Response Theory Detecting Pretraining Data from Large Language Models

Reference 2

Resolution
metadata mismatch
local_arxiv, observed 2026-06-29T07:33:13.330613Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-06-29T07:32:32.771146Z digest=sha256:0d9842e24873ecfba4ea7c8bb1afe147dde91b64479c464ff1448615872e12ba

Observation 7f005ee2-3673-4666-9e11-b68055fe34a7 · outbound

This paper cites Do Large Language Model Benchmarks Test Reliability?.

Auditing LLM Benchmarks with Item Response Theory Do Large Language Model Benchmarks Test Reliability?

Reference 3

Resolution
malformed identifier
arxiv_id, observed 2026-06-29T07:33:13.327707Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-06-29T07:32:32.771146Z digest=sha256:127a859ad375b6712d3d2928c6b4be5a4cf6b4c4a49af3c740b42bf3290633fc

Pith citing papers

Observation 9cfeaf8c-6499-47f7-a276-c9b42cfd7208 · inbound

Every Wrong Answer Counts: Option-Level Psychometrics for LLM Multiple-Choice Benchmarks cites this paper.

Every Wrong Answer Counts: Option-Level Psychometrics for LLM Multiple-Choice Benchmarks Auditing LLM Benchmarks with Item Response Theory

Reference 51

Resolution
metadata mismatch
local_arxiv, observed 2026-08-15T14:58:40.949418Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-08-15T14:58:40.067379Z digest=sha256:c53deceee5bddc0ce6aa0b9e26226a2c8b524c99a7667bbc7e3e61a333aebe46