Pith. sign in

Paper Citation Record · LEDGER

Uncovering Competency Gaps in Large Language Models and Their Benchmarks

As of 6 August 2026, this Paper Citation Record lists 8 of 8 outbound references and 1 inbound Pith citation observation for arXiv:2512.20638.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2512.20638 v2

Coverage vector

measured 8 of 8 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-03T18:13:50.531163Z

measured 9 of 9 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-06T06:34:29.942622+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-15T04:54:26.888562Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-15T04:55:03.372967Z

Reference resolution

8 of 8 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved8
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation cff422d3-6b97-41c6-96d3-e29cac4e9d71 · outbound

This paper cites an unresolved cited work.

Uncovering Competency Gaps in Large Language Models and Their Benchmarks Unresolved cited work

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-03T18:13:49.736604Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T18:13:49.736604Z digest=sha256:ea3c3d6a41e0c358e831673cc6f95e3886d116682c9316474aa7afc444b165e4

Observation 6a1361ff-270f-4da7-a89b-6c9c3edf4819 · outbound

This paper cites an unresolved cited work.

Uncovering Competency Gaps in Large Language Models and Their Benchmarks Unresolved cited work

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-03T18:13:49.882061Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T18:13:49.882061Z digest=sha256:0ccb3f5de248abbd9bc535eb8d793d584887bb989bd42601710b647e41209ba6

Observation 6df0bfe9-ccef-4c6f-8f1c-88180ae250b9 · outbound

This paper cites an unresolved cited work.

Uncovering Competency Gaps in Large Language Models and Their Benchmarks Unresolved cited work

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-03T18:13:50.039614Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T18:13:50.039614Z digest=sha256:6fa9a34e6efe8d2cb17e84a63d53d20eb5c45142afbf9e80eede050f9c56d143

Observation 107fde16-c262-496d-8646-01277af8fbc3 · outbound

This paper cites an unresolved cited work.

Uncovering Competency Gaps in Large Language Models and Their Benchmarks Unresolved cited work

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-03T18:13:50.154129Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T18:13:50.154129Z digest=sha256:e7706c94134881e53330f24307aae22819c811688f7967de438cbfc35b8f9555

Observation 1403fbf5-88e9-4f7d-afda-602e4ed88d63 · outbound

This paper cites an unresolved cited work.

Uncovering Competency Gaps in Large Language Models and Their Benchmarks Unresolved cited work

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-03T18:13:50.297769Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T18:13:50.297769Z digest=sha256:f3c67e595a27ddc1e317aed3f653e6669338fcbfd21355bf8ebba8e6dde88dd9

Observation 556859d2-96f5-4967-9465-9540052742cd · outbound

This paper cites an unresolved cited work.

Uncovering Competency Gaps in Large Language Models and Their Benchmarks Unresolved cited work

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-03T18:13:50.401010Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T18:13:50.401010Z digest=sha256:7847bb2e4995c6da141ae0de689a64ad4554c41af5b49f24989f09d85e49079c

Observation 5e4e4495-9f44-4b82-a6bb-e72c7a56c6f6 · outbound

This paper cites After analyzing the input prompt based on these criteria, you must list the criteria numbers that the prompt satisfies in the format of a Python array.

Uncovering Competency Gaps in Large Language Models and Their Benchmarks After analyzing the input prompt based on these criteria, you must list the criteria numbers that the prompt satisfies in the format of a Python array

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-03T18:13:50.531163Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T18:13:50.531163Z digest=sha256:79924c4179dda2d8d4dd0fe2187db4ab173592a51a1b79bcff9686f47d0b936e

Observation 115f6a02-bfde-4d21-b547-fe807885ea6d · outbound

This paper cites Offensive request attempting to override model safeguards.

Uncovering Competency Gaps in Large Language Models and Their Benchmarks Offensive request attempting to override model safeguards

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-03T18:13:49.635892Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T18:13:49.635892Z digest=sha256:231a76bb5bab47689de884f4a77c9edcffef965091a6fbcdf337acbb62e48884

Pith citing papers

Observation 1f7f7774-1710-4fd0-8214-b91e939c36a8 · inbound

Unsteady Metrics and Benchmarking Cultures of AI Model Builders cites this paper.

Unsteady Metrics and Benchmarking Cultures of AI Model Builders Uncovering Competency Gaps in Large Language Models and Their Benchmarks

Reference 7

Resolution
verified exact
arxiv_id, observed 2026-06-02T02:03:36.979230Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

source=pdf_text observed=2026-05-15T04:54:26.888562Z digest=sha256:6b2d3b87dcdabfffa68d30db9fc69470d9ecdb1bb67995d45218a91bfb691679