Pith. sign in

Paper Citation Record · LEDGER

Utility is in the Eye of the User: A Critique of NLP Leaderboards

As of 7 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 3 inbound Pith citation observations for arXiv:2009.13888.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2009.13888 v4

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 3 of 3 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T04:06:29.022554Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-18T11:01:17.105752Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 0c314a30-c5e5-447a-ab89-49843e9caecd · inbound

VLM@school -- Evaluation of AI image understanding on German middle school knowledge cites this paper.

VLM@school -- Evaluation of AI image understanding on German middle school knowledge Utility is in the Eye of the User: A Critique of NLP Leaderboards

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-07T04:06:29.022554Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:06:29.022554Z digest=sha256:b26ea63f28b66046b80aea080e768dd6f81b4fe0556b1f4a9ca92d513b8bf85a

Observation bfee44e5-92ad-4a1e-a4af-f10d0df48641 · inbound

Towards Real-World Validity in Generative AI Benchmarks: Understanding and Designing Domain-Centered Evaluations for Journalism Practitioners cites this paper.

Towards Real-World Validity in Generative AI Benchmarks: Understanding and Designing Domain-Centered Evaluations for Journalism Practitioners Utility is in the Eye of the User: A Critique of NLP Leaderboards

Reference 23

Resolution
verified exact
arxiv_id, observed 2026-05-18T11:01:17.109691Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-18T10:59:16.139525Z digest=sha256:4db1350d440eed031ac967652a9ade368b53c5e64def962f11e7dbeb5b06c695

Observation 72a29015-d3a7-4b0e-b559-60bc8b13ba09 · inbound

Unsteady Metrics and Benchmarking Cultures of AI Model Builders cites this paper.

Unsteady Metrics and Benchmarking Cultures of AI Model Builders Utility is in the Eye of the User: A Critique of NLP Leaderboards

Reference 23

Resolution
verified exact
arxiv_id, observed 2026-05-15T04:55:03.345398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-15T04:54:26.888562Z digest=sha256:f8b51982b5b42bab08ff3f5caa4e45f0563d471209fcbc5bbd7bf3e040d089e7