Pith. sign in

Paper Citation Record · LEDGER

Improving LLM Leaderboards with Psychometrical Methodology

As of 10 August 2026, this Paper Citation Record lists 22 of 22 outbound references and 2 inbound Pith citation observations for arXiv:2501.17200.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2501.17200 v1

Coverage vector

measured 22 of 22 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-10T12:49:36.947895Z

measured 24 of 24 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-02T17:05:10.649774Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-13T23:08:25.137504Z

Reference resolution

22 of 22 outbound references displayed

  • verified exact4
  • verified fuzzy8
  • unresolved10
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation d0872fcc-d50c-4c68-b9ee-a0fe650b36e3 · outbound

This paper cites cognitive.

Improving LLM Leaderboards with Psychometrical Methodology cognitive

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T12:49:37.766531Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-10T12:49:36.873585Z digest=sha256:e05a5ac4b2295a84b3111b8c479e3cfdea38c93ff1a512b86fb9b126ff111155

Observation 838d8ec6-a096-450c-baa0-bde466efc2db · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-10T12:49:36.939384Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T12:49:36.939384Z digest=sha256:fa660d1cee12661aab8dd78d65a7f2999761566d88a006306da71a3a5af183aa

Observation 210174d2-6839-45d1-889c-46041772b8df · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-10T12:49:37.745030Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-10T12:49:36.882706Z digest=sha256:76f4807183720e8d1c0b7789032883bc5b77a4b74a9193160f4f37cb87fb41c3

Observation 4a39b8b7-71a0-40b5-840c-f5723b71b4ea · outbound

This paper cites 1 The initial unidimensional model calibrated on the older leaderboard dataset, exhibited relatively poor model fit under Maximum Likelihood Robust estimator (Yuan & Bentler, 2000).

Improving LLM Leaderboards with Psychometrical Methodology 1 The initial unidimensional model calibrated on the older leaderboard dataset, exhibited relatively poor model fit under Maximum Likelihood Robust estimator (Yuan & Bentler, 2000)

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T12:49:37.778084Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-10T12:49:36.869051Z digest=sha256:d030f4250fcc788e9bfce50526c641fe7f76ebddaab733ac690b56bf7aaf90eb

Observation 5faefccb-b992-4e0f-8805-b60efb313e9b · outbound

This paper cites Which LLM is the best?.

Improving LLM Leaderboards with Psychometrical Methodology Which LLM is the best?

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T12:49:37.721075Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-10T12:49:36.891607Z digest=sha256:3162b85fc08f364164b5f4dfff838b2c416d34283612d2380de25fca096f1519

Observation e699e461-e502-412f-9bf0-ff35ab799a14 · outbound

This paper cites general cognitive ability.

Improving LLM Leaderboards with Psychometrical Methodology general cognitive ability

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T12:49:37.697537Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-10T12:49:36.899792Z digest=sha256:a7f197192e3ca45780b0017e2a8a72686c856c61d7a08380412e9a17254f286b

Observation 95d639a3-1a32-4fbb-a236-b47181832b6a · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-10T12:49:36.907878Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T12:49:36.907878Z digest=sha256:8f6a28642d3b6307fac601e6a76d725971fd5e26c5b2261d6c68aa1efa47abd2

Observation fa2a2ec6-752c-4591-b353-06a55bfeebe2 · outbound

This paper cites outliers.

Improving LLM Leaderboards with Psychometrical Methodology outliers

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T12:49:37.685460Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-10T12:49:36.903628Z digest=sha256:d3ffaf8f0cf398a9f3ccdaacb31342725955da0dfce512467f4af8cbbe40cf65

Observation bf5b87a5-5f7d-4d8e-a176-f70eb7475075 · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 20

Resolution
verified exact
raw_fallback, observed 2026-08-10T12:49:37.377673Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-10T12:49:36.927521Z digest=sha256:ff47606ffb01bf82a6c0974af6921111408eab787997b36d0b68735f1ed99348

Observation 307edf66-a4c8-46aa-9451-c7cc81ac6cd1 · outbound

This paper cites Variational Item Response Theory: Fast, Accurate, and Expressive.

Improving LLM Leaderboards with Psychometrical Methodology Variational Item Response Theory: Fast, Accurate, and Expressive

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-10T12:49:36.943661Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T12:49:36.943661Z digest=sha256:bb99e6a2d1ad3e71e4dcba7bfb8f9bb71d8a9d6fb7400a477f0545651ea04ab2

Observation b5e49480-7491-4981-94f7-cfcff384d724 · outbound

This paper cites Sociological methodology, 30(1), 165-200.

Improving LLM Leaderboards with Psychometrical Methodology Sociological methodology, 30(1), 165-200

Reference 22

Resolution
verified exact
raw_fallback, observed 2026-08-10T12:49:37.223780Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-10T12:49:36.947895Z digest=sha256:4fca4543fd84a2f586bab8819760a56396af236bc537ad77c411df8e7a11c41c

Observation 87d62a63-1f29-46f3-b3fd-46e0a97eeaa3 · outbound

This paper cites LawBench: Benchmarking Legal Knowledge of Large Language Models.

Improving LLM Leaderboards with Psychometrical Methodology LawBench: Benchmarking Legal Knowledge of Large Language Models

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-10T12:49:36.919546Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T12:49:36.919546Z digest=sha256:4d65b7d01136ef0ac211ec45ddf3d6d961ff9e071c61178ce9f934b70f9f0219

Observation b52efee5-1a38-45df-8026-a81d55cd2afa · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 95

Resolution
verified exact
doi, observed 2026-08-10T12:49:37.005164Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-10T12:49:36.931258Z digest=sha256:9b076a41193eedf0c7815e7016ff9c2aecd18572a174fdd706ab4bc32ca04e50

Observation 2bac8fb8-bdc3-414e-bbd9-a2653163c17f · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 118

Resolution
verified exact
raw_fallback, observed 2026-08-10T12:49:37.611257Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-10T12:49:36.911549Z digest=sha256:f936c11da538b286f7da6c8b87cbf450bc025b3208c2dbe080e5a71e55e81132

Observation 3c3cca9e-2f10-4978-9f50-28b1c2445d49 · outbound

This paper cites Observational Scaling Laws and the Predictability of Language Model Performance.

Improving LLM Leaderboards with Psychometrical Methodology Observational Scaling Laws and the Predictability of Language Model Performance

Reference 306

Resolution
unresolved
no resolver link, observed 2026-08-10T12:49:36.935178Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T12:49:36.935178Z digest=sha256:dad6549c276dd466e2d9027520c79969f21ef17ff3034900f6cc7c0a69cdf40d

Observation f80b7f35-9aed-42af-a5c9-5ad22940e80c · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 421

Resolution
unresolved
no resolver link, observed 2026-08-10T12:49:36.923696Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T12:49:36.923696Z digest=sha256:cc9e29034ee3952d466012f2d6e32891aec09be9dff95f6b196444dd854e03ff

Observation 74b141c5-4d4f-4f68-93ac-87ef82f2e36f · outbound

This paper cites A Survey on Evaluation of Large Language Models.

Improving LLM Leaderboards with Psychometrical Methodology A Survey on Evaluation of Large Language Models

Reference 839

Resolution
unresolved
no resolver link, observed 2026-08-10T12:49:36.915287Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T12:49:36.915287Z digest=sha256:7328e00fc886cb2be5d68e45b45fc63493c5d623935beba2e43c3d7ab2e1b5a4

Observation 4b4c5a5c-8091-44ca-ad87-26b5073f87eb · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 1978

Resolution
unresolved
raw_fallback, observed 2026-08-10T12:49:37.755898Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-10T12:49:36.878421Z digest=sha256:f1f6131dcb1704d82b2595713b8669a0e43c8114cb55aae65b07c5f64bb77623

Observation 208d9e9b-16e0-425f-a461-991454459b56 · outbound

This paper cites These questions are administered in a 5-shot manner.

Improving LLM Leaderboards with Psychometrical Methodology These questions are administered in a 5-shot manner

Reference 2021

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T12:49:37.789631Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-10T12:49:36.864896Z digest=sha256:dda0d0ffcdf2665ce93d9da46431354808832832c22a6d9e4c7faaea60c862b0

Observation 39feace7-dccb-4d0f-aa12-ffa9193fb82e · outbound

This paper cites utilitarian.

Improving LLM Leaderboards with Psychometrical Methodology utilitarian

Reference 2022

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T12:49:37.709752Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-10T12:49:36.895830Z digest=sha256:8d959142e50a44e4dc490c2437c0d69702f331deecdbf7325b94c8bf74af3058

Observation a0cb0ef7-aef5-4a74-852e-d8be4d49aaf9 · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 2023

Resolution
unresolved
raw_fallback, observed 2026-08-10T12:49:37.801455Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-10T12:49:36.859904Z digest=sha256:660548d81e3b009962ca97fc27373e0c3921c64c0fa4a71a57ce956e951fba36

Observation 8b0e996b-44ec-40ca-a5fc-9db9d1ccb749 · outbound

This paper cites A clear ceiling effect indicates that further increases in the number of parameters in LLMs results in increasingly diminishing improvements in model performance.

Improving LLM Leaderboards with Psychometrical Methodology A clear ceiling effect indicates that further increases in the number of parameters in LLMs results in increasingly diminishing improvements in model performance

Reference 2024

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T12:49:37.733271Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-10T12:49:36.887573Z digest=sha256:1932af41c788550826154ad57c1947d62b3c6f90be7d0fa0bbc9bf02551fcbae

Pith citing papers

Observation 90e94b55-168e-42ea-a437-178c91e53edc · inbound

HumorRank: A Tournament-Based Leaderboard for Evaluating Humor Generation in Large Language Models cites this paper.

HumorRank: A Tournament-Based Leaderboard for Evaluating Humor Generation in Large Language Models Improving LLM Leaderboards with Psychometrical Methodology

Reference 14

Resolution
verified exact
arxiv_id, observed 2026-05-13T23:08:25.140620Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-05-13T23:07:38.352198Z digest=sha256:0c55443957fcb2bbdaeb57c72ac5b0d4e378106444ffaa51ca0157ab7578d686

Observation 3a697ee8-d627-4b5d-9157-e4b5721c4274 · inbound

HumorRank: A Tournament-Based Leaderboard for Evaluating Humor Generation in Large Language Models cites this paper.

HumorRank: A Tournament-Based Leaderboard for Evaluating Humor Generation in Large Language Models Improving LLM Leaderboards with Psychometrical Methodology

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-02T17:05:10.649774Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T17:05:10.649774Z digest=sha256:49a1910aa4cbad22dbe386dc999ec810cd817f8001f1e686c4800089d9aa5e67