Pith. sign in

Paper Citation Record · LEDGER

Improving LLM Leaderboards with Psychometrical Methodology

As of 13 August 2026, this Paper Citation Record lists 22 of 22 outbound references and 2 inbound Pith citation observations for arXiv:2501.17200.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2501.17200 v1

Coverage vector

measured 22 of 22 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-10T12:49:36.947895Z

measured 24 of 24 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-13T06:32:02.005865+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-02T17:05:10.649774Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-13T23:08:25.137504Z

Reference resolution

22 of 22 outbound references displayed

  • verified exact4
  • verified fuzzy8
  • unresolved10
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation d0872fcc-d50c-4c68-b9ee-a0fe650b36e3 · outbound

This paper cites cognitive.

Improving LLM Leaderboards with Psychometrical Methodology cognitive

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T12:49:37.766531Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T12:49:36.873585Z digest=sha256:b90038ebc5cda6502a3267ecff8969a4c6c34e9c6b016134fed664545eccdfce

Observation 838d8ec6-a096-450c-baa0-bde466efc2db · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-10T12:49:36.939384Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T12:49:36.939384Z digest=sha256:6066ab60b0f3d6d085b1fe9d6f50e6e7fe3f790a86014d9216615408cc92eea3

Observation 210174d2-6839-45d1-889c-46041772b8df · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-10T12:49:37.745030Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T12:49:36.882706Z digest=sha256:ea005d9bdc64d4787fefb4eab658c6030ba1299c76587832bdcc6d08fcfc2938

Observation 4a39b8b7-71a0-40b5-840c-f5723b71b4ea · outbound

This paper cites 1 The initial unidimensional model calibrated on the older leaderboard dataset, exhibited relatively poor model fit under Maximum Likelihood Robust estimator (Yuan & Bentler, 2000).

Improving LLM Leaderboards with Psychometrical Methodology 1 The initial unidimensional model calibrated on the older leaderboard dataset, exhibited relatively poor model fit under Maximum Likelihood Robust estimator (Yuan & Bentler, 2000)

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T12:49:37.778084Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T12:49:36.869051Z digest=sha256:3e90b2081335e314e1f352c58b8225440e71eb0ff98b6dcfcb46f5958f2d67aa

Observation 5faefccb-b992-4e0f-8805-b60efb313e9b · outbound

This paper cites Which LLM is the best?.

Improving LLM Leaderboards with Psychometrical Methodology Which LLM is the best?

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T12:49:37.721075Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T12:49:36.891607Z digest=sha256:803bd7f1fe47a3675da214efa49a77f7cdd7b05266aacd45d6819fa93dcd85f7

Observation e699e461-e502-412f-9bf0-ff35ab799a14 · outbound

This paper cites general cognitive ability.

Improving LLM Leaderboards with Psychometrical Methodology general cognitive ability

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T12:49:37.697537Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T12:49:36.899792Z digest=sha256:c5d45d2ba6a20a9b53e5e4836908a452c0c3b6cb34c2a90d7d55af433e51024b

Observation 95d639a3-1a32-4fbb-a236-b47181832b6a · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-10T12:49:36.907878Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T12:49:36.907878Z digest=sha256:0304b0ef1d34ec3f2faca1cd458f5053de65f0fcc3ee3502866a76bef871b50d

Observation fa2a2ec6-752c-4591-b353-06a55bfeebe2 · outbound

This paper cites outliers.

Improving LLM Leaderboards with Psychometrical Methodology outliers

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T12:49:37.685460Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T12:49:36.903628Z digest=sha256:8504d521a965ffdb2f948fa0cbe8e53226889775dcb44dd08b8581e291ded0ff

Observation bf5b87a5-5f7d-4d8e-a176-f70eb7475075 · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 20

Resolution
verified exact
raw_fallback, observed 2026-08-10T12:49:37.377673Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T12:49:36.927521Z digest=sha256:10dd6167ad6cd1ff072cd033dab5a1a2fecc7d47cb275ea597b5e79cbadc9762

Observation 307edf66-a4c8-46aa-9451-c7cc81ac6cd1 · outbound

This paper cites Variational Item Response Theory: Fast, Accurate, and Expressive.

Improving LLM Leaderboards with Psychometrical Methodology Variational Item Response Theory: Fast, Accurate, and Expressive

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-10T12:49:36.943661Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T12:49:36.943661Z digest=sha256:a4e320d73d51a8da3dcc77f82c188fbb52c578ef43d2f22137ae9f23ca151e96

Observation b5e49480-7491-4981-94f7-cfcff384d724 · outbound

This paper cites Sociological methodology, 30(1), 165-200.

Improving LLM Leaderboards with Psychometrical Methodology Sociological methodology, 30(1), 165-200

Reference 22

Resolution
verified exact
raw_fallback, observed 2026-08-10T12:49:37.223780Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T12:49:36.947895Z digest=sha256:cdaf6111bff3fae7623a8870765e90b00cfddc6f592ddbd36516a50d9903b0db

Observation 87d62a63-1f29-46f3-b3fd-46e0a97eeaa3 · outbound

This paper cites LawBench: Benchmarking Legal Knowledge of Large Language Models.

Improving LLM Leaderboards with Psychometrical Methodology LawBench: Benchmarking Legal Knowledge of Large Language Models

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-10T12:49:36.919546Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T12:49:36.919546Z digest=sha256:94718190bc2ce888646a9a8c076b7549eab4720c4b1aea911b1fc98db6a250d5

Observation b52efee5-1a38-45df-8026-a81d55cd2afa · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 95

Resolution
verified exact
doi, observed 2026-08-10T12:49:37.005164Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T12:49:36.931258Z digest=sha256:e20cf6ad6f108ebc9564911b481ddfe7efb220c8fa087ebd5b08a4a2c26a7640

Observation 2bac8fb8-bdc3-414e-bbd9-a2653163c17f · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 118

Resolution
verified exact
raw_fallback, observed 2026-08-10T12:49:37.611257Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T12:49:36.911549Z digest=sha256:3161cbbd7c741b9f5f86b815f1638dd3f4cf3e23495ee0e07ee8575e6dcf6ba8

Observation 3c3cca9e-2f10-4978-9f50-28b1c2445d49 · outbound

This paper cites Observational Scaling Laws and the Predictability of Language Model Performance.

Improving LLM Leaderboards with Psychometrical Methodology Observational Scaling Laws and the Predictability of Language Model Performance

Reference 306

Resolution
unresolved
no resolver link, observed 2026-08-10T12:49:36.935178Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T12:49:36.935178Z digest=sha256:a880c70a8a067ae606734545bcb7332d956c6e0a75bb2997a0c2fa5038f81246

Observation f80b7f35-9aed-42af-a5c9-5ad22940e80c · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 421

Resolution
unresolved
no resolver link, observed 2026-08-10T12:49:36.923696Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T12:49:36.923696Z digest=sha256:d4c152478e3cdb482b88245580473900a1081f634916afea333920670520b64c

Observation 74b141c5-4d4f-4f68-93ac-87ef82f2e36f · outbound

This paper cites A Survey on Evaluation of Large Language Models.

Improving LLM Leaderboards with Psychometrical Methodology A Survey on Evaluation of Large Language Models

Reference 839

Resolution
unresolved
no resolver link, observed 2026-08-10T12:49:36.915287Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T12:49:36.915287Z digest=sha256:28d872340df6bd408f88348fb9f52e77c99ca2194f6af968bb58a2333ffc5d46

Observation 4b4c5a5c-8091-44ca-ad87-26b5073f87eb · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 1978

Resolution
unresolved
raw_fallback, observed 2026-08-10T12:49:37.755898Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T12:49:36.878421Z digest=sha256:9d6405f5fe5815157c56b7e91bc5e2b01ca849dee7f0b38f51fd2a4168fde472

Observation 208d9e9b-16e0-425f-a461-991454459b56 · outbound

This paper cites These questions are administered in a 5-shot manner.

Improving LLM Leaderboards with Psychometrical Methodology These questions are administered in a 5-shot manner

Reference 2021

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T12:49:37.789631Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T12:49:36.864896Z digest=sha256:cf266c9f8e176a37359f93ac7228f071876841b91a09026751b54c0b18a36e13

Observation 39feace7-dccb-4d0f-aa12-ffa9193fb82e · outbound

This paper cites utilitarian.

Improving LLM Leaderboards with Psychometrical Methodology utilitarian

Reference 2022

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T12:49:37.709752Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T12:49:36.895830Z digest=sha256:d360104dacc4588af6b9bd25ca8acce10600eeda02f1026516eac4f6ccfc4f5e

Observation a0cb0ef7-aef5-4a74-852e-d8be4d49aaf9 · outbound

This paper cites an unresolved cited work.

Improving LLM Leaderboards with Psychometrical Methodology Unresolved cited work

Reference 2023

Resolution
unresolved
raw_fallback, observed 2026-08-10T12:49:37.801455Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T12:49:36.859904Z digest=sha256:a9cd1b183d472df1e46979e1fe581126addb3a4a9d0af16f9af145c09aed57f7

Observation 8b0e996b-44ec-40ca-a5fc-9db9d1ccb749 · outbound

This paper cites A clear ceiling effect indicates that further increases in the number of parameters in LLMs results in increasingly diminishing improvements in model performance.

Improving LLM Leaderboards with Psychometrical Methodology A clear ceiling effect indicates that further increases in the number of parameters in LLMs results in increasingly diminishing improvements in model performance

Reference 2024

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T12:49:37.733271Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T12:49:36.887573Z digest=sha256:89bcac80ec463fceefc8b79fcbc76ab63c43a2cdf469963f7c4ec9dd8d8246d8

Pith citing papers

Observation 90e94b55-168e-42ea-a437-178c91e53edc · inbound

HumorRank: A Tournament-Based Leaderboard for Evaluating Humor Generation in Large Language Models cites this paper.

HumorRank: A Tournament-Based Leaderboard for Evaluating Humor Generation in Large Language Models Improving LLM Leaderboards with Psychometrical Methodology

Reference 14

Resolution
verified exact
arxiv_id, observed 2026-05-13T23:08:25.140620Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-05-13T23:07:38.352198Z digest=sha256:e9542cfe98b2b983415d6743d5ffcf4a19c723c52ecbed20b76ca57f96c4a86e

Observation 3a697ee8-d627-4b5d-9157-e4b5721c4274 · inbound

HumorRank: A Tournament-Based Leaderboard for Evaluating Humor Generation in Large Language Models cites this paper.

HumorRank: A Tournament-Based Leaderboard for Evaluating Humor Generation in Large Language Models Improving LLM Leaderboards with Psychometrical Methodology

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-02T17:05:10.649774Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T17:05:10.649774Z digest=sha256:a9828aba2a8c7ddea2e1661ed33421789edd1ebeeef823f3f1ccf6b1aa0218b4