Pith. sign in

Paper Citation Record · LEDGER

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking

As of 12 August 2026, this Paper Citation Record lists 32 of 32 outbound references and 0 inbound Pith citation observations for arXiv:2607.02104.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.02104 v2

Coverage vector

measured 32 of 32 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-02T09:07:09.975928Z

measured 32 of 32 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

32 of 32 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved32
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 7ec9f25a-06f5-408e-8d72-524762308f02 · outbound

This paper cites Communication, Simulation, and Intelligent Agents: Implications of Personal Intelligent Machines for Medical Education.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Communication, Simulation, and Intelligent Agents: Implications of Personal Intelligent Machines for Medical Education

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:08.781401Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:08.781401Z digest=sha256:a5381f564ee60cc1897782ff01e6694a7e499fd738ecbd3e4186a739d4faea01

Observation 8aba45e1-dd91-40e3-abda-ab6c1ca7968f · outbound

This paper cites Classification Problem Solving.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Classification Problem Solving

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:08.809637Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:08.809637Z digest=sha256:d77e2bb58d60c0d47e33f3110d7ffdccf615c8366c847570f6fb8c46c676bacd

Observation 7353e713-0dd6-41b4-9fe9-312c2d0b9666 · outbound

This paper cites , title =.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking , title =

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:08.854764Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:08.854764Z digest=sha256:1961eab09e84f1ec2596bd036fbada8fd6c87d4b8eb11d0f967eb95ac15bbe0c

Observation 3d0657f5-6ba2-49a6-980c-d2b6ef631767 · outbound

This paper cites New Ways to Make Microcircuits Smaller---Duplicate Entry.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking New Ways to Make Microcircuits Smaller---Duplicate Entry

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:08.884656Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:08.884656Z digest=sha256:e6adfd488c25849c4f421004e31582ab403d1fe8f2abd9943b70d8b2684c18fd

Observation 3f166104-5f09-49da-b2b8-04d76690309f · outbound

This paper cites Clancey and Glenn Rennels , abstract =.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Clancey and Glenn Rennels , abstract =

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:08.915199Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:08.915199Z digest=sha256:b053065cd6bce3b737b95b2f8172bfe3c5805345d62c320c36d8a48af788c663

Observation 63eb8679-81b3-4f50-ad19-55af961cc6d0 · outbound

This paper cites and Rennels, Glenn R.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking and Rennels, Glenn R

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:08.954747Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:08.954747Z digest=sha256:5daba40f7cde8b6f9be7db9c9c5b9092c5014dbe1b2f3a76a42834dd81ed0833

Observation 70ed6410-44d2-40dc-a5c1-c581e2adb27c · outbound

This paper cites Poligon: A System for Parallel Problem Solving.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Poligon: A System for Parallel Problem Solving

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:08.985926Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:08.985926Z digest=sha256:f1f60c79773652f032721645572f759c7368ea4fa0aad6cda58e2554d7e498f8

Observation 6c3590f4-f914-4971-9b6b-459a915fdca1 · outbound

This paper cites Transfer of Rule-Based Expertise through a Tutorial Dialogue.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Transfer of Rule-Based Expertise through a Tutorial Dialogue

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.025823Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.025823Z digest=sha256:c955b3741fa2f60199e70dee864ca3846fa90bd864f76c717e9741db0d845ea9

Observation a740a8d2-0be9-42b7-9a39-7d7b198a322d · outbound

This paper cites The Engineering of Qualitative Models.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking The Engineering of Qualitative Models

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.094760Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.094760Z digest=sha256:1a7e13cd996ed8890b5da2e22b83f48e3dcfb3573d6214e204d8036502e49fd6

Observation f11154ad-5ab3-43bb-b3ea-9e08ca244738 · outbound

This paper cites 2023 , eprint=.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking 2023 , eprint=

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.130382Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.130382Z digest=sha256:7ed412ddb5771aca8d0df29142cd2869975cba1802b383657454ccd0addf2105

Observation 2b466ae9-1539-4528-bfa4-27ff38dc28cf · outbound

This paper cites Pluto: The 'Other' Red Planet.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Pluto: The 'Other' Red Planet

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.170360Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.170360Z digest=sha256:eb3f3b9263d11d21fca153285e247d11ea83c070661f790e4c293e8c63894b9e

Observation 6487f094-b4e4-4dca-a308-084d6ef68b9b · outbound

This paper cites The Method of Paired Comparisons , author=.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking The Method of Paired Comparisons , author=

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.195431Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.195431Z digest=sha256:864e3d7e76611c74a6ecc8ea95f0d6abf4692a5594637d4bb63b363ba4ac3e67

Observation cb0891fd-86b6-4659-9e04-a4a45347a7d2 · outbound

This paper cites an unresolved cited work.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Unresolved cited work

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.225600Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.225600Z digest=sha256:510b21598f29501c6a0218265acbdbdd2db0e58108260574eb7077da625bc6f9

Observation f9b7ca97-6725-4f79-8616-c0a054098873 · outbound

This paper cites Proceedings of the Association for Computational Linguistics (ACL) , year=.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Proceedings of the Association for Computational Linguistics (ACL) , year=

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.274750Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.274750Z digest=sha256:7c9a7b8865936e37a72de43b6cfaca2188baa525ea5277458f528b0f8003762b

Observation b0953de7-e6af-4808-88d0-d0f9871e138b · outbound

This paper cites International Conference on Learning Representations (ICLR) , year=.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking International Conference on Learning Representations (ICLR) , year=

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.334828Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.334828Z digest=sha256:f8547be97a3a2f5976e1270e105ca29c45dc57893591b0d982185f9ae1e1ab7a

Observation 9e0f950d-efd8-4fb7-a4c3-26339a0b75ef · outbound

This paper cites Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluators.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluators

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.375261Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.375261Z digest=sha256:d6a1022ab872e12c217292c11b4b7d2432b171d3958c34ff54d66d4334fb792a

Observation 31005469-1d36-42c5-b068-0a641560849a · outbound

This paper cites Verbosity Bias in Preference Labeling by Large Language Models.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Verbosity Bias in Preference Labeling by Large Language Models

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.399732Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.399732Z digest=sha256:28a2094a9624453dc5edb9a3709e2b9c029a36d1658ef07779e96a3393503c74

Observation f4831f9b-e086-4010-97ce-5ca5ab5e1704 · outbound

This paper cites From Generation to Judgment: Opportunities and Challenges of.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking From Generation to Judgment: Opportunities and Challenges of

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.419396Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.419396Z digest=sha256:87aaf6f22c1eb52679ab23a7b0b5c0788eddb16fc4682052f07d728d250b1f2d

Observation 34e464f4-0cd4-48c4-bca8-12ae59594b8d · outbound

This paper cites Findings of the Association for Computational Linguistics (ACL) , year=.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Findings of the Association for Computational Linguistics (ACL) , year=

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.464767Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.464767Z digest=sha256:f4c1c043e8a4caed986383e04f4d1cbed17151132112fd465ba8d1af2468aa1a

Observation 47fcfe40-0d87-4f03-a0bc-ee4445b994dd · outbound

This paper cites Textual Bayes: Quantifying Prompt Uncertainty in LLM-Based Systems.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Textual Bayes: Quantifying Prompt Uncertainty in LLM-Based Systems

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.534780Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.534780Z digest=sha256:ff3d60553b58bd7b372ec5c798b5ecb2e47837cd5c68182470a427d60fa0a376

Observation 85527fe3-454b-4f1b-b09b-3c34818fa45d · outbound

This paper cites an unresolved cited work.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Unresolved cited work

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.564775Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.564775Z digest=sha256:d8094c50e40a2805d9339c365260e60da2873fdc75f902fd8f9503d9c3dbebb5

Observation 479bb0df-c07b-48ff-9d9e-2e6d7130d8ba · outbound

This paper cites Advances in Neural Information Processing Systems (NeurIPS) , year=.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Advances in Neural Information Processing Systems (NeurIPS) , year=

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.619416Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.619416Z digest=sha256:89fe5742e7b86b1706bc48a3a088db236b23dea94d62dbfd27eef9579f12e68f

Observation 403b8586-2ffa-4f57-8080-8a34daf33677 · outbound

This paper cites Bayesian Active Learning for Classification and Preference Learning.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Bayesian Active Learning for Classification and Preference Learning

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.664755Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.664755Z digest=sha256:fdf84c855880748b47f8feefafde182fdb6f6d6ad4045a267ebf58b86b615478

Observation 1e5e415b-040f-459f-930c-a663448ea788 · outbound

This paper cites Online Rank Elicitation for.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Online Rank Elicitation for

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.704781Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.704781Z digest=sha256:454142566add43a4b467b0e52239a199b4af90ddbe2da586ab87bdda5a2ee53e

Observation 17672615-dffe-4862-8a76-ca60550431f6 · outbound

This paper cites The Annals of Statistics , volume=.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking The Annals of Statistics , volume=

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.730520Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.730520Z digest=sha256:8036c148bb29b87c8c4ceb3d21435257f7107f873482f94e17ab587187f3464a

Observation 5679c7e8-850d-45fe-a371-14ded88cdaad · outbound

This paper cites Econometrica: journal of the Econometric Society , pages=.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Econometrica: journal of the Econometric Society , pages=

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.754773Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.754773Z digest=sha256:f3977755b07db8583e14895f4ac9faa6729e35f14d42131424a6d24f4209bdcb

Observation 2adfbabe-d94e-4dae-8794-7b9582138e60 · outbound

This paper cites The review of economic studies , volume=.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking The review of economic studies , volume=

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.794913Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.794913Z digest=sha256:0c0b3774584a17b468e406e4975debc72dc4033e12d15327446c6227f7b9971f

Observation abf2a195-854a-4625-a383-24690d90bd1d · outbound

This paper cites Journal of econometrics , volume=.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Journal of econometrics , volume=

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.828419Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.828419Z digest=sha256:017431a14a0788db140fe14dc890c4732a343b8995672fde8e77d0971e60b48a

Observation f6c80540-15eb-45d0-a6b5-6474e0813b2e · outbound

This paper cites Journal of the Royal Statistical Society Series B: Statistical Methodology , volume=.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Journal of the Royal Statistical Society Series B: Statistical Methodology , volume=

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.860216Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.860216Z digest=sha256:72519d2316218e134c4fd17f575807fcd2a596211248383167da30ae817cd9ad

Observation 9cedcd13-6770-41b5-9cdb-8a2a477b3a40 · outbound

This paper cites Psychometrika , volume=.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking Psychometrika , volume=

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.894781Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.894781Z digest=sha256:40d6bbef92ffeced855c51dfb6cb3bafd790c69d330261b715f788bdc873db1b

Observation e23a694a-9c1d-4b69-a340-bc57ba18f53b · outbound

This paper cites 2012 , publisher=.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking 2012 , publisher=

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.946382Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.946382Z digest=sha256:0fef043633b79b478effadfd50bbe5cabfa07adc88fec9f752b210bc99db042b

Observation eb7928f5-714f-499b-b1ac-9c6e72ada790 · outbound

This paper cites 1989 , school=.

When Can You Debias an LLM Judge? Identifiability Limits, a Test, and Designs for Top-k Ranking 1989 , school=

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-02T09:07:09.975928Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T09:07:09.975928Z digest=sha256:ed191e6c58224ac4e742954199981771d93714c4c739e99969d38fee3a7cc3ce

Pith citing papers

No inbound Pith citation observations are available.