Paper Citation Record · LEDGER

How Reliable is Multilingual LLM-as-a-Judge?

As of 21 August 2026, this Paper Citation Record lists 45 of 45 outbound references and 1 inbound Pith citation observation for arXiv:2505.12201.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.12201 v1

Coverage vector

measured 45 of 45 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-15T20:43:14.349012Z

measured 46 of 46 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-21T06:32:19.484+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-05T17:11:46.642722Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-05T17:11:48.533902Z

Reference resolution

45 of 45 outbound references displayed

verified exact0
verified fuzzy0
unresolved45
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 38456081-f736-4cda-8fd5-9bed064b9f1a · outbound

This paper cites URL: " 'urlintro :=.

How Reliable is Multilingual LLM-as-a-Judge? URL: " 'urlintro :=

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.122186Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e5116b4c-44a9-4853-b18c-8ad13d1ec2c6 · outbound

This paper cites write newline.

How Reliable is Multilingual LLM-as-a-Judge? write newline

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.127879Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5c0cc8f8-195e-4c49-91dc-c2e1efc9824e · outbound

This paper cites GPT-4 Technical Report.

How Reliable is Multilingual LLM-as-a-Judge? GPT-4 Technical Report

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.134057Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bedaf1e3-ae63-41db-9460-cefb38c40993 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.140035Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7354c741-022a-4e6e-b9d1-cf212cc40fcf · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.145289Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 75b0359e-59dd-48c2-89bb-3bac2f7c2df6 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.150321Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 09baa13e-54c3-4d55-9f80-ee15b3c92f99 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.155402Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 90cd1e40-b8e1-401a-9f62-33b8c35dc081 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.160038Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 474403f8-bb1d-47e6-9dca-350d1ade0a91 · outbound

This paper cites Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier.

How Reliable is Multilingual LLM-as-a-Judge? Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.165434Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2085bc7a-cafd-4a0b-8aea-1931687122dd · outbound

This paper cites The Llama 3 Herd of Models.

How Reliable is Multilingual LLM-as-a-Judge? The Llama 3 Herd of Models

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.170885Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0bc35f99-a5be-426e-b8dd-5c09e7aa3b3e · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.175759Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3d69b5a5-7584-4cde-8704-a6f65fbfc8bc · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.180798Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9a3e4424-f717-45d4-9b13-a677eef8a266 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.185728Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2655ba74-b905-437a-8c1e-8b3ff652f639 · outbound

This paper cites Human-like Summarization Evaluation with ChatGPT.

How Reliable is Multilingual LLM-as-a-Judge? Human-like Summarization Evaluation with ChatGPT

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.190656Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3ad35e2b-1968-4f4d-946c-e66f30c2523b · outbound

This paper cites A Survey on LLM-as-a-Judge.

How Reliable is Multilingual LLM-as-a-Judge? A Survey on LLM-as-a-Judge

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.195841Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2823df5b-38f3-4716-be86-8717237f7d3e · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-08-15T20:43:15.168247Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation fe8ad60d-8348-494a-b2b9-f936700ec648 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.205375Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 990e5c8b-36a0-4637-bbb2-3647cd39009b · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.210209Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6508d919-14d8-4ac9-b6f4-9aac46b60366 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.214919Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6199da80-df62-48e6-869b-a2b18755b5bb · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.224476Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 81abd44c-cd96-4073-a20b-37c1cdb46f5a · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.230733Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c2616dcd-2d1d-4fca-994d-3f3ce315bd7c · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.236086Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0d5c521d-6e8a-4f2b-9d15-ee1dd6eb1ea4 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.241405Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 32128faf-bbf3-4491-80eb-25f90069b28d · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 24

Resolution: unresolved; raw_fallback, observed 2026-08-15T20:43:15.131869Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 2d11d52b-bc88-4d5a-9b9c-766ad74cd915 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.251036Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation efd570a0-c17b-4719-8507-f644551af486 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.255834Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b3fd7539-c33a-402b-b576-f31b08f29c50 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.260725Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a8ea0f93-c02e-419c-86e0-dba87e09fda3 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.266197Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3ad79c96-c90d-47f2-88f9-3352aaca08fa · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.270930Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation aff7d780-af52-47f4-b21f-eaa41ed97855 · outbound

This paper cites Verbosity Bias in Preference Labeling by Large Language Models.

How Reliable is Multilingual LLM-as-a-Judge? Verbosity Bias in Preference Labeling by Large Language Models

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.275671Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation de8f8f46-dc97-44b3-b9b1-82afa5199486 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.280822Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ba2352a9-0216-4ca9-ab8b-51f7ace637af · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.285440Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 67768767-cdb4-4e32-ad73-b1e200c56d95 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.290187Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5eb711d3-fb13-4465-b3f4-a8c5f8722f2f · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.294974Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e5eef079-152f-4bca-93a7-ac8a0e35aa35 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.299817Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2ff49664-4a5b-4ef1-8c79-c4ac170bb3ca · outbound

This paper cites Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models.

How Reliable is Multilingual LLM-as-a-Judge? Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.304693Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e3be3669-a67d-412b-91a5-939d61b70841 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.309589Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cef5f12f-4658-450a-a749-e6f46ef53078 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.314122Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5c355fc3-6f8f-445a-86c9-61c460d59032 · outbound

This paper cites Self-Taught Evaluators.

How Reliable is Multilingual LLM-as-a-Judge? Self-Taught Evaluators

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.319262Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 44f1bfe0-3fd2-4fc4-9748-ed1eaa6631dd · outbound

This paper cites Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judge.

How Reliable is Multilingual LLM-as-a-Judge? Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judge

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.324324Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d6b7d6aa-d589-41d1-b584-61084ee63ec4 · outbound

This paper cites Qwen2.5 Technical Report.

How Reliable is Multilingual LLM-as-a-Judge? Qwen2.5 Technical Report

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.329590Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6e8ca840-9feb-4fc4-b30d-7709179a39cf · outbound

This paper cites Justice or Prejudice? Quantifying Biases in LLM-as-a-Judge.

How Reliable is Multilingual LLM-as-a-Judge? Justice or Prejudice? Quantifying Biases in LLM-as-a-Judge

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.334417Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ffea80d1-0925-46e4-8364-517abad03145 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.339176Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 25f947f8-a4cb-4836-9bc4-070ea603ee85 · outbound

This paper cites an unresolved cited work.

How Reliable is Multilingual LLM-as-a-Judge? Unresolved cited work

Reference 44

Resolution: unresolved; raw_fallback, observed 2026-08-15T20:43:15.072198Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation d3e155cb-bed5-48ab-b0e2-81d81da632bc · outbound

This paper cites JudgeLM: Fine-tuned Large Language Models are Scalable Judges.

How Reliable is Multilingual LLM-as-a-Judge? JudgeLM: Fine-tuned Large Language Models are Scalable Judges

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-15T20:43:14.349012Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation 41c0fbbc-1ca5-4c2b-8d44-f40ab0bbac35 · inbound

Cross-Lingual Bias in Large Language Models: A Comparative Analysis of English and Swahili cites this paper.

Cross-Lingual Bias in Large Language Models: A Comparative Analysis of English and Swahili How Reliable is Multilingual LLM-as-a-Judge?

Reference 20

Resolution: metadata mismatch; local_arxiv, observed 2026-08-05T17:11:48.654872Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.