Paper Citation Record · LEDGER

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations

As of 11 August 2026, this Paper Citation Record lists 10 of 10 outbound references and 3 inbound Pith citation observations for arXiv:2606.26185.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2606.26185 v1

Coverage vector

measured 10 of 10 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-06-26T01:53:46.908577Z

measured 13 of 13 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-11T06:34:44.6726+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-06T00:08:34.857363Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-06T00:08:59.601333Z

Reference resolution

10 of 10 outbound references displayed

verified exact6
verified fuzzy0
unresolved4
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 68dd176a-ee0a-4225-8829-24ca2bb259a4 · outbound

This paper cites Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena

Reference 1

Resolution: verified exact; local_arxiv, observed 2026-07-04T15:09:54.397648Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation d9252ef9-ee39-4429-9e4f-00b56cfd1ce0 · outbound

This paper cites Large Language Models are not Fair Evaluators.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Large Language Models are not Fair Evaluators

Reference 2

Resolution: verified exact; local_arxiv, observed 2026-07-04T15:09:54.394732Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation f43997db-3bdb-474f-90a4-8c06e8722afd · outbound

This paper cites He et al.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations He et al

Reference 3

Resolution: unresolved; no resolver link, observed 2026-06-26T01:53:46.908577Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 94ef8115-7063-4838-8e90-13f09e43a0a6 · outbound

This paper cites Large Language Models are Inconsistent and Biased Evaluators.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Large Language Models are Inconsistent and Biased Evaluators

Reference 4

Resolution: verified exact; arxiv_id, observed 2026-07-04T15:09:54.390910Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation d5567166-653f-46d3-8b4f-6305a48227ae · outbound

This paper cites Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences

Reference 5

Resolution: verified exact; arxiv_id, observed 2026-07-04T15:09:54.401489Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 189e457b-f67b-4553-8c8a-6da98d13c595 · outbound

This paper cites aisev issue \#25: Reproducibility Improvement Proposal.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations aisev issue \#25: Reproducibility Improvement Proposal

Reference 6

Resolution: unresolved; no resolver link, observed 2026-06-26T01:53:46.908577Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 93eabea6-89e7-4ffb-9cd1-237861675781 · outbound

This paper cites Your Agent Is Mine: Measuring Malicious Intermediary Attacks on the LLM Supply Chain.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Your Agent Is Mine: Measuring Malicious Intermediary Attacks on the LLM Supply Chain

Reference 7

Resolution: verified exact; local_arxiv, observed 2026-07-04T15:09:54.405024Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation fd8186c6-12ef-408f-b379-cd8d87433438 · outbound

This paper cites an unresolved cited work.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Unresolved cited work

Reference 8

Resolution: unresolved; no resolver link, observed 2026-06-26T01:53:46.908577Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9195e983-de97-45ee-9943-5e3c8c0a9acb · outbound

This paper cites Route Claude CLI traffic through AI Gateway and D ash S cope.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Route Claude CLI traffic through AI Gateway and D ash S cope

Reference 9

Resolution: unresolved; no resolver link, observed 2026-06-26T01:53:46.908577Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a08f84e1-1907-4abf-82fa-c9c1ed56193b · outbound

This paper cites an unresolved cited work.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Unresolved cited work

Reference 10

Resolution: verified exact; doi, observed 2026-06-26T01:58:54.253270Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Pith citing papers

Observation 992e5398-d529-4625-a9f2-499d87be3443 · inbound

Compaction as Epistemic Failure: How Agentic LLM Tools Fabricate Confirmed Results from Killed Processes cites this paper.

Compaction as Epistemic Failure: How Agentic LLM Tools Fabricate Confirmed Results from Killed Processes Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-02T07:23:27.844913Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e7b10dc4-40f6-412b-871d-e1e56e0109ce · inbound

Position Bias is Hidden Behind Ceiling Effects: A Permutation Diagnostic for LLM Benchmarks cites this paper.

Position Bias is Hidden Behind Ceiling Effects: A Permutation Diagnostic for LLM Benchmarks Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-01T09:13:30.692459Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c8c64de8-d069-48e4-8ef3-2b95063da1e2 · inbound

Measuring Product Quality Using Images: The CLIP Q-Score and an Application to Real Estate cites this paper.

Measuring Product Quality Using Images: The CLIP Q-Score and an Application to Real Estate Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations

Reference 77

Resolution: metadata mismatch; local_arxiv, observed 2026-08-06T00:08:59.802374Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.