Pith. sign in

Paper Citation Record · LEDGER

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations

As of 23 August 2026, this Paper Citation Record lists 10 of 10 outbound references and 3 inbound Pith citation observations for arXiv:2606.26185.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2606.26185 v1

Coverage vector

measured 10 of 10 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-06-26T01:53:46.908577Z

measured 13 of 13 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-23T06:30:58.430688+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-06T00:08:34.857363Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-06T00:08:59.601333Z

Reference resolution

10 of 10 outbound references displayed

  • verified exact6
  • verified fuzzy0
  • unresolved4
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 68dd176a-ee0a-4225-8829-24ca2bb259a4 · outbound

This paper cites Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena

Reference 1

Resolution
verified exact
local_arxiv, observed 2026-07-04T15:09:54.397648Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:e56b06524e36a6443017710230efad43d1dbaa1e01d2fab04d8fd2a7b9fa43c5

Observation d9252ef9-ee39-4429-9e4f-00b56cfd1ce0 · outbound

This paper cites Large Language Models are not Fair Evaluators.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Large Language Models are not Fair Evaluators

Reference 2

Resolution
verified exact
local_arxiv, observed 2026-07-04T15:09:54.394732Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:aa10beb185577094be726111d0718d69df1f4833e548d3e2641d71a19b810343

Observation f43997db-3bdb-474f-90a4-8c06e8722afd · outbound

This paper cites He et al.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations He et al

Reference 3

Resolution
unresolved
no resolver link, observed 2026-06-26T01:53:46.908577Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:34df6b3258fdd1598159c5709c81a3e7ace4442393f91703693d5a87bf0e5a0b

Observation 94ef8115-7063-4838-8e90-13f09e43a0a6 · outbound

This paper cites Large Language Models are Inconsistent and Biased Evaluators.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Large Language Models are Inconsistent and Biased Evaluators

Reference 4

Resolution
verified exact
arxiv_id, observed 2026-07-04T15:09:54.390910Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:a53fb8bc0d4bb716813d502ce26ccf52fd630e988f3c5e2b9c3abf676b8bd047

Observation d5567166-653f-46d3-8b4f-6305a48227ae · outbound

This paper cites Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences

Reference 5

Resolution
verified exact
arxiv_id, observed 2026-07-04T15:09:54.401489Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:6c48c4a60815b5bb87c86c953b1d7b777677d1e55ad5444b2093409002ee6a73

Observation 189e457b-f67b-4553-8c8a-6da98d13c595 · outbound

This paper cites aisev issue \#25: Reproducibility Improvement Proposal.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations aisev issue \#25: Reproducibility Improvement Proposal

Reference 6

Resolution
unresolved
no resolver link, observed 2026-06-26T01:53:46.908577Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:f9cbaa249006273e37b41d37a937f3db4b709c4ca519a36cd22d6b7e0a526e38

Observation 93eabea6-89e7-4ffb-9cd1-237861675781 · outbound

This paper cites Your Agent Is Mine: Measuring Malicious Intermediary Attacks on the LLM Supply Chain.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Your Agent Is Mine: Measuring Malicious Intermediary Attacks on the LLM Supply Chain

Reference 7

Resolution
verified exact
local_arxiv, observed 2026-07-04T15:09:54.405024Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:c741719486f4c7d61b355ffab8e1453b697a269c34a2f6d19af070a7cf3fed1d

Observation fd8186c6-12ef-408f-b379-cd8d87433438 · outbound

This paper cites an unresolved cited work.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Unresolved cited work

Reference 8

Resolution
unresolved
no resolver link, observed 2026-06-26T01:53:46.908577Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:e17bfe565e2d36b8d1b003fcd22549d9957d757c0cd132cea20d9c165b4ff0cc

Observation 9195e983-de97-45ee-9943-5e3c8c0a9acb · outbound

This paper cites Route Claude CLI traffic through AI Gateway and D ash S cope.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Route Claude CLI traffic through AI Gateway and D ash S cope

Reference 9

Resolution
unresolved
no resolver link, observed 2026-06-26T01:53:46.908577Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:d49fe9ac3d96ff6de54fffc61c41fdbdf6d9b24c59714c4756c3128ad4036aed

Observation a08f84e1-1907-4abf-82fa-c9c1ed56193b · outbound

This paper cites an unresolved cited work.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Unresolved cited work

Reference 10

Resolution
verified exact
doi, observed 2026-06-26T01:58:54.253270Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:9569a6f9c0ecf4f48fdbda526e4147ed50d03c42424d27e5be2182c49655750f

Pith citing papers

Observation 992e5398-d529-4625-a9f2-499d87be3443 · inbound

Compaction as Epistemic Failure: How Agentic LLM Tools Fabricate Confirmed Results from Killed Processes cites this paper.

Compaction as Epistemic Failure: How Agentic LLM Tools Fabricate Confirmed Results from Killed Processes Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-02T07:23:27.844913Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T07:23:27.844913Z digest=sha256:dd0ecd51bcb457a40d4e15f0c7f645a0c477e4edb2cd050d2a82afc246302512

Observation e7b10dc4-40f6-412b-871d-e1e56e0109ce · inbound

Position Bias is Hidden Behind Ceiling Effects: A Permutation Diagnostic for LLM Benchmarks cites this paper.

Position Bias is Hidden Behind Ceiling Effects: A Permutation Diagnostic for LLM Benchmarks Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-01T09:13:30.692459Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T09:13:30.692459Z digest=sha256:e1fc30a58d084b07a224580db0cee9f890deb20ac5b7a959bf2d4a6f5cb9daff

Observation c8c64de8-d069-48e4-8ef3-2b95063da1e2 · inbound

Measuring Product Quality Using Images: The CLIP Q-Score and an Application to Real Estate cites this paper.

Measuring Product Quality Using Images: The CLIP Q-Score and an Application to Real Estate Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations

Reference 77

Resolution
metadata mismatch
local_arxiv, observed 2026-08-06T00:08:59.802374Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-08-06T00:08:34.857363Z digest=sha256:07ae47ae187e48304ff5bd786b54fa06f59e02b2e273d0a993a1ff01d95cb3a9