Pith. sign in

Paper Citation Record · LEDGER

Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

As of 7 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 17 inbound Pith citation observations for arXiv:2407.18370.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2407.18370 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 17 of 17 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 17 of 17 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T13:59:54.023882Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T18:40:02.360168Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 7090a3ea-a633-4d2a-a051-62b87f17c934 · inbound

A Survey on LLM-as-a-Judge cites this paper.

A Survey on LLM-as-a-Judge Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 60

Resolution
verified exact
arxiv_id, observed 2026-05-23T17:35:44.226111Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-23T17:33:13.394338Z digest=sha256:c5f60b87152915caed98ddb134ec84779451b537c1e7ca5f2b97cf2c103e63c7

Observation 09bf418e-0b48-4325-b65f-7cca8c25d156 · inbound

LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods cites this paper.

LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 107

Resolution
verified exact
arxiv_id, observed 2026-05-11T23:08:36.896485Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-11T23:08:34.312466Z digest=sha256:38e348843698f4319385480bf240214f0a8cea53d1377ce98c1e589f61d43969

Observation e58d48c8-f8da-4d62-92ae-dcb9336f3f37 · inbound

Amulet: Putting Complex Multi-Turn Conversations on the Stand with LLM Juries cites this paper.

Amulet: Putting Complex Multi-Turn Conversations on the Stand with LLM Juries Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T13:59:54.023882Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T13:59:54.023882Z digest=sha256:21fe59aac9f822323438e328f83cfd1ef8eeca3d49ec6cbdff54dfddac1457d0

Observation c424073a-bfd4-4170-a9ee-7d06548f9f18 · inbound

Conformal Arbitrage: Risk-Controlled Balancing of Competing Objectives in Language Models cites this paper.

Conformal Arbitrage: Risk-Controlled Balancing of Competing Objectives in Language Models Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-07T12:01:40.254252Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T12:01:40.254252Z digest=sha256:ce980b8407c05f0fedb184dedafca00c5265519cf1192310c6d9852d29c75709

Observation ac310bb2-807c-4fa9-96d4-77d0dae9d681 · inbound

Model Context Protocol (MCP) at First Glance: Studying the Security and Maintainability of MCP Servers cites this paper.

Model Context Protocol (MCP) at First Glance: Studying the Security and Maintainability of MCP Servers Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 69

Resolution
verified exact
arxiv_id, observed 2026-05-19T09:32:15.539528Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-19T09:32:08.596259Z digest=sha256:8e5cc3a0b1986430a203cb69d4e9c1642031fe07415ae7206f52c3423c4a5a85

Observation 8884d101-cb9b-478e-a31d-6bd08a954b8f · inbound

RAGtifier: Evaluating RAG Generation Approaches of State-of-the-Art RAG Systems for the SIGIR LiveRAG Competition cites this paper.

RAGtifier: Evaluating RAG Generation Approaches of State-of-the-Art RAG Systems for the SIGIR LiveRAG Competition Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T00:23:10.389859Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T00:23:10.389859Z digest=sha256:bb21c962dab4db3f991100c273f28361deba4801ccfd42b2f100045b91e1cf21

Observation 23bfdaf8-b932-4062-b746-684a6ff46bce · inbound

Watch, Listen, Understand, Mislead: Tri-modal Adversarial Attacks on Short Videos for Content Appropriateness Evaluation cites this paper.

Watch, Listen, Understand, Mislead: Tri-modal Adversarial Attacks on Short Videos for Content Appropriateness Evaluation Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-06T17:09:22.262209Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T17:09:22.262209Z digest=sha256:425e9c8fc4c809ac258228d08403f621d2fa0620e5041425ea68333858c25d8b

Observation 63707587-9d6a-4cc8-a362-e6103c2c9a5c · inbound

How to Correctly Report LLM-as-a-Judge Evaluations cites this paper.

How to Correctly Report LLM-as-a-Judge Evaluations Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 306

Resolution
unresolved
no resolver link, observed 2026-08-03T20:08:53.242333Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T20:08:53.242333Z digest=sha256:689cebced391bde8b8a55a536bc4a520bd9b463a9f473476cb6198da876492a5

Observation 91ae4156-363b-4a1f-89d0-e105c993573f · inbound

Beyond Accuracy: Policy Invariance as a Reliability Test for LLM Safety Judges cites this paper.

Beyond Accuracy: Policy Invariance as a Reliability Test for LLM Safety Judges Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 20

Resolution
verified exact
arxiv_id, observed 2026-05-11T20:01:12.388357Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-08T10:23:58.198464Z digest=sha256:850ece86b69631d445af2156939db691edd63a2bc83a1832347870fd46fad60b

Observation 1936330c-9434-486c-868d-4175b2912055 · inbound

Supporting System Testing with a Multi-Agent LLM-based Framework for Knowledge Graph Extraction: A Case Study with Ethernet Switch Systems cites this paper.

Supporting System Testing with a Multi-Agent LLM-based Framework for Knowledge Graph Extraction: A Case Study with Ethernet Switch Systems Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 11

Resolution
verified exact
arxiv_id, observed 2026-05-20T08:33:08.865965Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-20T08:32:39.748993Z digest=sha256:732f0cd6a043ad93c36358c8c36ddc426fa208ab5fbfa2aca1856c4138bdf9e8

Observation 6c8d0b8c-a0d7-4752-85bf-e365614a927c · inbound

BalanceRAG: Joint Risk Calibration for Cascaded Retrieval-Augmented Generation cites this paper.

BalanceRAG: Joint Risk Calibration for Cascaded Retrieval-Augmented Generation Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 16

Resolution
verified exact
arxiv_id, observed 2026-05-20T05:23:03.731291Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-05-20T05:19:45.438362Z digest=sha256:ed399c7dbcd31682428dbee59e56a9952824601b523b2d48a61bf854e91e1d48

Observation ec3071c8-b2b1-4db4-8ba2-038d4d6c30bf · inbound

Who judges the judges? Governance from metrics: a runtime framework for continuous LLM compliance monitoring cites this paper.

Who judges the judges? Governance from metrics: a runtime framework for continuous LLM compliance monitoring Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 9

Resolution
verified exact
arxiv_id, observed 2026-06-30T12:54:39.771070Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-06-30T12:53:51.591538Z digest=sha256:5bb411a93054a6f614ff7eaca1c76ebc67b23b1c288fab27ddac65f03189fd9a

Observation 9f261826-e90c-47d3-852a-b6830d20c174 · inbound

Cherry-pick Override: Unsafe Directional Commitment in LLM Judges under Mixed Evidence cites this paper.

Cherry-pick Override: Unsafe Directional Commitment in LLM Judges under Mixed Evidence Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 5

Resolution
metadata mismatch
arxiv_id, observed 2026-07-02T20:07:21.380474Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-06-27T21:02:12.302963Z digest=sha256:6f014cf2f839f0abed2dffc588fc45b81865df36065271b023d078436864510d

Observation 042d93eb-de1a-4e9a-aa71-ec7c0af784e9 · inbound

Towards Spec Learning: Inference-Time Alignment from Preference Pairs cites this paper.

Towards Spec Learning: Inference-Time Alignment from Preference Pairs Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 49

Resolution
metadata mismatch
arxiv_id, observed 2026-07-04T11:39:47.121009Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-06-26T07:49:36.816100Z digest=sha256:4ffc53a1caf16fa81ec723ef96881f35671da05ee47b0a89ca24f5867e0a32f7

Observation f3bb3349-48cc-42f1-b0bc-a2a57702cd49 · inbound

Towards Spec Learning: Inference-Time Alignment from Preference Pairs cites this paper.

Towards Spec Learning: Inference-Time Alignment from Preference Pairs Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 49

Resolution
metadata mismatch
arxiv_id, observed 2026-06-30T12:44:39.567868Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-06-30T10:17:33.176525Z digest=sha256:df95b9e550f0c565fe78621163ca6bdb8171a37ada34057e1fe1d6f1570f0d4e

Observation 032de267-95a9-4e78-9c15-daea2dce0477 · inbound

To Isolate or to Score? Model-Adaptive Assessment for Cost-Efficient Multi-Agent RAG cites this paper.

To Isolate or to Score? Model-Adaptive Assessment for Cost-Efficient Multi-Agent RAG Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 28

Resolution
verified exact
arxiv_id, observed 2026-07-04T18:40:02.361916Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-06-25T22:44:43.951083Z digest=sha256:95e9f1eb5d5b856009dc1812ae49392971571e4f3703f4b9a2802b2ee5d57460

Observation c7b2138c-b1b1-4ced-8ca5-3cdb490c6f38 · inbound

CodeRescue: Budget-Calibrated Recovery Routing for Coding Agents cites this paper.

CodeRescue: Budget-Calibrated Recovery Routing for Coding Agents Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-01T12:47:37.674516Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T12:47:37.674516Z digest=sha256:c4f697239d7ecaf886e0ab652121934266460b308be3babf325f1937d8a02b62