Paper Citation Record · LEDGER

Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking

As of 20 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 11 inbound Pith citation observations for arXiv:2409.15268.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2409.15268 v3

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 11 of 11 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-20T06:33:59.587034+00:00

measured 11 of 11 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-16T12:09:30.995669Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-21T08:59:55.282302Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 113f4932-bff7-4f33-a9f7-87b8f4a4f63c · inbound

JuStRank: Benchmarking LLM Judges for System Ranking cites this paper.

JuStRank: Benchmarking LLM Judges for System Ranking Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-11T16:59:49.485061Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bcb0113d-cadd-4e51-b422-9ec778c4aa08 · inbound

Revisiting Uncertainty Quantification Evaluation in Language Models: Spurious Interactions with Response Length Bias Results cites this paper.

Revisiting Uncertainty Quantification Evaluation in Language Models: Spurious Interactions with Response Length Bias Results Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-16T12:09:30.995669Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7675ace2-b13c-44df-9582-dab965298b83 · inbound

Evaluating Judges as Evaluators: The JETTS Benchmark of LLM-as-Judges as Test-Time Scaling Evaluators cites this paper.

Evaluating Judges as Evaluators: The JETTS Benchmark of LLM-as-Judges as Test-Time Scaling Evaluators Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-16T11:33:53.354266Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 81afd1b5-4835-49fc-b1d7-f747130c89b4 · inbound

Guillotine: Hypervisors for Isolating Malicious AIs cites this paper.

Guillotine: Hypervisors for Isolating Malicious AIs Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-16T11:28:45.431092Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a1e8dd68-4f2c-469a-9845-439d8b3b5b15 · inbound

WorldPM: Scaling Human Preference Modeling cites this paper.

WorldPM: Scaling Human Preference Modeling Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-15T21:12:52.576766Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bc074de8-e6eb-408b-bfe5-ccef2fb27b58 · inbound

Can LLMs Reason Structurally? Benchmarking via the Lens of Data Structures cites this paper.

Can LLMs Reason Structurally? Benchmarking via the Lens of Data Structures Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking

Reference 2025

Resolution: malformed identifier; no resolver link, observed 2026-08-07T12:42:38.753358Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d5d04af2-9785-46e1-8bee-dee2e8beec6e · inbound

RAGtifier: Evaluating RAG Generation Approaches of State-of-the-Art RAG Systems for the SIGIR LiveRAG Competition cites this paper.

RAGtifier: Evaluating RAG Generation Approaches of State-of-the-Art RAG Systems for the SIGIR LiveRAG Competition Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-07T00:23:09.955657Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 790eb472-0233-4070-a125-d8f79dc8d3ce · inbound

LitBench: A Benchmark and Dataset for Reliable Evaluation of Creative Writing cites this paper.

LitBench: A Benchmark and Dataset for Reliable Evaluation of Creative Writing Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-06T21:12:44.870655Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 17d19ec5-6bb5-45db-b084-e56ed6458ac5 · inbound

Learning Preference-Based Objectives from Clinical Narratives for Dynamic Sepsis Treatment cites this paper.

Learning Preference-Based Objectives from Clinical Narratives for Dynamic Sepsis Treatment Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking

Reference 9

Resolution: unresolved; no resolver link, observed 2026-07-12T22:22:06.385856Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9d297682-fc5f-49ce-8f05-c7a34bf2284c · inbound

TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-training cites this paper.

TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-training Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking

Reference 8

Resolution: verified exact; arxiv_id, observed 2026-05-11T10:21:02.996153Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation f69e5be1-f9f2-47c5-ac28-cd815bd0b250 · inbound

TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-training cites this paper.

TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-training Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking

Reference 8

Resolution: verified exact; arxiv_id, observed 2026-05-21T08:59:55.284856Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.