Paper Integrity Record · LEDGER

Inside the Unfair Judge: A Mechanistic Interpretability Account of LLM-as-Judge Bias

As of 3 August 2026, Pith completed 8 of 8 listed checks against arXiv:2607.11871. The completed checks produced 1 public finding within their stated scope.

This is a record of named checks, not a clean-status claim or a paper verdict.

pith.integrity.v1
2607.11871 v1
pith:2026:ULXVDONQPB2X556WEK4JNU3D3O

Coverage vector

completed 8 of 8 listed checks

Counted as completed checks in the claim sentence numerator.

Listed checks

doi_compliance

completed

v1.1.0, observed 2026-08-03 04:30:51.360235+00:00

Scope: DOI and arXiv identifiers listed in the bibliography checked against named registries.
Completed surface: Checked 54 references.

doi_title_agreement

completed

v1.0.0, observed 2026-08-01 03:38:49.517474+00:00

Scope: Cited titles compared with titles resolved from their DOI or arXiv identifier.
Completed surface: Checked 3 references.

ai_meta_artifact

completed

v1.0.0, observed 2026-07-28 10:52:46.761327+00:00

Scope: Paper body text scanned for literal AI-assistant artifacts.
Completed surface: Checked 1 reference. Recorded 1 finding from this run.

claim_evidence

completed

v1.0.0, observed 2026-07-20 09:47:43.100293+00:00

Scope: Recorded paper claims checked for the evidence artifacts they name.
Completed surface: Completed within the stated scope.

external_links

completed

v1.0.0, observed 2026-07-14 17:34:10.519423+00:00

Scope: External URLs extracted from paper text checked at the stated time.
Completed surface: Checked 20 references. Recorded 2 findings from this run.

shingle_duplication

completed

v0.1.0, observed 2026-07-14 05:53:50.600326+00:00

Scope: Available paper body text compared for identical 40-token sequences under the detector's stated exclusions.
Completed surface: Checked 600 references.

citation_quote_validity

completed

v0.1.0, observed 2026-07-14 03:57:04.918081+00:00

Scope: Specific factual attributions checked against cited-paper text available in Pith.
Completed surface: Completed within the stated scope.

cited_work_retraction

completed

v1.0.0, observed 2026-07-14 02:50:08.766054+00:00

Scope: Cited references checked for source-reported retractions or expressions of concern.
Completed surface: Checked 4 references.

Observations

Methods and limits

Each listed check names the surface it examined. A skipped, failed, partial, unavailable, not collected, not requested, or withheld check says nothing about what a completed check would have returned.

Only checks with status completed enter the claim sentence numerator.
Findings appear only from completed checks and only within the scope printed for that check.
Severity labels describe one observation row. They do not roll up into a paper judgment.