Pith. sign in

Paper Integrity Record · LEDGER

Talk is (Not) Cheap: A Taxonomy and Benchmark Coverage Audit for LLM Attacks

As of 26 May 2026, Pith completed 5 of 6 listed checks against arXiv:2605.15118. The completed checks produced no public findings within their stated scope. 1 check was skipped and produced no result.

This is a record of named checks, not a clean-status claim or a paper verdict.

pith.integrity.v1
2605.15118 v2
pith:2026:6RHRJQSIKLPIJZIJ2ZHYZEBBD3

Coverage vector

completed 5 of 6 listed checks

Counted as completed checks in the claim sentence numerator.

skipped 1 of 6 listed checks

Skipped checks produced no result and say nothing about absence.

Listed checks

ai_meta_artifact

completed

v1.0.0, observed 2026-05-26 06:34:44.225481+00:00

Scope
Paper body text scanned for literal AI-assistant artifacts.
Completed surface
Checked 1 reference.

cited_work_retraction

completed

v1.0.0, observed 2026-05-24 16:53:10.352233+00:00

Scope
Cited references checked for source-reported retractions or expressions of concern.
Completed surface
Completed within the stated scope.

claim_evidence

completed

v1.0.0, observed 2026-05-21 15:42:30.250671+00:00

Scope
Recorded paper claims checked for the evidence artifacts they name.
Completed surface
Completed within the stated scope.

external_links

completed

v1.0.0, observed 2026-05-19 11:34:47.080787+00:00

Scope
External URLs extracted from paper text checked at the stated time.
Completed surface
Checked 1 reference.

shingle_duplication

completed

v0.1.0, observed 2026-05-19 09:50:11.108907+00:00

Scope
Available paper body text compared for identical 40-token sequences under the detector's stated exclusions.
Completed surface
Checked 600 references.

citation_quote_validity

skipped

v0.1.0, observed 2026-05-19 07:49:43.526549+00:00

Scope
Specific factual attributions checked against cited-paper text available in Pith.
Reason
No resolvable cited-paper references were available.

Observations

The completed checks produced no public findings within their stated scope.

Methods and limits

Each listed check names the surface it examined. A skipped, failed, partial, unavailable, not collected, not requested, or withheld check says nothing about what a completed check would have returned.

  • Only checks with status completed enter the claim sentence numerator.
  • Findings appear only from completed checks and only within the scope printed for that check.
  • Severity labels describe one observation row. They do not roll up into a paper judgment.