Paper Integrity Record · LEDGER

SWE-Mutation: Can LLMs Generate Reliable Test Suites in Software Engineering?

As of 5 June 2026, Pith completed 7 of 7 listed checks against arXiv:2605.22175. The completed checks produced 2 public findings within their stated scope.

This is a record of named checks, not a clean-status claim or a paper verdict.

pith.integrity.v1
2605.22175 v1
pith:2026:TVKWGMVXMRIZCMNWHGN5B2ROTH

Coverage vector

completed 7 of 7 listed checks

Counted as completed checks in the claim sentence numerator.

Listed checks

doi_compliance

completed

v1.0.0, observed 2026-06-05 08:56:51.823697+00:00

Scope: DOI and arXiv identifiers listed in the bibliography checked against named registries.
Completed surface: Checked 26 references. Recorded 2 findings from this run.

doi_title_agreement

completed

v1.0.0, observed 2026-06-05 07:06:09.850794+00:00

Scope: Cited titles compared with titles resolved from their DOI or arXiv identifier.
Completed surface: Checked 43 references.

ai_meta_artifact

completed

v1.0.0, observed 2026-05-29 05:37:53.307134+00:00

Scope: Paper body text scanned for literal AI-assistant artifacts.
Completed surface: Checked 1 reference.

claim_evidence

completed

v1.0.0, observed 2026-05-27 13:24:28.501005+00:00

Scope: Recorded paper claims checked for the evidence artifacts they name.
Completed surface: Completed within the stated scope.

citation_quote_validity

completed

v0.1.0, observed 2026-05-24 21:50:13.529650+00:00

Scope: Specific factual attributions checked against cited-paper text available in Pith.
Completed surface: Completed within the stated scope.

shingle_duplication

completed

v0.1.0, observed 2026-05-24 01:50:56.592118+00:00

Scope: Available paper body text compared for identical 40-token sequences under the detector's stated exclusions.
Completed surface: Checked 600 references.

cited_work_retraction

completed

v1.0.0, observed 2026-05-22 11:53:03.746114+00:00

Scope: Cited references checked for source-reported retractions or expressions of concern.
Completed surface: Checked 17 references.

Observations

Methods and limits

Each listed check names the surface it examined. A skipped, failed, partial, unavailable, not collected, not requested, or withheld check says nothing about what a completed check would have returned.

Only checks with status completed enter the claim sentence numerator.
Findings appear only from completed checks and only within the scope printed for that check.
Severity labels describe one observation row. They do not roll up into a paper judgment.