Counted as completed checks in the claim sentence numerator.
Paper Integrity Record · LEDGER
When Skills Don't Help: A Negative Result on Procedural Knowledge for Tool-Grounded Agents in Offensive Cybersecurity
As of 2 June 2026, Pith completed 11 of 12 listed checks against arXiv:2605.20023. The completed checks produced 2 public findings within their stated scope. 1 check was skipped and produced no result.
This is a record of named checks, not a clean-status claim or a paper verdict.
Coverage vector
Skipped checks produced no result and say nothing about absence.
Listed checks
ai_meta_artifact
completedv1.0.0, observed 2026-06-02 23:41:14.052176+00:00
- Scope
- Paper body text scanned for literal AI-assistant artifacts.
- Completed surface
- Checked 1 reference.
doi_title_agreement
completedv1.0.0, observed 2026-05-29 01:03:43.622058+00:00
- Scope
- Cited titles compared with titles resolved from their DOI or arXiv identifier.
- Completed surface
- Completed within the stated scope.
doi_compliance
completedv1.0.0, observed 2026-05-27 01:05:36.819930+00:00
- Scope
- DOI and arXiv identifiers listed in the bibliography checked against named registries.
- Completed surface
- Completed within the stated scope.
claim_evidence
completedv1.0.0, observed 2026-05-26 23:44:17.379197+00:00
- Scope
- Recorded paper claims checked for the evidence artifacts they name.
- Completed surface
- Completed within the stated scope.
doi_title_agreement
completedv1.0.0, observed 2026-05-25 09:02:42.269580+00:00
- Scope
- Cited titles compared with titles resolved from their DOI or arXiv identifier.
- Completed surface
- Checked 4 references.
claim_evidence
completedv1.0.0, observed 2026-05-25 08:03:45.313609+00:00
- Scope
- Recorded paper claims checked for the evidence artifacts they name.
- Completed surface
- Completed within the stated scope.
doi_compliance
completedv1.0.0, observed 2026-05-25 06:11:18.716634+00:00
- Scope
- DOI and arXiv identifiers listed in the bibliography checked against named registries.
- Completed surface
- Checked 2 references.
external_links
completedv1.0.0, observed 2026-05-20 23:34:59.520535+00:00
- Scope
- External URLs extracted from paper text checked at the stated time.
- Completed surface
- Checked 3 references. Recorded 1 finding from this run.
shingle_duplication
completedv0.1.0, observed 2026-05-20 17:50:01.589024+00:00
- Scope
- Available paper body text compared for identical 40-token sequences under the detector's stated exclusions.
- Completed surface
- Checked 600 references.
citation_quote_validity
completedv0.1.0, observed 2026-05-20 07:49:44.546519+00:00
- Scope
- Specific factual attributions checked against cited-paper text available in Pith.
- Completed surface
- Completed within the stated scope.
cited_work_retraction
completedv1.0.0, observed 2026-05-20 04:53:40.406665+00:00
- Scope
- Cited references checked for source-reported retractions or expressions of concern.
- Completed surface
- Completed within the stated scope.
ai_meta_artifact
skippedv1.0.0, observed 2026-05-20 02:33:27.891980+00:00
- Scope
- Paper body text scanned for literal AI-assistant artifacts.
- Reason
- Paper body text was unavailable.
Observations
Methods and limits
Each listed check names the surface it examined. A skipped, failed, partial, unavailable, not collected, not requested, or withheld check says nothing about what a completed check would have returned.
- Only checks with status completed enter the claim sentence numerator.
- Findings appear only from completed checks and only within the scope printed for that check.
- Severity labels describe one observation row. They do not roll up into a paper judgment.