Paper Integrity Record · LEDGER

OpenSkillEval: Automatically Auditing the Open Skill Ecosystem for LLM Agents

As of 5 June 2026, Pith completed 9 of 10 listed checks against arXiv:2605.23657. The completed checks produced no public findings within their stated scope. 1 check was skipped and produced no result.

This is a record of named checks, not a clean-status claim or a paper verdict.

pith.integrity.v1
2605.23657 v2
pith:2026:H5ICOP4SKFEOYMF3F2GYVCMV3M

Coverage vector

completed 9 of 10 listed checks

Counted as completed checks in the claim sentence numerator.

skipped 1 of 10 listed checks

Skipped checks produced no result and say nothing about absence.

Listed checks

doi_compliance

completed

v1.0.0, observed 2026-06-05 21:16:23.105934+00:00

Scope: DOI and arXiv identifiers listed in the bibliography checked against named registries.
Completed surface: Completed within the stated scope.

doi_title_agreement

completed

v1.0.0, observed 2026-06-05 21:06:15.530135+00:00

Scope: Cited titles compared with titles resolved from their DOI or arXiv identifier.
Completed surface: Completed within the stated scope.

ai_meta_artifact

completed

v1.0.0, observed 2026-06-05 20:36:14.811424+00:00

Scope: Paper body text scanned for literal AI-assistant artifacts.
Completed surface: Checked 1 reference.

claim_evidence

completed

v1.0.0, observed 2026-05-28 12:24:49.447299+00:00

Scope: Recorded paper claims checked for the evidence artifacts they name.
Completed surface: Completed within the stated scope.

doi_title_agreement

completed

v1.0.0, observed 2026-05-28 04:33:27.053625+00:00

Scope: Cited titles compared with titles resolved from their DOI or arXiv identifier.
Completed surface: Checked 33 references.

doi_compliance

completed

v1.0.0, observed 2026-05-28 04:24:32.696014+00:00

Scope: DOI and arXiv identifiers listed in the bibliography checked against named registries.
Completed surface: Checked 8 references.

shingle_duplication

completed

v0.1.0, observed 2026-05-25 21:51:33.278021+00:00

Scope: Available paper body text compared for identical 40-token sequences under the detector's stated exclusions.
Completed surface: Checked 600 references.

citation_quote_validity

completed

v0.1.0, observed 2026-05-25 09:50:19.731490+00:00

Scope: Specific factual attributions checked against cited-paper text available in Pith.
Completed surface: Checked 1 reference.

cited_work_retraction

completed

v1.0.0, observed 2026-05-25 06:23:20.197358+00:00

Scope: Cited references checked for source-reported retractions or expressions of concern.
Completed surface: Checked 2 references.

ai_meta_artifact

skipped

v1.0.0, observed 2026-05-25 02:35:00.810366+00:00

Scope: Paper body text scanned for literal AI-assistant artifacts.
Reason: Paper body text was unavailable.

Observations

The completed checks produced no public findings within their stated scope.

Methods and limits

Each listed check names the surface it examined. A skipped, failed, partial, unavailable, not collected, not requested, or withheld check says nothing about what a completed check would have returned.

Only checks with status completed enter the claim sentence numerator.
Findings appear only from completed checks and only within the scope printed for that check.
Severity labels describe one observation row. They do not roll up into a paper judgment.