Pith. sign in

Paper Integrity Record · LEDGER

Contextualized Evaluation of Vision Language Models through Dynamic, Multi-turn Interactions

As of 2 August 2026, Pith completed 4 of 7 listed checks against arXiv:2607.14499. The completed checks produced 1 public finding within their stated scope. 3 checks were skipped and produced no result.

This is a record of named checks, not a clean-status claim or a paper verdict.

pith.integrity.v1
2607.14499 v1
pith:2026:M4OIGFMIIZJHS2DYP5CLEBM3AV

Coverage vector

completed 4 of 7 listed checks

Counted as completed checks in the claim sentence numerator.

skipped 3 of 7 listed checks

Skipped checks produced no result and say nothing about absence.

Listed checks

doi_title_agreement

completed

v1.0.0, observed 2026-08-02 10:09:01.277886+00:00

Scope
Cited titles compared with titles resolved from their DOI or arXiv identifier.
Completed surface
Checked 1 reference.

doi_compliance

completed

v1.1.0, observed 2026-08-02 01:59:36.184122+00:00

Scope
DOI and arXiv identifiers listed in the bibliography checked against named registries.
Completed surface
Checked 29 references. Recorded 1 finding from this run.

ai_meta_artifact

skipped

v1.0.0, observed 2026-07-24 00:51:41.238182+00:00

Scope
Paper body text scanned for literal AI-assistant artifacts.
Reason
Paper body text was unavailable.

claim_evidence

completed

v1.0.0, observed 2026-07-22 10:29:10.802240+00:00

Scope
Recorded paper claims checked for the evidence artifacts they name.
Completed surface
Completed within the stated scope.

citation_quote_validity

skipped

v0.1.0, observed 2026-07-19 19:57:13.828978+00:00

Scope
Specific factual attributions checked against cited-paper text available in Pith.
Reason
Paper body text was unavailable.

shingle_duplication

skipped

v0.1.0, observed 2026-07-19 13:53:47.143910+00:00

Scope
Available paper body text compared for identical 40-token sequences under the detector's stated exclusions.
Reason
Usable body text was absent or too short for this check.

cited_work_retraction

completed

v1.0.0, observed 2026-07-17 00:50:34.320991+00:00

Scope
Cited references checked for source-reported retractions or expressions of concern.
Completed surface
Completed within the stated scope.

Observations

Methods and limits

Each listed check names the surface it examined. A skipped, failed, partial, unavailable, not collected, not requested, or withheld check says nothing about what a completed check would have returned.

  • Only checks with status completed enter the claim sentence numerator.
  • Findings appear only from completed checks and only within the scope printed for that check.
  • Severity labels describe one observation row. They do not roll up into a paper judgment.