Paper Integrity Record · LEDGER

Validity of LLMs as data annotators: AMALIA on authority

As of 10 July 2026, Pith completed 5 of 8 listed checks against arXiv:2607.08731. The completed checks produced no public findings within their stated scope. 3 checks were skipped and produced no result.

This is a record of named checks, not a clean-status claim or a paper verdict.

pith.integrity.v1
2607.08731 v1
pith:2026:HCMSMHTLPD6HUIXAAVG4CEOREV

Coverage vector

completed 5 of 8 listed checks

Counted as completed checks in the claim sentence numerator.

skipped 3 of 8 listed checks

Skipped checks produced no result and say nothing about absence.

Listed checks

external_links

completed

v1.0.0, observed 2026-07-10 17:36:23.775040+00:00

Scope: External URLs extracted from paper text checked at the stated time.
Completed surface: Checked 7 references. Recorded 1 finding from this run.

doi_compliance

completed

v1.0.0, observed 2026-07-10 02:31:32.410118+00:00

Scope: DOI and arXiv identifiers listed in the bibliography checked against named registries.
Completed surface: Checked 14 references.

doi_title_agreement

completed

v1.0.0, observed 2026-07-10 02:31:08.502575+00:00

Scope: Cited titles compared with titles resolved from their DOI or arXiv identifier.
Completed surface: Checked 14 references.

cited_work_retraction

completed

v1.0.0, observed 2026-07-10 02:19:03.358133+00:00

Scope: Cited references checked for source-reported retractions or expressions of concern.
Completed surface: Completed within the stated scope.

citation_quote_validity

skipped

v0.1.0, observed 2026-07-10 01:57:15.254891+00:00

Scope: Specific factual attributions checked against cited-paper text available in Pith.
Reason: Paper body text was unavailable.

shingle_duplication

skipped

v0.1.0, observed 2026-07-10 01:54:05.812443+00:00

Scope: Available paper body text compared for identical 40-token sequences under the detector's stated exclusions.
Reason: Usable body text was absent or too short for this check.

ai_meta_artifact

skipped

v1.0.0, observed 2026-07-10 01:49:40.257784+00:00

Scope: Paper body text scanned for literal AI-assistant artifacts.
Reason: Paper body text was unavailable.

claim_evidence

completed

v1.0.0, observed 2026-07-10 01:22:05.566444+00:00

Scope: Recorded paper claims checked for the evidence artifacts they name.
Completed surface: Completed within the stated scope.

Observations

The completed checks produced no public findings within their stated scope.

Methods and limits

Each listed check names the surface it examined. A skipped, failed, partial, unavailable, not collected, not requested, or withheld check says nothing about what a completed check would have returned.

Only checks with status completed enter the claim sentence numerator.
Findings appear only from completed checks and only within the scope printed for that check.
Severity labels describe one observation row. They do not roll up into a paper judgment.