Recoverable Identifier

arXiv:2605.19275 · detector doi_compliance · incontrovertible · 2026-05-20 03:01:00.891622+00:00

Paper page Integrity report arXiv Try DOI

Evidence text

https://doi.org/10.1038/s41597- 025-05228-w. Companion materials Prompt sources, batching details, summary CSVs, and reproduction instructions are on the GitHub repository at https://github.com/hhilbig/polsci-open-bench. 11 Tasks Table 2: Thirty-four tasks in the benchmark. ’Type’ is the report grouping used in Figure 3; it is a broad annotation type rather than a source-provided task family. ’Provenance’: Verbatim = prompt unchanged from source paper, Verbatim-adapted = source content with format-only changes, Derived = my prompt based on a source codebook, public label definitions, or task description. ’Prompt’: short ( 15-35 lines) or long codebook ( 47-126 lines). This is the trait that determines local batching feasibility. Source labels correspond to full entries in the references. The CMP task uses the Halterman & Keith (2026) domain-collapsed 7-class version of the Manifesto Project (2025) CMP/MARPOR coding scheme, not the full CMP category set. Task Description Source Type Labels Provenance Prompt Gilardi relevance Tweets, classified as about content moderation or not. Gilardi et al. 2023 Relevance & Harm binary Verbatim short Brandt relevance News articles, classified as conflict- or politics-relevant or not. Brandt et al. 2025 Relevance & Harm binary Derived short Burnham PolNLI Premise-hypothesis pairs, classified for entailment. Burnham et al. 2025 Claims & Relations binary Derived short Ballard incivility Tweets by U.S. members of Congress, classified for incivi

Evidence payload

{
  "printed_excerpt": "https://doi.org/10.1038/s41597- 025-05228-w. Companion materials Prompt sources, batching details, summary CSVs, and reproduction instructions are on the GitHub repository at https://github.com/hhilbig/polsci-open-bench. 11 Tasks Table 2: T",
  "reconstructed_doi": "10.1038/s41597-025-05228-w.Companion",
  "ref_index": 22,
  "resolved_title": null,
  "verdict_class": "incontrovertible"
}