Pith Number

pith:4ERRQCUZ

pith:2021:4ERRQCUZQSTKGPZU73UL5DHW4E

not attested not anchored not stored refs pending

The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics

Akhila Yerukola, Aman Madaan, Anastasia Shimorina, Angelina McMillan-Major, Ankur Parikh, Antoine Bosselut, Aremu Anuoluwapo, Bodhisattwa Prasad Majumder, Chris Emezue, Cristina Garbacea, Dhruv Kumar, Dipanjan Das, Diyi Yang, Emiel van Miltenburg, Esin Durmus, Faisal Ladhak, Harsh Jhamtani, Hendrik Strobelt, Jiawei Zhou, Jo\~ao Sedoc, Juan Diego Rodriguez, Karmanya Aggarwal, Kaustubh D. Dhole, Khyathi Raghavi Chandu, Khyati Mahajan, Laura Perez-Beltrachini, Marco Antonio Sobrevilla Cabezudo, Mihir Kale, Miruna Clinciu, Moin Nadeem, Mounica Maddela, Niranjan Ramesh Rao, Nishant Subramani, Ond\v{r}ej Du\v{s}ek, Pawan Sasanka Ammanamanchi, Pedro Henrique Martins, Rubungo Andre Niyongabo, Saad Mahamood, Salomey Osei, Samira Shaikh, Sashank Santhanam, Sebastian Gehrmann, Shailza Jolly, Shashi Narayan, Simon Mille, Tatsunori Hashimoto, Thibault Sellam, Tosin Adewumi, Varun Gangal, Vikas Raunak, Vitaly Nikolaev, Wanyu Du, Wei Xu, Yacine Jernite, Yangfeng Ji, Yufang Hou

arxiv:2102.01672 v3 · 2021-02-02 · cs.CL · cs.AI · cs.LG

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{4ERRQCUZQSTKGPZU73UL5DHW4E}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

2 papers in Pith

Scaling Data-Constrained Language Models

PAL: Program-aided Language Models

Receipt and verification

First computed	2026-07-05T02:28:20.310491Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

e123180a9984a6a33f34fee8be8cf6e112d5aea6b6cdb25929df495862b989c1

Aliases

arxiv: 2102.01672 · arxiv_version: 2102.01672v3 · doi: 10.48550/arxiv.2102.01672 · pith_short_12: 4ERRQCUZQSTK · pith_short_16: 4ERRQCUZQSTKGPZU · pith_short_8: 4ERRQCUZ

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/4ERRQCUZQSTKGPZU73UL5DHW4E \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: e123180a9984a6a33f34fee8be8cf6e112d5aea6b6cdb25929df495862b989c1

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "e8bbe77e8299fad208c011be998f72a63411a86e9a441e89359e7d3a78277dbd",
    "cross_cats_sorted": [
      "cs.AI",
      "cs.LG"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2021-02-02T18:42:05Z",
    "title_canon_sha256": "b43393e3473623e2b14443a9a5d46e5f7a4509c6ac1654d28a361c46bc1fcf68"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2102.01672",
    "kind": "arxiv",
    "version": 3
  }
}