Pith Number

pith:WRTKN46K

pith:2025:WRTKN46KDBPT2AN3URSEUBPGNS

not attested not anchored not stored refs pending

HellaSwag-Pro: A Large-Scale Bilingual Benchmark for Evaluating the Robustness of LLMs in Commonsense Reasoning

Dayiheng Liu, Fuli Feng, Junyang Lin, Keqin Bao, Moxin Li, Rui Men, Wenjie Wang, Xiaoyuan Li, Yichang Zhang

arxiv:2502.11393 v2 · 2025-02-17 · cs.CL

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{WRTKN46KDBPT2AN3URSEUBPGNS}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

1 paper in Pith

MTR-Bench: A Comprehensive Benchmark for Multi-Turn Reasoning Evaluation

Receipt and verification

First computed	2026-07-05T11:09:08.443113Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

b466a6f3ca185f3d01bba4644a05e66cae392a6c7144bd7e59bf3fe60a969875

Aliases

arxiv: 2502.11393 · arxiv_version: 2502.11393v2 · doi: 10.48550/arxiv.2502.11393 · pith_short_12: WRTKN46KDBPT · pith_short_16: WRTKN46KDBPT2AN3 · pith_short_8: WRTKN46K

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/WRTKN46KDBPT2AN3URSEUBPGNS \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: b466a6f3ca185f3d01bba4644a05e66cae392a6c7144bd7e59bf3fe60a969875

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "56fb27aca9e15334a1a0fb9fd10b07dac05ebe3de19b2570a929be3fe929cef9",
    "cross_cats_sorted": [],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2025-02-17T03:24:02Z",
    "title_canon_sha256": "9f6f41108da71d04fdab91a19ae8bdfc5aa1a4d333c3ac352c023c595c73e326"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2502.11393",
    "kind": "arxiv",
    "version": 2
  }
}