Pith. sign in
Pith Number

pith:4CAA2XJ2

pith:2021:4CAA2XJ2A2XT4VAJO2DVZWL532
not attested not anchored not stored refs pending

Adversarially Constructed Evaluation Sets Are More Challenging, but May Not Be Fair

Angelica Chen, Jason Phang, Samuel R. Bowman, William Huang

arxiv:2111.08181 v1 · 2021-11-16 · cs.CL

Add to your LaTeX paper
\usepackage{pith}
\pithnumber{4CAA2XJ2A2XT4VAJO2DVZWL532}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp
2 Internet Archive
3 Author claim open · sign in to claim
4 Citations open
5 Replications open
Portable graph bundle live · download bundle · merged state
The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

1 paper in Pith

Receipt and verification
First computed 2026-07-05T03:32:30.636386Z
Builder pith-number-builder-2026-05-17-v1
Signature Pith Ed25519 (pith-v1-2026-05) · public key
Schema pith-number/v1.0

Canonical hash

e0800d5d3a06af3e540976875cd97ddea3b23a644f06e96b4428c2e3e50e655a

Aliases

arxiv: 2111.08181 · arxiv_version: 2111.08181v1 · doi: 10.48550/arxiv.2111.08181 · pith_short_12: 4CAA2XJ2A2XT · pith_short_16: 4CAA2XJ2A2XT4VAJ · pith_short_8: 4CAA2XJ2
Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/4CAA2XJ2A2XT4VAJO2DVZWL532 \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: e0800d5d3a06af3e540976875cd97ddea3b23a644f06e96b4428c2e3e50e655a
Canonical record JSON
{
  "metadata": {
    "abstract_canon_sha256": "6e321dda920b7960673150804381cfe0ad4c6b82bb490f3a20d894ef8e852636",
    "cross_cats_sorted": [],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2021-11-16T01:45:26Z",
    "title_canon_sha256": "b9fd6016325a5b5a5745189613bf84bffa41e5f14c4f511496c1e251fd8631e9"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2111.08181",
    "kind": "arxiv",
    "version": 1
  }
}