Pith. sign in
Pith Number

pith:VKN3CGCY

pith:2022:VKN3CGCYPHXLOMFSYLJZLQUA4A
not attested not anchored not stored refs pending

Token Dropping for Efficient BERT Pretraining

Denny Zhou, Le Hou, Richard Yuanzhe Pang, Tianyi Zhou, Xiaodan Song, Xinying Song, Yuexin Wu

arxiv:2203.13240 v1 · 2022-03-24 · cs.CL · cs.LG

Add to your LaTeX paper
\usepackage{pith}
\pithnumber{VKN3CGCYPHXLOMFSYLJZLQUA4A}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp
2 Internet Archive
3 Author claim open · sign in to claim
4 Citations open
5 Replications open
Portable graph bundle live · download bundle · merged state
The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

1 paper in Pith

Receipt and verification
First computed 2026-07-05T04:08:22.138380Z
Builder pith-number-builder-2026-05-17-v1
Signature Pith Ed25519 (pith-v1-2026-05) · public key
Schema pith-number/v1.0

Canonical hash

aa9bb1185879eeb730b2c2d395c280e03c9d91af8c4f3ac1a00ae2865ceca172

Aliases

arxiv: 2203.13240 · arxiv_version: 2203.13240v1 · doi: 10.48550/arxiv.2203.13240 · pith_short_12: VKN3CGCYPHXL · pith_short_16: VKN3CGCYPHXLOMFS · pith_short_8: VKN3CGCY
Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/VKN3CGCYPHXLOMFSYLJZLQUA4A \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: aa9bb1185879eeb730b2c2d395c280e03c9d91af8c4f3ac1a00ae2865ceca172
Canonical record JSON
{
  "metadata": {
    "abstract_canon_sha256": "38dc068070a144c09b913ff95bbb5411f68f565918e819c6adbf32aa9694cad1",
    "cross_cats_sorted": [
      "cs.LG"
    ],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2022-03-24T17:50:46Z",
    "title_canon_sha256": "00c34884b3f52bfadeda690ad441336d2f4ba296f52d2253aeaf9c540e83b0be"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2203.13240",
    "kind": "arxiv",
    "version": 1
  }
}