Pith. sign in
Pith Number

pith:7UJPNLXO

pith:2024:7UJPNLXOUUOCUKCXF36D3KCEDH
not attested not anchored not stored refs pending

Tokenization Matters! Degrading Large Language Models through Challenging Their Tokenization

Deqing Yang, Dixuan Wang, Guochao Jiang, Jiaqing Liang, Junyuan Jiang, Yanda Li, Zepeng Ding, Ziqin Luo

arxiv:2405.17067 v2 · 2024-05-27 · cs.CL · cs.AI

Add to your LaTeX paper
\usepackage{pith}
\pithnumber{7UJPNLXOUUOCUKCXF36D3KCEDH}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp
2 Internet Archive
3 Author claim open · sign in to claim
4 Citations open
5 Replications open
Portable graph bundle live · download bundle · merged state
The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

1 paper in Pith

Receipt and verification
First computed 2026-07-05T11:03:14.857396Z
Builder pith-number-builder-2026-05-17-v1
Signature Pith Ed25519 (pith-v1-2026-05) · public key
Schema pith-number/v1.0

Canonical hash

fd12f6aeeea51c2a28572efc3da84419c33ebc3a988d5647a8c5e81924b4b717

Aliases

arxiv: 2405.17067 · arxiv_version: 2405.17067v2 · doi: 10.48550/arxiv.2405.17067 · pith_short_12: 7UJPNLXOUUOC · pith_short_16: 7UJPNLXOUUOCUKCX · pith_short_8: 7UJPNLXO
Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/7UJPNLXOUUOCUKCXF36D3KCEDH \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: fd12f6aeeea51c2a28572efc3da84419c33ebc3a988d5647a8c5e81924b4b717
Canonical record JSON
{
  "metadata": {
    "abstract_canon_sha256": "058fdb77442649a316bc2ab762d4ea8cdcdee36f2eac120897e73b5a95c2796f",
    "cross_cats_sorted": [
      "cs.AI"
    ],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2024-05-27T11:39:59Z",
    "title_canon_sha256": "e0e685a19accbb37a09fe62f81e1bbd448294e5a0a8ba380fc386f1229a8b230"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2405.17067",
    "kind": "arxiv",
    "version": 2
  }
}