Pith. sign in
Pith Number

pith:PZZ5T4O2

pith:2024:PZZ5T4O2FWF4Z4C2SIKYUGDHN5
not attested not anchored not stored refs pending

RoTBench: A Multi-Level Benchmark for Evaluating the Robustness of Large Language Models in Tool Learning

Caishuang Huang, Guanyu Li, Junjie Ye, Qi Zhang, Sixian Li, Songyang Gao, Tao Gui, Xiaoran Fan, Xuanjing Huang, Yilong Wu

arxiv:2401.08326 v3 · 2024-01-16 · cs.CL · cs.AI

Add to your LaTeX paper
\usepackage{pith}
\pithnumber{PZZ5T4O2FWF4Z4C2SIKYUGDHN5}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp
2 Internet Archive
3 Author claim open · sign in to claim
4 Citations open
5 Replications open
Portable graph bundle live · download bundle · merged state
The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.
Receipt and verification
First computed 2026-07-05T09:09:55.605027Z
Builder pith-number-builder-2026-05-17-v1
Signature Pith Ed25519 (pith-v1-2026-05) · public key
Schema pith-number/v1.0

Canonical hash

7e73d9f1da2d8bccf05a92158a18676f7d73dac8e60918cf85cbed0eda91fafc

Aliases

arxiv: 2401.08326 · arxiv_version: 2401.08326v3 · doi: 10.48550/arxiv.2401.08326 · pith_short_12: PZZ5T4O2FWF4 · pith_short_16: PZZ5T4O2FWF4Z4C2 · pith_short_8: PZZ5T4O2
Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/PZZ5T4O2FWF4Z4C2SIKYUGDHN5 \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 7e73d9f1da2d8bccf05a92158a18676f7d73dac8e60918cf85cbed0eda91fafc
Canonical record JSON
{
  "metadata": {
    "abstract_canon_sha256": "3c732d785d19abd84b5e7bcdaf45ac2548e5da0b5897979642089a689a590a98",
    "cross_cats_sorted": [
      "cs.AI"
    ],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2024-01-16T12:45:15Z",
    "title_canon_sha256": "6820e22d543cbe69100022108cd777e9b7a241f559c9a1a577353a6edd9987e3"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2401.08326",
    "kind": "arxiv",
    "version": 3
  }
}