Pith. sign in
Pith Number

pith:3Z2ODSFK

pith:2025:3Z2ODSFKUS5OKWXYAWKFR4NLPQ
not attested not anchored not stored refs pending

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks

(2) University of Illinois at Urbana-Champaign), Ameet Rahane (1), Amit Paradkar (1), Anca Sailer (1), Bekir O. Turkkan (1), Bhavya Bhavya (1), Carlos Fonseca (1), Chandrasekhar Narayanaswami (1), Daby Sow (1), Debanjana Kar (1), Divya Pathak (1), Felix George (1), Gerard Vanloo (1), Harshit Kumar (1), Hirokuni Kitahara (1), Jackson Clark (2), Jae-wook Ahn (1), Laura Shwartz (1), Lav R. Varshney (2), Michael Nidd (1), Mudit Verma (1), Naoki Abe (1), Nicholas C. M. Fuller (1), Noah Zheutlin (1), Oishik Chatterjee (1), Pavankumar Murali (1), Pooja Aggarwal (1), Pranjal Gupta (1), Prateeti Mohapatra (1), Pratibha Moogi (1), Rohan Arora (1), Rong Lee (1), Ruchi Mahindru (1), Ruchir Puri (1) ((1) IBM, Saki Takano (1), Saurabh Jha (1), Suranjana Samanta (1), Takumi Yanagawa (1), Tianyin Xu (2), Ting Dai (1), Xinbo Wu (2), Yinfang Chen (2), Yu Deng (1), Yuji Watanabe (1)

arxiv:2502.05352 v1 · 2025-02-07 · cs.AI · cs.DC · cs.MA

Add to your LaTeX paper
\usepackage{pith}
\pithnumber{3Z2ODSFKUS5OKWXYAWKFR4NLPQ}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp
2 Internet Archive
3 Author claim open · sign in to claim
4 Citations open
5 Replications open
Portable graph bundle live · download bundle · merged state
The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

7 papers in Pith

Receipt and verification
First computed 2026-07-05T10:11:36.762617Z
Builder pith-number-builder-2026-05-17-v1
Signature Pith Ed25519 (pith-v1-2026-05) · public key
Schema pith-number/v1.0

Canonical hash

de74e1c8aaa4bae55af8059458f1ab7c15c2d62ee28312c83b107d5610865656

Aliases

arxiv: 2502.05352 · arxiv_version: 2502.05352v1 · doi: 10.48550/arxiv.2502.05352 · pith_short_12: 3Z2ODSFKUS5O · pith_short_16: 3Z2ODSFKUS5OKWXY · pith_short_8: 3Z2ODSFK
Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/3Z2ODSFKUS5OKWXYAWKFR4NLPQ \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: de74e1c8aaa4bae55af8059458f1ab7c15c2d62ee28312c83b107d5610865656
Canonical record JSON
{
  "metadata": {
    "abstract_canon_sha256": "0dd3d1930f53b9d65310e33d33d1207edae8ba873725d3ca13598e2bb2f33d53",
    "cross_cats_sorted": [
      "cs.DC",
      "cs.MA"
    ],
    "license": "http://creativecommons.org/licenses/by-nc-nd/4.0/",
    "primary_cat": "cs.AI",
    "submitted_at": "2025-02-07T21:46:52Z",
    "title_canon_sha256": "5caea945e13939fd21b16cb4729f860535588d760c7c42a460c673e08e386617"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2502.05352",
    "kind": "arxiv",
    "version": 1
  }
}