Pith Number

pith:LLPZ5DSA

pith:2024:LLPZ5DSAWR5YZT5NCZYVN5IMBV

not attested not anchored not stored refs pending

Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language Models

Andy K. Zhang, Ari Glenn, Celeste Menders, Dan Boneh, Daniel E. Ho, Daniel Zamoshchin, Derek Askaryar, Donovan Jasper, Eliot Jones, Gashon Hussein, Gautham Raghupathi, Joey Ji, Justin W. Lin, Kenny Osele, Leo Glikbarg, Mike Yang, Nathan Tran, Neil Perry, Percy Liang, Polycarpos Yiorkadjis, Pura Peetathawatchai, Rinnara Sangpisit, Rishi Alluri, Riya Dulepet, Samantha Liu, Teddy Zhang, Vikram Sivashankar

arxiv:2408.08926 v4 · 2024-08-15 · cs.CR · cs.AI · cs.CL · cs.CY · cs.LG

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{LLPZ5DSAWR5YZT5NCZYVN5IMBV}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

29 papers in Pith

ScopeJudge: Cost-Aware Pre-Execution Gating for Offensive Security Agents

Poisoned Playbooks: Demystifying Knowledge Poisoning Effects on AI Security Agents

An Evaluation of Data Leakage Risks in Tool-Using LLM Agents in Realistic Scenarios

Mastermind: Strategy-grounded Learning for Repository-Scale Vulnerability Reproduction

Stateful Online Monitoring Catches Distributed Agent Attacks

Receipt and verification

First computed	2026-07-05T10:48:18.488389Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

5adf9e8e40b47b8ccfad167156f50c0d41b658de8bcd4ffc04c5f05102cd8a57

Aliases

arxiv: 2408.08926 · arxiv_version: 2408.08926v4 · doi: 10.48550/arxiv.2408.08926 · pith_short_12: LLPZ5DSAWR5Y · pith_short_16: LLPZ5DSAWR5YZT5N · pith_short_8: LLPZ5DSA

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/LLPZ5DSAWR5YZT5NCZYVN5IMBV \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 5adf9e8e40b47b8ccfad167156f50c0d41b658de8bcd4ffc04c5f05102cd8a57

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "61cff41d13a23379bab61317532c9e9b970345c4ba5ac04fe2f3242726f1da04",
    "cross_cats_sorted": [
      "cs.AI",
      "cs.CL",
      "cs.CY",
      "cs.LG"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CR",
    "submitted_at": "2024-08-15T17:23:10Z",
    "title_canon_sha256": "9d606e70cdbe558916d80b5c5b48be2c362c9b90458bc0f487d5242334657ae4"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2408.08926",
    "kind": "arxiv",
    "version": 4
  }
}