Pith Number

pith:T4IFBEK3

pith:2023:T4IFBEK3STFEW26YYS6K76XUGN

not attested not anchored not stored refs pending

LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models

Adam Chilton, Aditya Narayana, Alex Chohlas-Wood, Austin Peters, Brandon Waldon, Christopher R\'e, Daniel E. Ho, Daniel N. Rockmore, Diego Zambrano, Dmitry Talisman, Enam Hoque, Faiz Surani, Frank Fagan, Galit Sarfaty, Gregory M. Dickinson, Haggai Porat, Jason Hegland, Jessica Wu, Joel Niklaus, Joe Nudell, John Nay, Jonathan H. Choi, Julian Nyarko, Kevin Tobia, Margaret Hagan, Megan Ma, Michael Livermore, Neel Guha, Nikon Rasumov-Rahe, Nils Holzenberger, Noam Kolt, Peter Henderson, Sean Rehaag, Shang Gao, Sharad Goel, Spencer Williams, Sunny Gandhi, Tom Zur, Varun Iyer, Zehua Li

arxiv:2308.11462 v1 · 2023-08-20 · cs.CL · cs.AI · cs.CY

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{T4IFBEK3STFEW26YYS6K76XUGN}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

26 papers in Pith

How Do Tool-Augmented LLM Agents Perform on Real-World Energy Analytics Tasks?

HAKARI-Bench: A Lightweight Benchmark for Comparing Retrieval Architectures and Efficiency Settings under Unified Conditions

Answer Engineering: Local Trajectory Editing for Protocol-Constrained Decision Making in Large Language Models

The Measurement Gap in the Automation of EU Law: Benchmarking Doctrinal Legal Reasoning under the EU AI Act

Legal Reasoning Is Not Lawyering: Rethinking Legal Benchmarks for Pro Se Access to Justice

Receipt and verification

First computed	2026-07-05T06:43:35.259816Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

9f1050915b94ca4b6bd8c4bcaffaf4335f38003ffc6663982cf7cdb672cfeea6

Aliases

arxiv: 2308.11462 · arxiv_version: 2308.11462v1 · doi: 10.48550/arxiv.2308.11462 · pith_short_12: T4IFBEK3STFE · pith_short_16: T4IFBEK3STFEW26Y · pith_short_8: T4IFBEK3

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/T4IFBEK3STFEW26YYS6K76XUGN \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 9f1050915b94ca4b6bd8c4bcaffaf4335f38003ffc6663982cf7cdb672cfeea6

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "fd227cb7dbeea12553b863694b1e1ae2e2eae09bbf1c1f9a1a9c2aa96e7ba66d",
    "cross_cats_sorted": [
      "cs.AI",
      "cs.CY"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2023-08-20T22:08:03Z",
    "title_canon_sha256": "26f787639fd0c04623ab0974256ce6dd404e9c4b0e313d5b503b816c5dc8ea24"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2308.11462",
    "kind": "arxiv",
    "version": 1
  }
}