Pith Number

pith:ASXOA3TJ

pith:2026:ASXOA3TJAHGFOZNF224GTGVAAF

not attested not anchored not stored refs pending

CalBench: Evaluating Coordination-Privacy Trade-offs in Multi-Agent LLMs

Chelsea Zou, Noah Goodman, Robert D. Hawkins, Selena She, Yiheng Yao

CalBench is a benchmark where agents with private calendars must coordinate meeting schedules without sharing data.

arxiv:2605.09823 v2 · 2026-05-10 · cs.MA · cs.AI

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{ASXOA3TJAHGFOZNF224GTGVAAF}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Claims

C1strongest claim

CalBench is inherently decentralized: no agent has access to another agent's private calendar, yet agents must still reach mutually consistent decisions over shared meeting scheduling, enabling precise verification of task success, communication efficiency, and fairness.

C2weakest assumption

That the specific mechanics of private-calendar scheduling with oracle optima and semantic privacy tags form a representative and controllable proxy for general coordination-privacy trade-offs across multi-agent LLM applications.

C3one line summary

CalBench introduces a decentralized multi-agent benchmark for calendar scheduling that measures coordination quality against an oracle optimum and privacy leakage under private information constraints.

Receipt and verification

First computed	2026-05-29T02:05:46.343754Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

04aee06e6901cc5765a5d6b8699aa0017ca92c308a110158ffeadc8c788de547

Aliases

arxiv: 2605.09823 · arxiv_version: 2605.09823v2 · doi: 10.48550/arxiv.2605.09823 · pith_short_12: ASXOA3TJAHGF · pith_short_16: ASXOA3TJAHGFOZNF · pith_short_8: ASXOA3TJ

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/ASXOA3TJAHGFOZNF224GTGVAAF \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 04aee06e6901cc5765a5d6b8699aa0017ca92c308a110158ffeadc8c788de547

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "006f631bf071ea1f8d05f3f15f3161477b73bf1099fcb93456a088b983ab5dba",
    "cross_cats_sorted": [
      "cs.AI"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.MA",
    "submitted_at": "2026-05-10T23:56:02Z",
    "title_canon_sha256": "214f42161ca674233252c399d91ab1c6ec1ed69ea4382b3c5446016f3e95a365"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2605.09823",
    "kind": "arxiv",
    "version": 2
  }
}