Pith Number

pith:IYP6PC34

pith:2024:IYP6PC34XHRMJZDNB3677B6TDN

not attested not anchored not stored refs pending

Vibe-Eval: A hard evaluation suite for measuring progress of multimodal language models

Aitor Ormazabal, Che Zheng, Cyprien de Masson d'Autume, Dani Yogatama, Deyu Fu, Donovan Ong, Eric Chen, Ethan Yeo, Eugenie Lamprecht, Hai Pham, Kaloyan Aleksiev, Lei Li, Matthew Henderson, Max Bain, Mikel Artetxe, Nishant Relan, Piotr Padlewski, Qi Liu, Samuel Phua, Yi Tay, Yuqi Wang, Zhongkai Zhu

arxiv:2405.02287 v1 · 2024-05-03 · cs.CL · cs.AI · cs.CV

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{IYP6PC34XHRMJZDNB3677B6TDN}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

4 papers in Pith

Seed2.0 Model Card: Towards Intelligence Frontier for Real-World Complexity

VideoPhy: Evaluating Physical Commonsense for Video Generation

Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities

LLaVA-OneVision: Easy Visual Task Transfer

Receipt and verification

First computed	2026-07-05T08:15:09.392828Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

461fe78b7cb9e2c4e46d0efdff87d31b4a997d2bdf037a7c84436df6f6a146ed

Aliases

arxiv: 2405.02287 · arxiv_version: 2405.02287v1 · doi: 10.48550/arxiv.2405.02287 · pith_short_12: IYP6PC34XHRM · pith_short_16: IYP6PC34XHRMJZDN · pith_short_8: IYP6PC34

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/IYP6PC34XHRMJZDNB3677B6TDN \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 461fe78b7cb9e2c4e46d0efdff87d31b4a997d2bdf037a7c84436df6f6a146ed

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "566e114857dd76978ea16c3ddb2a50111f6a7943d099fa8e784b4a23ef669be7",
    "cross_cats_sorted": [
      "cs.AI",
      "cs.CV"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2024-05-03T17:59:55Z",
    "title_canon_sha256": "1d762eb3a110e95d98add2fd44160f8b35e13ede62b9ded54834f50002ac45f7"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2405.02287",
    "kind": "arxiv",
    "version": 1
  }
}