Pith Number

pith:EWZWQPQQ

pith:2026:EWZWQPQQ65DEJNIG23HS3YHJ2S

not attested not anchored not stored refs pending

Query-efficient model evaluation using cached responses

Ben Johnson, Carey Priebe, Hayden Helm

DKPS with cached responses allows benchmark evaluation of new models using far fewer queries while matching baseline accuracy.

arxiv:2605.07096 v2 · 2026-05-08 · cs.LG · cs.AI · stat.ME

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{EWZWQPQQ65DEJNIG23HS3YHJ2S}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Claims

C1strongest claim

DKPS-based methods achieve the same mean absolute error as baselines with a substantially decreased query budget.

C2weakest assumption

That the Data Kernel Perspective Space reliably quantifies black-box relationships between models and that the stated theoretical conditions for query-efficiency translate to practical benchmark settings.

C3one line summary

DKPS-based methods leverage cached model responses to achieve equivalent benchmark prediction accuracy with substantially fewer queries than standard evaluation.

Formal links

2 machine-checked theorem links

Cited by

1 paper in Pith

Jailbreak susceptibility prediction and mitigation via the behavioral geometry of models

Receipt and verification

First computed	2026-06-05T01:15:25.229360Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

25b3683e10f74644b506d6cf2de0e9d486bcb68beded879ef3f92522188244b3

Aliases

arxiv: 2605.07096 · arxiv_version: 2605.07096v2 · doi: 10.48550/arxiv.2605.07096 · pith_short_12: EWZWQPQQ65DE · pith_short_16: EWZWQPQQ65DEJNIG · pith_short_8: EWZWQPQQ

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/EWZWQPQQ65DEJNIG23HS3YHJ2S \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 25b3683e10f74644b506d6cf2de0e9d486bcb68beded879ef3f92522188244b3

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "dd978c8478367cca2f1a62480a3e7fac9b963ffba13c4ee72d1e82372576c895",
    "cross_cats_sorted": [
      "cs.AI",
      "stat.ME"
    ],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.LG",
    "submitted_at": "2026-05-08T01:24:06Z",
    "title_canon_sha256": "8f44e85ebbcbce3a8e5132595228ef7a59c57ba89ba148d4188406011ec3bb6b"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2605.07096",
    "kind": "arxiv",
    "version": 2
  }
}