Pith Number

pith:MUHGYXO5

pith:2026:MUHGYXO5YGUKCS4QKUXL6HSM5B

not attested not anchored not stored refs pending

Continuous benchmarking: Keeping pace with an evolving ecosystem of models and technologies

Anno C. Kurth, Catherine Mia Sch\"ofmann, Dennis Terhorst, Hans Ekkehard Plesser, Jan Vogelsang, Johanna Senk, Jos\'e Villamar, Markus Diesmann, Melissa Lober, Susanne Kunkel

An automated benchmarking pipeline with continuous integration features enables reproducible and reusable results for evolving HPC systems and models.

arxiv:2604.15919 v3 · 2026-04-17 · cs.DC

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{MUHGYXO5YGUKCS4QKUXL6HSM5B}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Claims

C1strongest claim

We have extended our previous conceptual work on systematic benchmarking workflows with the functionality of user-agnostic operations as well as continuous benchmarking. This fosters reproducibility and re-use of benchmarking results to ensure sustainable technological progress.

C2weakest assumption

That the described automated benchmarking pipeline can be realized with user-agnostic operations and continuous features in a way that actually delivers customization, collaboration, and re-use without further technical specification or validation.

C3one line summary

The authors describe a continuous benchmarking system for HPC applications that supports user-agnostic operations, customization, and collaboration to ensure reproducibility and sustainable progress in neuroscience and AI.

Receipt and verification

First computed	2026-05-28T01:04:40.233492Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

650e6c5dddc1a8a14b90552ebf1e4ce850d611daf02800a19ce19e12f4a6dc11

Aliases

arxiv: 2604.15919 · arxiv_version: 2604.15919v3 · doi: 10.48550/arxiv.2604.15919 · pith_short_12: MUHGYXO5YGUK · pith_short_16: MUHGYXO5YGUKCS4Q · pith_short_8: MUHGYXO5

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/MUHGYXO5YGUKCS4QKUXL6HSM5B \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 650e6c5dddc1a8a14b90552ebf1e4ce850d611daf02800a19ce19e12f4a6dc11

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "a2a7e2f495e1f15993d58ca115ce5e26c4cd805e2cbcee1ee1334114729b2e89",
    "cross_cats_sorted": [],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.DC",
    "submitted_at": "2026-04-17T10:20:05Z",
    "title_canon_sha256": "13748e6d64901a6fe6f9c8606f394bec9390e2491ce1c0ebd547cc10f05b4aa5"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2604.15919",
    "kind": "arxiv",
    "version": 3
  }
}