Pith Number

pith:XL6J5GZF

pith:2025:XL6J5GZF7MLLXBOI6IY7YFYTER

not attested not anchored not stored refs pending

SWE-MERA: A Dynamic Benchmark for Agenticly Evaluating Large Language Models on Software Engineering Tasks

Aidar Valeev, Alena Fenogenova, Dmitry Babayev, Ivan Lopatin, Mikhail Ivanov, Pavel Adamenko, Pavel Zadorozhny, Rodion Levichev, Valentin Malykh

arxiv:2507.11059 v2 · 2025-07-15 · cs.SE · cs.AI · cs.CL

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{XL6J5GZF7MLLXBOI6IY7YFYTER}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

1 paper in Pith

RuBench: A Repository-Level Agentic Coding Benchmark with Natively Authored Russian Task Specifications

Receipt and verification

First computed	2026-07-05T11:38:52.412601Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

bafc9e9b25fb16bb85c8f231fc17132471cdb6acdd78d0fb2541a18fcde8cd7d

Aliases

arxiv: 2507.11059 · arxiv_version: 2507.11059v2 · doi: 10.48550/arxiv.2507.11059 · pith_short_12: XL6J5GZF7MLL · pith_short_16: XL6J5GZF7MLLXBOI · pith_short_8: XL6J5GZF

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/XL6J5GZF7MLLXBOI6IY7YFYTER \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: bafc9e9b25fb16bb85c8f231fc17132471cdb6acdd78d0fb2541a18fcde8cd7d

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "e29d2821afe42ca8c716ef3a0295651c41ff59b3f23b92330705cae509bfc591",
    "cross_cats_sorted": [
      "cs.AI",
      "cs.CL"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.SE",
    "submitted_at": "2025-07-15T07:52:33Z",
    "title_canon_sha256": "471a80d8bb4b463849190992ec9102b3ad602f0911dab0da34301385c0c9e11a"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2507.11059",
    "kind": "arxiv",
    "version": 2
  }
}