Pith Number

pith:5JRUKBBC

pith:2025:5JRUKBBC5R6E6LXVRVCXH7PWW6

not attested not anchored not stored refs pending

Medical Large Language Model Benchmarks Should Prioritize Construct Validity

Ahmed Alaa, Frances Dean, Inioluwa Deborah Raji, Niloufar Golchini, Shiladitya Dutta, Thomas Hartvigsen, Travis Zack

arxiv:2503.10694 v1 · 2025-03-12 · cs.CL

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{5JRUKBBC5R6E6LXVRVCXH7PWW6}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

6 papers in Pith

Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoning

Same Evidence, Different Answer: Auditing Order Sensitivity in Multimodal Large Language Models

Resolution Diagnostics for Paired LLM Evaluation

Healthcare LLM Benchmarks Are Only as Good as Their Explicit Assumptions

ContractBench: Can LLM Agents Preserve Observation Contracts?

Receipt and verification

First computed	2026-07-05T10:31:03.838757Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

ea63450422ec7c4f2ef58d4573fdf6b78c4621cc2ff752d7a705a160284ea579

Aliases

arxiv: 2503.10694 · arxiv_version: 2503.10694v1 · doi: 10.48550/arxiv.2503.10694 · pith_short_12: 5JRUKBBC5R6E · pith_short_16: 5JRUKBBC5R6E6LXV · pith_short_8: 5JRUKBBC

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/5JRUKBBC5R6E6LXVRVCXH7PWW6 \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: ea63450422ec7c4f2ef58d4573fdf6b78c4621cc2ff752d7a705a160284ea579

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "2bbf3136f8c2c093ade21956320fb64938e047594fbbde29826c7e4e82b0ab48",
    "cross_cats_sorted": [],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2025-03-12T05:08:02Z",
    "title_canon_sha256": "b015ebec658297ccd4648d1da60ad81c3cb3a186b36777e865389542b264da5f"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2503.10694",
    "kind": "arxiv",
    "version": 1
  }
}