pith:WA4HPUYA
DPrivBench: Benchmarking LLMs' Reasoning for Differential Privacy
DPrivBench shows that top LLMs handle basic differential privacy mechanisms but fail on advanced algorithms, exposing gaps in automated DP reasoning.
arxiv:2604.15851 v3 · 2026-04-17 · cs.LG · cs.AI · cs.CR
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{WA4HPUYAFG4223QK47MXKIF6RE}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
Experiments show that while the strongest models handle textbook mechanisms well, all models struggle with advanced algorithms, revealing substantial gaps in current DP reasoning capabilities.
The benchmark instances are free of shortcut reasoning patterns and correctly labeled as to whether each function satisfies the stated DP guarantee under the given assumptions.
DPrivBench shows that top LLMs handle basic differential privacy mechanisms but fail on advanced algorithms, exposing gaps in automated DP reasoning.
Receipt and verification
| First computed | 2026-05-20T00:04:31.797946Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
b03877d30029b9ad6e0ae7d97520be891bddaf91662d0832f3909e11b356cf50
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/WA4HPUYAFG4223QK47MXKIF6RE \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: b03877d30029b9ad6e0ae7d97520be891bddaf91662d0832f3909e11b356cf50
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "f99ea8b91d69c7290d1d304f8b51b02d60a37b0c55433ed60a44d39faf7ffc6f",
"cross_cats_sorted": [
"cs.AI",
"cs.CR"
],
"license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
"primary_cat": "cs.LG",
"submitted_at": "2026-04-17T09:03:11Z",
"title_canon_sha256": "7c00df388e9485eac7a07815c9502594e2c8e4d5b1d3171f8a9a695f793a4c53"
},
"schema_version": "1.0",
"source": {
"id": "2604.15851",
"kind": "arxiv",
"version": 3
}
}