pith:BYFFEMDJ
Sketch Then Paint: Hierarchical Reinforcement Learning for Diffusion Multi-Modal Large Language Models
Hierarchical reinforcement learning with staged sketch-then-paint updates improves how diffusion multimodal models assign credit during image generation.
arxiv:2605.16842 v1 · 2026-05-16 · cs.AI
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{BYFFEMDJN5AAXFGZ5K2OHHRJ44}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
HT-GRPO achieves substantial gains on the GenEval and DPG benchmarks. Evaluations across six additional metrics confirm significant improvements in image quality, aesthetics, and human preference.
The prompt-conditioned estimator correctly computes importance ratios from a fully masked state and the hierarchical credit assignment accurately prioritizes structural tokens without introducing new biases or instabilities in the policy optimization.
Proposes HT-GRPO with sketch-then-paint staged updates, prompt-conditioned importance ratios, and hierarchical credit assignment for dMLLMs, reporting gains on GenEval and DPG plus quality metrics.
References
Formal links
Receipt and verification
| First computed | 2026-05-20T00:03:25.755287Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
0e0a5230696f400b94d9eab4e39e29e71158dca69d8cdf346aab34f3a1460273
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/BYFFEMDJN5AAXFGZ5K2OHHRJ44 \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 0e0a5230696f400b94d9eab4e39e29e71158dca69d8cdf346aab34f3a1460273
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "5b1c3ab3f01a8eda0f7c556aeac57b2b5fe7414e73ae723e5628244892489f00",
"cross_cats_sorted": [],
"license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
"primary_cat": "cs.AI",
"submitted_at": "2026-05-16T06:59:54Z",
"title_canon_sha256": "58a4888ac1e2fff49fc3abc3084a79e22f0b0c689af7db46ae3d44292e3f65a7"
},
"schema_version": "1.0",
"source": {
"id": "2605.16842",
"kind": "arxiv",
"version": 1
}
}