pith:G3QQ7POG
MMSkills: Towards Multimodal Skills for General Visual Agents
MMSkills equips visual agents with reusable packages of textual procedures, state cards, and multi-view keyframes derived from public trajectories.
arxiv:2605.13527 v2 · 2026-05-13 · cs.AI
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{G3QQ7POGVFS2KAENSVZT6KAVWH}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
Experiments across GUI and game-based visual-agent benchmarks show that MMSkills consistently improve both frontier and smaller multimodal agents, suggesting that external multimodal procedural knowledge complements model-internal priors.
That the generated multimodal skills (state cards and keyframes) can be consulted at inference time without excessive image context or over-anchoring to reference screenshots, as stated in the problem formalization.
MMSkills creates compact multimodal skill packages from trajectories and uses a branch-loaded agent to improve visual decision-making on GUI and game benchmarks.
References
Formal links
Receipt and verification
| First computed | 2026-05-18T02:44:24.291370Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
36e10fbdc6a965a5008d95733f2815b1c1d841e6e556ada5757e391960041f88
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/G3QQ7POGVFS2KAENSVZT6KAVWH \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 36e10fbdc6a965a5008d95733f2815b1c1d841e6e556ada5757e391960041f88
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "76a3f6d7ee634029e7ff8b78b41a96b2433bb8e5c205dadbadab367e80e0734e",
"cross_cats_sorted": [],
"license": "http://creativecommons.org/licenses/by/4.0/",
"primary_cat": "cs.AI",
"submitted_at": "2026-05-13T13:40:31Z",
"title_canon_sha256": "322f5e2aeeb7abcf2eaa5cfb19c085f9141a433850de629f89519f63ac7d2135"
},
"schema_version": "1.0",
"source": {
"id": "2605.13527",
"kind": "arxiv",
"version": 2
}
}