pith:QUSHR6WH
CLIP Tricks You: Training-free Token Pruning for Efficient Pixel Grounding in Large VIsion-Language Models
Reversing CLIP visual-text similarity retains the tokens needed for accurate pixel grounding without training.
arxiv:2605.13178 v1 · 2026-05-13 · cs.CV · cs.AI
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{QUSHR6WH544A2PINBG53GSRP6Q}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
LiteLVLM significantly outperforms existing methods by over 5% across diverse token budgets. Without any training or fine-tuning, LiteLVLM maintains 90% of the original performance with a 22% speedup and a 2.3x memory reduction.
The observation that referent-region visual tokens exhibit low similarity to text in CLIP analysis generalizes directly to the large vision-language models used for pixel grounding, and that reversing the similarity ranking will reliably retain the necessary tokens across inputs and models.
LiteLVLM prunes visual tokens for pixel grounding by reversing CLIP visual-text similarity to retain referent region tokens, outperforming prior methods by over 5% with 22% speedup and 2.3x memory reduction without any training.
References
Receipt and verification
| First computed | 2026-05-18T03:08:56.450163Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
852478fac7ef380d3d0d09bbb34a2ff4131e3b3a4dee98b0e4e64acf152cb334
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/QUSHR6WH544A2PINBG53GSRP6Q \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 852478fac7ef380d3d0d09bbb34a2ff4131e3b3a4dee98b0e4e64acf152cb334
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "9c82ac07718480edb4405202e8eea1d3e1767846b96faaf68464ebc7e84c35a9",
"cross_cats_sorted": [
"cs.AI"
],
"license": "http://creativecommons.org/licenses/by/4.0/",
"primary_cat": "cs.CV",
"submitted_at": "2026-05-13T08:40:40Z",
"title_canon_sha256": "3723d4e9b36ff76cf8d891b08b3348d7cf26c77e5522988302b02f7ec78f7e66"
},
"schema_version": "1.0",
"source": {
"id": "2605.13178",
"kind": "arxiv",
"version": 1
}
}