LightVLM accelerates vision-language model inference with pyramid token merging and KV cache compression, preserving about 98% accuracy with only 3% of image tokens.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CV 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
LightVLM: Acceleraing Large Multimodal Models with Pyramid Token Merging and KV Cache Compression
LightVLM accelerates vision-language model inference with pyramid token merging and KV cache compression, preserving about 98% accuracy with only 3% of image tokens.