TinyDrop uses a lightweight model's confidence and attention map to early-exit easy samples and drop uninformative tokens in frozen ViTs, cutting FLOPs by up to 87%.
Settings We evaluate TinyDrop across ImageNet-1K [19] on state-of- the-art architectures, including Vision Transformer [1, 20], BEiTv2 [3], DeiT3 [4] and DeiT [21]
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
method 1
citation-polarity summary
fields
cs.CV 1years
2025 1verdicts
CONDITIONAL 1roles
method 1polarities
use method 1representative citing papers
citing papers explorer
-
TinyDrop: Tiny Model Guided Token Dropping for Vision Transformers
TinyDrop uses a lightweight model's confidence and attention map to early-exit easy samples and drop uninformative tokens in frozen ViTs, cutting FLOPs by up to 87%.