The Visual Token Codec compresses ViT intermediate features by entropy-coding patch tokens on their native grid instead of a flattened sequence, reducing bitrate by 15.7x to 37.4x at 90% of uncompressed performance over a VTM-based baseline.
DMOFC: Discrimination Metric-Optimized Feature Compression
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Feature compression, as an important branch of video coding for machines (VCM), has attracted significant attention and exploration. However, the existing methods mainly focus on intra-feature similarity, such as the Mean Squared Error (MSE) between the reconstructed and original features, while neglecting the importance of inter-feature relationships. In this paper, we analyze the inter-feature relationships, focusing on feature discriminability in machine vision and underscoring its significance in feature compression. To maintain the feature discriminability of reconstructed features, we introduce a discrimination metric for feature compression. The discrimination metric is designed to ensure that the distance between features of the same category is smaller than the distance between features of different categories. Furthermore, we explore the relationship between the discrimination metric and the discriminability of the original features. Experimental results confirm the effectiveness of the proposed discrimination metric and reveal there exists a trade-off between the discrimination metric and the discriminability of the original features.
citation-role summary
citation-polarity summary
fields
cs.CV 1years
2026 1verdicts
CONDITIONAL 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
Visual Token Codec: Unleashing Spatial Redundancy for ViT Feature Coding
The Visual Token Codec compresses ViT intermediate features by entropy-coding patch tokens on their native grid instead of a flattened sequence, reducing bitrate by 15.7x to 37.4x at 90% of uncompressed performance over a VTM-based baseline.