The subspace intervention framework reveals that pre-training objectives shape how ViTs encode geometric information in compressible low-rank subspaces, with peak precision at intermediate layers.
In: International conference on ma- chine learning
2 Pith papers cite this work. Polarity classification is still indexing.
fields
cs.CV 2years
2026 2representative citing papers
Under cold-start scarcity, ArcAD's Sinkhorn-balanced hyperspherical clustering plus anomaly-guided repulsion lifts reconstruction-based anomaly detection, with the clearest gains (+3.7 to +11.2 I-AUROC) on large multi-class benchmarks.
citing papers explorer
-
Understanding Geometric Representations in Self-Supervised Vision Transformers via Subspace Intervention
The subspace intervention framework reveals that pre-training objectives shape how ViTs encode geometric information in compressible low-rank subspaces, with peak precision at intermediate layers.
-
ArcAD: Anomaly-Rectified Calibration for Cold-Start Supervised Anomaly Detection
Under cold-start scarcity, ArcAD's Sinkhorn-balanced hyperspherical clustering plus anomaly-guided repulsion lifts reconstruction-based anomaly detection, with the clearest gains (+3.7 to +11.2 I-AUROC) on large multi-class benchmarks.