The authors argue that modality collapse is caused by polysemantic neurons entangling noisy and predictive features across modalities, and that knowledge distillation or explicit basis reallocation frees rank bottlenecks to prevent it.
S., Gupte, A., and Poggio, T
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2025 1verdicts
REJECT 1representative citing papers
citing papers explorer
-
A Closer Look at Multimodal Representation Collapse
The authors argue that modality collapse is caused by polysemantic neurons entangling noisy and predictive features across modalities, and that knowledge distillation or explicit basis reallocation frees rank bottlenecks to prevent it.