Domain-adapted BERT models distinguish senses of 'Planck' better than general models, and reveal the rise of the Planck mission meaning in physics papers.
Isotropy, Clusters, and Classifiers
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
Whether embedding spaces use all their dimensions equally, i.e., whether they are isotropic, has been a recent subject of discussion. Evidence has been accrued both for and against enforcing isotropy in embedding spaces. In the present paper, we stress that isotropy imposes requirements on the embedding space that are not compatible with the presence of clusters -- which also negatively impacts linear classification objectives. We demonstrate this fact both mathematically and empirically and use it to shed light on previous results from the literature.
fields
cs.CL 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Meaning at the Planck scale? Contextualized word embeddings for doing history, philosophy, and sociology of science
Domain-adapted BERT models distinguish senses of 'Planck' better than general models, and reveal the rise of the Planck mission meaning in physics papers.