In BERT, middle layers around layers 3 and 4 of BERT-base produce the strongest clustering of verb-particle constructions, with phrasal verbs like 'give up' separated more sharply than prepositional verbs like 'agree on'.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Analysis and Visualization of Linguistic Structures in Large Language Models: Neural Representations of Verb-Particle Constructions in BERT
In BERT, middle layers around layers 3 and 4 of BERT-base produce the strongest clustering of verb-particle constructions, with phrasal verbs like 'give up' separated more sharply than prepositional verbs like 'agree on'.