Replacing standard self-attention with performer attention in the pooling layer of a language identification model improves average accuracy on VoxPopuli, FLEURS, and VoxLingua, while agent attention is comparable and theoretically cheaper.
It is often used in applications like speech recogni- tion [1, 2], language translation [3], and content filtering [4]
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
background 1
citation-polarity summary
fields
eess.AS 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
On the use of Performer and Agent Attention for Spoken Language Identification
Replacing standard self-attention with performer attention in the pooling layer of a language identification model improves average accuracy on VoxPopuli, FLEURS, and VoxLingua, while agent attention is comparable and theoretically cheaper.