A no-softmax language model using random-feature-linearized 2-simplicial attention plus Kimi Delta Attention reports higher mean accuracy at 16k context under an analytic iso-FLOP budget.
International Conference on Learning Representations , year =
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.AI 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Linearized 2-Simplicial Attention
A no-softmax language model using random-feature-linearized 2-simplicial attention plus Kimi Delta Attention reports higher mean accuracy at 16k context under an analytic iso-FLOP budget.