The paper claims that linear self-attention defines a parametric endofunctor whose layered stacking is the free monad, but the construction is mostly restatement and has serious technical flaws.
Convenient categories of smooth spaces
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2025 1verdicts
REJECT 1representative citing papers
citing papers explorer
-
Self-Attention as a Parametric Endofunctor: A Categorical Framework for Transformer Architectures
The paper claims that linear self-attention defines a parametric endofunctor whose layered stacking is the free monad, but the construction is mostly restatement and has serious technical flaws.