On MNIST, learned block-rotation 'monoidal' embeddings outperform fixed truncated DFT embeddings, with the gap growing as embedding dimension drops to 2.
Directional Non-Commutative Monoidal Structures with Interchange Law via Commutative Generators
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
We introduce a novel framework consisting of a class of algebraic structures that generalize one-dimensional monoidal systems into higher dimensions by defining per-axis composition operators subject to non-commutativity and a global interchange law. These structures, defined recursively from a base case of vector-matrix pairs, model directional composition in multiple dimensions while preserving structural coherence through commutative linear operators. We show that the framework that unifies several well-known linear transforms in signal processing and data analysis. In this framework, data indices are embedded into a composite structure that decomposes into simpler components. We show that classic transforms such as the Discrete Fourier Transform (DFT), the Walsh transform, and the Hadamard transform are special cases of our algebraic structure. The framework provides a systematic way to derive these transforms by appropriately choosing vector and matrix pairs. By subsuming classical transforms within a common structure, the framework also enables the development of learnable transformations tailored to specific data modalities and tasks.
citation-role summary
citation-polarity summary
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1roles
extension 1polarities
extend 1representative citing papers
citing papers explorer
-
Directional Non-Commutative Monoidal Embeddings for MNIST
On MNIST, learned block-rotation 'monoidal' embeddings outperform fixed truncated DFT embeddings, with the gap growing as embedding dimension drops to 2.