Adding an equivariance regularizer to an autoregressive music transformer makes pitch-transposed and time-shifted inputs produce correspondingly shifted outputs while slightly improving next-token prediction.
To the best of our knowledge, this provides the first empirical evidence that equivariance does not emerge from scaling
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
method 1
citation-polarity summary
fields
cs.SD 1years
2026 1verdicts
CONDITIONAL 1roles
method 1polarities
support 1representative citing papers
citing papers explorer
-
Equivariant Music Transformer
Adding an equivariance regularizer to an autoregressive music transformer makes pitch-transposed and time-shifted inputs produce correspondingly shifted outputs while slightly improving next-token prediction.