For every prime p at least 5, a single ReLU neuron can, with positive Gaussian probability, train to a frozen or diverging state whose normalized Fourier spectrum flatly distributes energy, contradicting single-frequency alignment.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
math.OC 1years
2026 1verdicts
ACCEPT 1representative citing papers
citing papers explorer
-
A Counterexample to Fourier Alignment in Single-Neuron Modular Addition
For every prime p at least 5, a single ReLU neuron can, with positive Gaussian probability, train to a frozen or diverging state whose normalized Fourier spectrum flatly distributes energy, contradicting single-frequency alignment.