The paper claims that a fully spectral wavelet-domain model can reach near-Transformer accuracy on GLUE tasks while using 72% fewer parameters and no attention or convolution layers.
A Hybrid Wavelet-Fourier Method for Next-Generation Conditional Diffusion Models
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
We present a novel generative modeling framework,Wavelet-Fourier-Diffusion, which adapts the diffusion paradigm to hybrid frequency representations in order to synthesize high-quality, high-fidelity images with improved spatial localization. In contrast to conventional diffusion models that rely exclusively on additive noise in pixel space, our approach leverages a multi-transform that combines wavelet sub-band decomposition with partial Fourier steps. This strategy progressively degrades and then reconstructs images in a hybrid spectral domain during the forward and reverse diffusion processes. By supplementing traditional Fourier-based analysis with the spatial localization capabilities of wavelets, our model can capture both global structures and fine-grained features more effectively. We further extend the approach to conditional image generation by integrating embeddings or conditional features via cross-attention. Experimental evaluations on CIFAR-10, CelebA-HQ, and a conditional ImageNet subset illustrate that our method achieves competitive or superior performance relative to baseline diffusion models and state-of-the-art GANs, as measured by Fr\'echet Inception Distance (FID) and Inception Score (IS). We also show how the hybrid frequency-based representation improves control over global coherence and fine texture synthesis, paving the way for new directions in multi-scale generative modeling.
citation-role summary
citation-polarity summary
fields
cs.LG 1years
2025 1verdicts
REJECT 1roles
extension 1polarities
unclear 1representative citing papers
citing papers explorer
-
Wavelet Logic Machines: Learning and Reasoning in the Spectral Domain Without Neural Networks
The paper claims that a fully spectral wavelet-domain model can reach near-Transformer accuracy on GLUE tasks while using 72% fewer parameters and no attention or convolution layers.