REVIEW 3 cited by
Wavelets Are All You Need for Autoregressive Image Generation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
In this paper, we take a new approach to autoregressive image generation that is based on two main ingredients. The first is wavelet image coding, which allows to tokenize the visual details of an image from coarse to fine details by ordering the information starting with the most significant bits of the most significant wavelet coefficients. The second is a variant of a language transformer whose architecture is re-designed and optimized for token sequences in this 'wavelet language'. The transformer learns the significant statistical correlations within a token sequence, which are the manifestations of well-known correlations between the wavelet subbands at various resolutions. We show experimental results with conditioning on the generation process.
Forward citations
Cited by 3 Pith papers
-
Flow Along the K-Amplitude for Generative Modeling
K-Flow trains flow-matching models with frequency scale as time, enabling competitive image and molecule generation plus scale-level control of outputs.
-
DCTdiff: Intriguing Properties of Image Generative Modeling in the DCT Space
Diffusion models trained on DCT-compressed image representations outperform pixel-based and latent (VAE) diffusion baselines at lower training cost.
-
Enhancing Foundation Models for Time Series Forecasting via Wavelet-based Tokenization
A wavelet-based tokenizer that lets an autoregressive transformer forecast quantized wavelet coefficients instead of raw values, improving accuracy and generalization on time series benchmarks.
Discussion (0). Continue with ORCID to comment.