Pith. sign in

REVIEW 2 major objections 2 minor 23 cited by

DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generation

T0 review · 2 major / 2 minor · reviewed 2026-05-17 · grok-4.3

Challenge this review Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read DeCo decouples frequencies in pixel diffusion so the DiT models semantics while a lightweight decoder adds details.

desk verdict DeCo gets pixel diffusion competitive on ImageNet FID by decoupling frequencies, but the decoupling itself lacks direct validation in the abstract. read the letter →

arxiv 2511.19365 v2 submitted 2025-11-24 cs.CV cs.AI

Zehong Ma , Longhui Wei , Shuai Wang , Shiliang Zhang , Qi Tian This is my paper · ORCID
classification cs.CVcs.AI
keywords pixeldiffusionfrequencydecouplingimagegenerationtransformerflowmatchingNettext-to-image
checked against Cost.FunctionalEquationreality_from_one_distinction
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper tries to make end-to-end pixel diffusion competitive with latent methods by splitting the workload along frequency lines. A diffusion transformer focuses on low-frequency semantic structure, while a small decoder produces high-frequency visual details from that semantic guidance alone. This specialization is reinforced by a frequency-aware flow-matching loss that weights important frequencies more heavily. The result is faster training and inference plus better image quality than earlier single-network pixel diffusion approaches.

What carries the argument

The frequency-DeCoupled pixel diffusion framework that routes low-frequency semantics through a DiT and high-frequency details through a lightweight decoder conditioned on the DiT output.

What would settle it

Train an ablated version of DeCo that removes the separate decoder and forces the DiT to model all frequencies; if the FID on ImageNet 256x256 rises above 3.0 or visible high-frequency artifacts appear in generated images, the decoupling premise is falsified.

Watch

Extended reading notes

Core claim

DeCo decouples the generation of high-frequency details from low-frequency semantics in pixel space. The DiT specializes in modeling low-frequency content and supplies semantic guidance to a lightweight pixel decoder that synthesizes the high-frequency components. A frequency-aware flow-matching loss further directs attention to visually salient frequencies. This yields FID scores of 1.62 at 256x256 and 2.22 at 512x512 on ImageNet among pixel diffusion models and a GenEval score of 0.86 for the text-to-image variant.

Load-bearing premise

A lightweight pixel decoder can reliably synthesize accurate high-frequency details when given only semantic conditioning from the DiT without reintroducing artifacts or requiring joint optimization.

Editorial extensions

If this is right

  • Pixel diffusion models can train and sample faster because the main transformer no longer expends capacity on high-frequency signals.
  • End-to-end pixel-space generation becomes competitive with two-stage latent diffusion without relying on a VAE bottleneck.
  • The frequency-aware loss produces images with better perceptual quality by suppressing insignificant frequency bands.
  • The same pretrained backbone delivers leading system-level performance on text-to-image benchmarks such as GenEval.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same conditioning pattern could be tested on video or 3D diffusion to reduce compute while preserving fine detail.
  • Making the frequency split learned rather than fixed might further improve results on diverse datasets.
  • The approach suggests a general principle: separate semantic and perceptual modeling early in the generative pipeline.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

2 major / 2 minor

Summary. The manuscript presents DeCo, a frequency-decoupled pixel diffusion framework for end-to-end image generation. It uses a DiT to specialize in low-frequency semantics while a lightweight pixel decoder generates high-frequency details conditioned on DiT guidance, combined with a frequency-aware flow-matching loss that emphasizes salient frequencies. Experiments report FID scores of 1.62 (256×256) and 2.22 (512×512) on ImageNet, closing the gap with latent diffusion models, and a text-to-image variant achieves an overall score of 0.86 on GenEval.

Significance. If the decoupling is effective, the approach could enable more efficient pixel-space diffusion with higher capacity than VAE-based latent methods by avoiding compression artifacts and allowing component specialization. The public code release at the provided GitHub link is a clear strength supporting reproducibility.

major comments (2)
  1. [Method (§3)] The central claim that frequency decoupling succeeds (DiT models only low-frequency semantics while the decoder produces high-frequency content from guidance alone without artifacts or re-coupling via joint optimization) is load-bearing but unsupported by direct evidence. No frequency-spectrum analysis, high-frequency error maps, or conditioning diagrams are provided to verify specialization.
  2. [Experiments (§4)] Experiments section: No ablations isolate the contribution of the frequency-aware flow-matching loss or the lightweight decoder design; without these, it is unclear whether the reported FID gains (1.62 at 256²) stem from true decoupling or from other unisolated factors such as training schedule or architecture scale.
minor comments (2)
  1. [Abstract] The abstract states that the decoder is 'lightweight' but does not quantify parameter count or FLOPs relative to the DiT, which would clarify the efficiency claim.
  2. [Figures] Figure captions and diagrams could more explicitly label the frequency separation path and loss weighting to improve readability for readers unfamiliar with the split.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the thoughtful and constructive review. We address each major comment below with clarifications and proposed revisions to strengthen the manuscript.

read point-by-point responses

  1. Referee: [Method (§3)] The central claim that frequency decoupling succeeds (DiT models only low-frequency semantics while the decoder produces high-frequency content from guidance alone without artifacts or re-coupling via joint optimization) is load-bearing but unsupported by direct evidence. No frequency-spectrum analysis, high-frequency error maps, or conditioning diagrams are provided to verify specialization.

    Authors: We agree that additional direct evidence would better substantiate the specialization claim. In the revised manuscript we will add frequency-spectrum analysis comparing the DiT output and final decoder output, high-frequency error maps relative to ground truth, and a conditioning diagram that illustrates the guidance pathway from DiT to decoder. These additions will be placed in Section 3 and the supplementary material. revision: yes

  2. Referee: [Experiments (§4)] Experiments section: No ablations isolate the contribution of the frequency-aware flow-matching loss or the lightweight decoder design; without these, it is unclear whether the reported FID gains (1.62 at 256²) stem from true decoupling or from other unisolated factors such as training schedule or architecture scale.

    Authors: We acknowledge that the current experiments do not contain targeted ablations for these two components. We will add two new ablation studies in the revised Section 4: (1) a comparison of the frequency-aware flow-matching loss against a standard flow-matching baseline while keeping all other elements fixed, and (2) an ablation replacing the lightweight decoder with a deeper variant to isolate its contribution. These results will be reported alongside the existing FID numbers. revision: yes

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: architectural design choices and empirical results are independent of inputs

full rationale

The paper presents DeCo as an empirical framework consisting of a proposed frequency-decoupled architecture (DiT for low-frequency semantics plus lightweight pixel decoder for high-frequency details) and a frequency-aware flow-matching loss. These are introduced as design decisions motivated by intuition about frequency separation, not derived from equations or prior results that reduce back to the same inputs by construction. Reported FID scores (1.62 at 256x256, 2.22 at 512x512) and GenEval score arise from standard benchmark evaluations on ImageNet, which are external to the model definition. No self-citations, uniqueness theorems, fitted parameters renamed as predictions, or ansatzes smuggled via prior work are used to justify the central claims. The derivation chain is therefore self-contained as an engineering proposal validated experimentally.

Assumptions & free parameters 0 free parameters · 2 assumptions · 0 invented entities

The central claim rests on standard diffusion-model assumptions plus the paper-specific premise that frequency components can be cleanly separated and handled by separate modules without significant information loss or optimization conflicts.

assumptions (2)
  • standard math Standard assumptions of flow-matching or diffusion processes in image generation (e.g., gradual noise addition and reversal)
    Invoked implicitly when describing the DiT and flow-matching loss.
  • domain assumption High-frequency details can be generated reliably by a lightweight decoder conditioned solely on low-frequency semantic features from the DiT
    Core design choice stated in the abstract; if false the decoupling benefit disappears.

how reviews work

0 comments
Cite this review

Pith. "Pith review of DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generation." pith.science (2026). https://pith.science/paper/2511.19365

@misc{pith2026251119365,
  author       = {Pith},
  title        = {Pith review of: DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/2511.19365}},
  note         = {Machine review of arXiv:2511.19365}
}
read the original abstract

Pixel diffusion aims to generate images directly in pixel space in an end-to-end fashion. This approach avoids the limitations of VAE in the two-stage latent diffusion, offering higher model capacity. Existing pixel diffusion models suffer from slow training and inference, as they usually model both high-frequency signals and low-frequency semantics within a single diffusion transformer (DiT). To pursue a more efficient pixel diffusion paradigm, we propose the frequency-DeCoupled pixel diffusion framework. With the intuition to decouple the generation of high and low frequency components, we leverage a lightweight pixel decoder to generate high-frequency details conditioned on semantic guidance from the DiT. This thus frees the DiT to specialize in modeling low-frequency semantics. In addition, we introduce a frequency-aware flow-matching loss that emphasizes visually salient frequencies while suppressing insignificant ones. Extensive experiments show that DeCo achieves superior performance among pixel diffusion models, attaining FID of 1.62 (256x256) and 2.22 (512x512) on ImageNet, closing the gap with latent diffusion methods. Furthermore, our pretrained text-to-image model achieves a leading overall score of 0.86 on GenEval in system-level comparison. Codes are publicly available at https://github.com/Zehong-Ma/DeCo.

Figures

Figures reproduced from arXiv: 2511.19365 by the authors.

Figure 1
Figure 1. Qualitative results of text-to-image generation of DeCo. All images are 512 [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Illustration of our frequency-decoupled (DeCo) framework. In (a), traditional baseline models rely on a single DiT to jointly [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗
Figure 3
Figure 3. Overview of the proposed frequency-decoupled (DeCo) framework. The DiT operates on downsampled inputs to model low [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (7 more)
Figure 4
Figure 4. Figure 4: DCT energy distribution of DiT outputs and predicted [PITH_FULL_IMAGE:figures/full_fig_p005_4.png]
Figure 5
Figure 5. Figure 5: FID comparison between our DeCo and baseline. DeCo [PITH_FULL_IMAGE:figures/full_fig_p006_5.png]
Figure 6
Figure 6. Figure 6: Qualitative results of class-to-image generation of DeCo. All images are 256 [PITH_FULL_IMAGE:figures/full_fig_p007_6.png]
Figure 7
Figure 7. Figure 7: Base and Scaled Quantization Tables. factor q to create new scaled quantization tables Qcur for different compression levels. Since a smaller quantization step implies that a fre￾quency component is more significant to human perception, we use the normalized reciprocal…
Figure 8
Figure 8. Figure 8: More Qualitative results of text-to-image generation at a 512 [PITH_FULL_IMAGE:figures/full_fig_p013_8.png]
Figure 9
Figure 9. Figure 9: More qualitative results of class-to-image generation at a 256 [PITH_FULL_IMAGE:figures/full_fig_p014_9.png]
Figure 10
Figure 10. Figure 10: Qualitative results of class-to-image generation at a 512 [PITH_FULL_IMAGE:figures/full_fig_p015_10.png]

Discussion (0). Continue with ORCID to comment.

Lean theorems connected to this paper

Citations machine-checked in the Pith Canon. Every link opens the source theorem in the public Lean library.

  • IndisputableMonolith/Cost/FunctionalEquation.lean washburn_uniqueness_aczel unclear
    ?
    unclear

    Relation between the paper passage and the cited Recognition theorem.

    leverage a lightweight pixel decoder to generate high-frequency details conditioned on semantic guidance from the DiT... frequency-aware flow-matching loss that emphasizes visually salient frequencies while suppressing insignificant ones... DCT... JPEG quantization tables

  • IndisputableMonolith/Foundation/RealityFromDistinction.lean reality_from_one_distinction unclear
    ?
    unclear

    Relation between the paper passage and the cited Recognition theorem.

    DiT to specialize in modeling low-frequency semantics... 8-tick period never mentioned; no golden-ratio or reciprocal-cost identities

What do these tags mean?
matches
The paper's claim is directly supported by a theorem in the formal canon.
supports
The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
extends
The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
uses
The paper appears to rely on the theorem as machinery.
contradicts
The paper's claim conflicts with a theorem or certificate in the canon.
unclear
Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.

Forward citations

Cited by 23 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. WavTTS: Towards High-Quality Zero-Shot TTS via Direct Raw Waveform Modeling

    eess.AS 2026-06 unverdicted novelty 8.0 of 10

    WavTTS is the first raw-waveform diffusion TTS model using DiT flow matching and multi-scale mel supervision that approaches SOTA latent zero-shot performance while beating prior end-to-end models.

  2. SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolation

    cs.MM 2026-07 conditional novelty 7.0 of 10

    SPEED generates an interpolated video frame in a single pixel-space diffusion step, reporting state-of-the-art LPIPS on DAVIS, SNU-FILM, and XTest4K with lower latency and memory than latent-diffusion baselines.

  3. Coevolving Representations in Joint Image-Feature Diffusion

    cs.CV 2026-04 unverdicted novelty 7.0 of 10

    CoReDi coevolves semantic representations with the diffusion model via a jointly learned linear projection stabilized by stop-gradient, normalization, and regularization, yielding faster convergence and higher sample ...

  4. Energy-Guided Flow Matching

    cs.CV 2026-08 conditional novelty 6.0 of 10

    Energy-Guided Flow Matching replaces the fixed clean endpoint with a sample-adaptive heat-kernel-filtered endpoint, yielding coarse-to-fine generation, better ImageNet FID, and faster convergence.

  5. DuSPiT: Dual-Branch Sub-Patch Pixel Diffusion Transformer

    cs.CV 2026-07 conditional novelty 6.0 of 10

    DuSPiT splits pixel diffusion into a compact global-structure branch and a high-capacity subpatch detail branch, reaching ImageNet-512 FID 1.52 at 329 GFLOPs, below JiT-G/32 (1.78).

  6. PixWorld: Unifying 3D Scene Generation and Reconstruction in Pixel Space

    cs.CV 2026-07 conditional novelty 6.0 of 10

    A single pixel-space diffusion model jointly performs 3D scene reconstruction and generation by supervising flow matching on rendered multi-view images, matching SOTA reconstruction and outperforming latent-space generation.

  7. PixelU: A U-Shaped Transformer for Efficient End-to-End Pixel Diffusion

    cs.CV 2026-06 unverdicted novelty 6.0 of 10

    PixelU is a minimalist U-shaped Diffusion Transformer for pixel-space diffusion that decouples frequencies with zero-cost skip connections and constant-channel downsampling, outperforming baselines like JiT-G at 1/3 t...

  8. BareWave: Waveform-Native Flow-Matching Text-to-Speech

    eess.AS 2026-06 unverdicted novelty 6.0 of 10

    BareWave develops a waveform-native flow-matching framework for direct text-to-waveform TTS using representation alignment, staged noise scheduling, and velocity-aware perceptual alignment to achieve strong zero-shot ...

  9. Diffusion Image Generation with Explicit Modeling of Data Manifold Geometry

    cs.CV 2026-05 unverdicted novelty 6.0 of 10

    MIND integrates discrete patch tokenization into diffusion score functions via soft top-k and dual-branch layers, achieving FID 22.73 (no guidance) and 2.06 (with guidance) on ImageNet-256 after 80 epochs, outperformi...

  10. PixIE: Prompted Pixel-Space Low-Light Image Enhancement

    cs.CV 2026-05 unverdicted novelty 6.0 of 10

    PixIE proposes a pixel-space low-light image enhancement framework using DINO-prompted blocks, spatial-channel compaction, and multi-receptive-field embeddings, reporting PSNR gains of 1.9-15.0% and LPIPS reductions o...

  11. HyperDiT: Hyper-Connected Transformers for High-Fidelity Pixel-Space Diffusion

    cs.CV 2026-05 unverdicted novelty 6.0 of 10

    HyperDiT reports FID 1.56 on ImageNet 256x256 using hyper-connected cross-scale attention, SA-RoPE, and VFM registers in pixel space.

  12. L2P: Unlocking Latent Potential for Pixel Generation

    cs.CV 2026-05 unverdicted novelty 6.0 of 10

    L2P repurposes pre-trained LDMs for direct pixel generation via large-patch tokenization and shallow-layer training on synthetic data, matching source performance with 8-GPU training and enabling native 4K output.

  13. FREPix: Frequency-Heterogeneous Flow Matching for Pixel-Space Image Generation

    cs.CV 2026-05 unverdicted novelty 6.0 of 10

    FREPix generates images by transporting low- and high-frequency wavelet components along separate schedules, reaching 1.91 FID on ImageNet 256×256.

  14. CoD-Lite: Real-Time Diffusion-Based Generative Image Compression

    cs.CV 2026-04 unverdicted novelty 6.0 of 10

    CoD-Lite delivers real-time generative image compression via a lightweight convolution-based diffusion codec with compression-oriented pre-training and distillation, achieving substantial bitrate savings.

  15. PixelGen: Improving Pixel Diffusion with Perceptual Supervision

    cs.CV 2026-02 accept novelty 6.0 of 10

    PixelGen augments pixel diffusion with gated perceptual supervision to reach FID 5.11 on ImageNet-256 and GenEval 0.79 in text-to-image, narrowing the gap to latent methods without VAEs.

  16. STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching

    cs.CV 2026-07 conditional novelty 5.0 of 10

    A hybrid stereo-matching model uses a cascade matching network to propose disparities and a diffusion transformer to refine ambiguous regions; it claims state-of-the-art benchmark results.

  17. FADRA: Frequency-Aware Diffusion with Residual Adaptation for Video Face Restoration

    cs.CV 2026-07 conditional novelty 5.0 of 10

    FADRA restores degraded face videos by adding LQ-guided step-wise residual refinement and a frequency-aware loss to a frozen text-to-video diffusion model, achieving state-of-the-art temporal coherence and spatial fidelity.

  18. Trajectory Forcing: Structure-First Generation with Controllable Semantic Trajectories

    cs.CV 2026-06 unverdicted novelty 5.0 of 10

    Trajectory Forcing makes generative image synthesis trajectory-centric by organizing it into decodable semantic stages derived from clustered visual representations and trained with one-step flow-matching models.

  19. SpectralDiT: Timestep-Conditioned Spectral Residual Correction for Flow-Matching DiTs

    cs.CV 2026-06 unverdicted novelty 5.0 of 10

    SpectralDiT adds timestep-conditioned spectral residual correction to flow-matching DiTs and reports FID reductions of 5% on CIFAR-10 and 8.7% relative on ImageNet-100 latent diffusion with under 2% added parameters.

  20. FrequencyBooster: Full-Frequency Modeling for High-Fidelity Pixel Diffusion

    cs.CV 2026-05 unverdicted novelty 5.0 of 10

    FrequencyBooster reports state-of-the-art FID scores of 1.60 at 256x256 and 1.69 at 512x512 for pixel diffusion by using a specialized decoder for full-frequency modeling.

  21. HDRFace: Rethinking Face Restoration with High-Dimensional Representation

    cs.CV 2026-05 unverdicted novelty 5.0 of 10

    HDRFace injects high-dimensional facial features from low-quality and intermediate images into diffusion models via SDFM fusion, reporting gains on SD V2.1-base and Qwen-Image.

  22. SPROUT: A Scalable Diffusion Foundation Model for Agricultural Vision

    cs.CV 2026-03 conditional novelty 5.0 of 10

    SPROUT, a pixel-space diffusion transformer pre-trained on 2.6M unlabeled agricultural images with effective-rank timestep selection, outperforms web-pretrained foundation models on dense plant phenotyping tasks.

  23. Why Do DiT Editors Drift? Plug-and-Play Low Frequency Alignment in VAE Latent Space

    cs.CV 2026-05 unverdicted novelty 4.0 of 10

    VAE-LFA suppresses semantic drift in multi-turn DiT image editing by low-pass filtering latent discrepancies and aligning low-frequency components to an EMA of previous rounds in VAE space.

Reference graph

Works this paper leans on

71 extracted references · 71 canonical work pages · cited by 23 Pith papers

  1. [1]

    All are worth words: A vit backbone for diffusion models

    Fan Bao, Shen Nie, Kaiwen Xue, Yue Cao, Chongxuan Li, Hang Su, and Jun Zhu. All are worth words: A vit backbone for diffusion models. InProceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 22669–22679, 2023. 3

    work page 2023

  2. [2]

    Improving image gener- ation with better captions

    James Betker, Gabriel Goh, Li Jing, Tim Brooks, Jianfeng Wang, Linjie Li, Long Ouyang, Juntang Zhuang, Joyce Lee, Yufei Guo, Wesam Manassra, Prafulla Dhariwal, Casey Chu, Yunxin Jiao, and Aditya Ramesh. Improving image gener- ation with better captions. OpenAI Technical Report, 2023. 8

    work page 2023

  3. [3]

    Pixart-α: Fast training of dif- fusion transformer for photorealistic text-to-image synthesis,

    Junsong Chen, Jincheng Yu, Chongjian Ge, Lewei Yao, Enze Xie, Yue Wu, Zhongdao Wang, James Kwok, Ping Luo, Huchuan Lu, and Zhenguo Li. Pixart-α: Fast training of dif- fusion transformer for photorealistic text-to-image synthesis,

    work page

  4. [4]

    Deep Compression Autoencoder for Efficient High-Resolution Diffusion Models

    Junyu Chen, Han Cai, Junsong Chen, Enze Xie, Shang Yang, Haotian Tang, Muyang Li, Yao Lu, and Song Han. Deep compression autoencoder for efficient high-resolution diffu- sion models.arXiv preprint arXiv:2410.10733, 2024. 3

    work page Pith review arXiv 2024

  5. [5]

    BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Dataset

    Jiuhai Chen, Zhiyang Xu, Xichen Pan, Yushi Hu, Can Qin, Tom Goldstein, Lifu Huang, Tianyi Zhou, Saining Xie, Sil- vio Savarese, et al. Blip3-o: A family of fully open unified multimodal models-architecture, training and dataset.arXiv preprint arXiv:2505.09568, 2025. 8, 3

    work page Pith review arXiv 2025

  6. [6]

    PixelFlow: Pixel-Space Generative Models with Flow

    Shoufa Chen, Chongjian Ge, Shilong Zhang, Peize Sun, and Ping Luo. Pixelflow: Pixel-space generative models with flow.arXiv preprint arXiv:2504.07963, 2025. 2, 3, 4, 5, 6, 7, 8, 1

    work page Pith review arXiv 2025

  7. [7]

    Vision transformer adapter for dense predictions

    Zhe Chen, Yuchen Duan, Wenhai Wang, Junjun He, Tong Lu, Jifeng Dai, and Yu Qiao. Vision transformer adapter for dense predictions. InThe Eleventh International Conference on Learning Representations, 2023. 2

    work page 2023

  8. [8]

    Deep generative image models using a laplacian pyramid of adver- sarial networks.Advances in neural information processing systems, 28, 2015

    Emily L Denton, Soumith Chintala, Rob Fergus, et al. Deep generative image models using a laplacian pyramid of adver- sarial networks.Advances in neural information processing systems, 28, 2015. 2

    work page 2015

Show all 71 references
  1. [9]

    Diffusion models beat gans on image synthesis.Advances in neural informa- tion processing systems, 34:8780–8794, 2021

    Prafulla Dhariwal and Alexander Nichol. Diffusion models beat gans on image synthesis.Advances in neural informa- tion processing systems, 34:8780–8794, 2021. 1, 2, 3, 7

    2021

  2. [10]

    Sigmoid- weighted linear units for neural network function approxima- tion in reinforcement learning.Neural networks, 107:3–11,

    Stefan Elfwing, Eiji Uchibe, and Kenji Doya. Sigmoid- weighted linear units for neural network function approxima- tion in reinforcement learning.Neural networks, 107:3–11,

  3. [11]

    Scaling rectified flow transformers for high-resolution image synthesis.arXiv preprint arXiv:2403.03206, 2024

    Patrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari, Jonas M ¨uller, Harry Saini, Yam Levi, Dominik Lorenz, Axel Sauer, Frederic Boesel, et al. Scaling rectified flow transformers for high-resolution image synthesis.arXiv preprint arXiv:2403.03206, 2024. 8

    2024 arXiv

  4. [12]

    Fluid: Scaling autoregressive text-to-image generative models with continuous tokens.arXiv preprint arXiv:2410.13863, 2024

    Lijie Fan, Tianhong Li, Siyang Qin, Yuanzhen Li, Chen Sun, Michael Rubinstein, Deqing Sun, Kaiming He, and Yonglong Tian. Fluid: Scaling autoregressive text-to-image generative models with continuous tokens.arXiv preprint arXiv:2410.13863, 2024. 1

    2024

  5. [13]

    Seedream 3.0 technical report.arXiv preprint arXiv:2504.11346, 2025

    Yu Gao, Lixue Gong, Qiushan Guo, Xiaoxia Hou, Zhichao Lai, Fanshi Li, Liang Li, Xiaochen Lian, Chao Liao, Liyang Liu, et al. Seedream 3.0 technical report.arXiv preprint arXiv:2504.11346, 2025. 1

    2025 arXiv

  6. [14]

    Geneval: An object-focused framework for evaluating text- to-image alignment.Advances in Neural Information Pro- cessing Systems, 36:52132–52152, 2023

    Dhruba Ghosh, Hannaneh Hajishirzi, and Ludwig Schmidt. Geneval: An object-focused framework for evaluating text- to-image alignment.Advances in Neural Information Pro- cessing Systems, 36:52132–52152, 2023. 6, 8

    2023

  7. [15]

    Seedream 2.0: A native chinese-english bilin- gual image generation foundation model.arXiv preprint arXiv:2503.07703, 2025

    Lixue Gong, Xiaoxia Hou, Fanshi Li, Liang Li, Xiaochen Lian, Fei Liu, Liyang Liu, Wei Liu, Wei Lu, Yichun Shi, et al. Seedream 2.0: A native chinese-english bilin- gual image generation foundation model.arXiv preprint arXiv:2503.07703, 2025. 1

    2025

  8. [16]

    Neue methoden zur approximativen integration der differentialgleichungen einer unabh ¨angigen ver¨anderlichen.Z

    Karl Heun et al. Neue methoden zur approximativen integration der differentialgleichungen einer unabh ¨angigen ver¨anderlichen.Z. Math. Phys, 45:23–38, 1900. 7, 8

    1900

  9. [17]

    Gans trained by a two time-scale update rule converge to a local nash equilib- rium.Advances in neural information processing systems, 30, 2017

    Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. Gans trained by a two time-scale update rule converge to a local nash equilib- rium.Advances in neural information processing systems, 30, 2017. 6

    2017

  10. [18]

    Classifier-free diffusion guidance.arXiv preprint arXiv:2207.12598, 2022

    Jonathan Ho and Tim Salimans. Classifier-free diffusion guidance.arXiv preprint arXiv:2207.12598, 2022. 6, 1

    2022 arXiv

  11. [19]

    Denoising dif- fusion probabilistic models.Advances in neural information processing systems, 33:6840–6851, 2020

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising dif- fusion probabilistic models.Advances in neural information processing systems, 33:6840–6851, 2020. 1

    2020

  12. [20]

    sim- ple diffusion: End-to-end diffusion for high resolution im- ages

    Emiel Hoogeboom, Jonathan Heek, and Tim Salimans. sim- ple diffusion: End-to-end diffusion for high resolution im- ages. InInternational Conference on Machine Learning, pages 13213–13232. PMLR, 2023. 2, 3

    2023

  13. [21]

    Ella: Equip diffusion models with llm for enhanced semantic alignment.arXiv preprint arXiv:2403.05135, 2024

    Xiwei Hu, Rui Wang, Yixiao Fang, Bin Fu, Pei Cheng, and Gang Yu. Ella: Equip diffusion models with llm for enhanced semantic alignment.arXiv preprint arXiv:2403.05135, 2024. 6, 8

    2024 arXiv

  14. [22]

    Scalable adap- tive computation for iterative generation.arXiv preprint arXiv:2212.11972, 2022

    Allan Jabri, David Fleet, and Ting Chen. Scalable adap- tive computation for iterative generation.arXiv preprint arXiv:2212.11972, 2022. 7

    2022

  15. [23]

    Information technology — digital compression and coding of continuous-tone still images: Requirements and guidelines

    Joint Photographic Experts Group. Information technology — digital compression and coding of continuous-tone still images: Requirements and guidelines. Technical Report ITU-T T.81, International Telecommunication Union (ITU- T), 1992. 2, 4, 5

    1992

  16. [24]

    Progressive growing of gans for improved quality, stability, and variation

    Tero Karras, Timo Aila, Samuli Laine, and Jaakko Lehtinen. Progressive growing of gans for improved quality, stability, and variation. InInternational Conference on Learning Rep- resentations, 2018. 2

    2018

  17. [25]

    Analyzing and improving the training dynamics of diffusion models

    Tero Karras, Miika Aittala, Jaakko Lehtinen, Janne Hellsten, Timo Aila, and Samuli Laine. Analyzing and improving the training dynamics of diffusion models. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 24174–24184, 2024. 3

    2024

  18. [26]

    Understanding diffu- sion objectives as the elbo with simple data augmentation

    Diederik Kingma and Ruiqi Gao. Understanding diffu- sion objectives as the elbo with simple data augmentation. Advances in Neural Information Processing Systems, 36: 65484–65516, 2023. 7

    2023

  19. [27]

    Understanding diffu- sion objectives as the elbo with simple data augmentation

    Diederik Kingma and Ruiqi Gao. Understanding diffu- sion objectives as the elbo with simple data augmentation. Advances in Neural Information Processing Systems, 36: 65484–65516, 2023. 2, 3 7

    2023

  20. [28]

    Improved precision and recall met- ric for assessing generative models.Advances in neural in- formation processing systems, 32, 2019

    Tuomas Kynk ¨a¨anniemi, Tero Karras, Samuli Laine, Jaakko Lehtinen, and Timo Aila. Improved precision and recall met- ric for assessing generative models.Advances in neural in- formation processing systems, 32, 2019. 6

    2019

  21. [29]

    Applying guidance in a limited interval improves sample and distribution quality in diffusion models.arXiv preprint arXiv:2404.07724, 2024

    Tuomas Kynk ¨a¨anniemi, Miika Aittala, Tero Karras, Samuli Laine, Timo Aila, and Jaakko Lehtinen. Applying guidance in a limited interval improves sample and distribution quality in diffusion models.arXiv preprint arXiv:2404.07724, 2024. 7, 1

    2024

  22. [30]

    Flux.https://github.com/ black-forest-labs/flux, 2024

    Black Forest Labs. Flux.https://github.com/ black-forest-labs/flux, 2024. 1, 8

    2024

  23. [31]

    Repa-e: Unlocking vae for end-to-end tuning with latent diffusion transformers

    Xingjian Leng, Jaskirat Singh, Yunzhong Hou, Zhenchang Xing, Saining Xie, and Liang Zheng. Repa-e: Unlocking vae for end-to-end tuning with latent diffusion transformers. arXiv preprint arXiv:2504.10483, 2025. 1, 3

    2025

  24. [32]

    Back to basics: Let denoising generative models denoise, 2025

    Tianhong Li and Kaiming He. Back to basics: Let denoising generative models denoise, 2025. 2, 3, 6, 7

    2025

  25. [33]

    Fractal generative models.arXiv preprint arXiv:2502.17437, 2025

    Tianhong Li, Qinyi Sun, Lijie Fan, and Kaiming He. Fractal generative models.arXiv preprint arXiv:2502.17437, 2025. 3, 7

    2025

  26. [34]

    Exploring the effect of high-frequency components in gans training.ACM Trans

    Ziqiang Li, Pengfei Xia, Xue Rui, and Bin Li. Exploring the effect of high-frequency components in gans training.ACM Trans. Multimedia Comput. Commun. Appl., 19(5), 2023. 2

    2023

  27. [35]

    Mogao: An omni foundation model for interleaved multi-modal generation.arXiv preprint arXiv:2505.05472, 2025

    Chao Liao, Liyang Liu, Xun Wang, Zhengxiong Luo, Xinyu Zhang, Wenliang Zhao, Jie Wu, Liang Li, Zhi Tian, and Weilin Huang. Mogao: An omni foundation model for interleaved multi-modal generation.arXiv preprint arXiv:2505.05472, 2025. 1

    2025

  28. [36]

    Yaron Lipman, Ricky T. Q. Chen, Heli Ben-Hamu, Maxim- ilian Nickel, and Matthew Le. Flow matching for genera- tive modeling. InThe Eleventh International Conference on Learning Representations, 2023. 3

    2023

  29. [37]

    Decoupled weight de- cay regularization

    Ilya Loshchilov and Frank Hutter. Decoupled weight de- cay regularization. InInternational Conference on Learning Representations, 2019. 1

    2019

  30. [38]

    Latent consistency models: Synthesizing high- resolution images with few-step inference, 2024

    Simian Luo, Yiqin Tan, Longbo Huang, Jian Li, and Hang Zhao. Latent consistency models: Synthesizing high- resolution images with few-step inference, 2024. 3

    2024

  31. [39]

    Sit: Explor- ing flow and diffusion-based generative models with scalable interpolant transformers.arXiv preprint arXiv:2401.08740,

    Nanye Ma, Mark Goldstein, Michael S Albergo, Nicholas M Boffi, Eric Vanden-Eijnden, and Saining Xie. Sit: Explor- ing flow and diffusion-based generative models with scalable interpolant transformers.arXiv preprint arXiv:2401.08740,

  32. [40]

    Generating images with sparse representations

    Charlie Nash, Jacob Menick, Sander Dieleman, and Peter W Battaglia. Generating images with sparse representations. arXiv preprint arXiv:2103.03841, 2021. 6

    2021

  33. [41]

    Dinov2: Learning robust visual features without supervision

    Maxime Oquab, Timoth ´ee Darcet, Th ´eo Moutakanni, Huy V o, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193, 2023. 3

    2023 arXiv

  34. [42]

    How do vision transformers work? InInternational Conference on Learning Represen- tations, 2022

    Namuk Park and Songkuk Kim. How do vision transformers work? InInternational Conference on Learning Represen- tations, 2022. 2

    2022

  35. [43]

    Scalable diffusion models with transformers

    William Peebles and Saining Xie. Scalable diffusion models with transformers. InProceedings of the IEEE/CVF Inter- national Conference on Computer Vision, pages 4195–4205,

  36. [44]

    1, 3, 4, 5, 6, 7, 8, 9

  37. [45]

    Springer Science & Busi- ness Media, 1992

    William B Pennebaker and Joan L Mitchell.JPEG: Still im- age data compression standard. Springer Science & Busi- ness Media, 1992. 2

    1992

  38. [46]

    High-resolution image synthesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj ¨orn Ommer. High-resolution image synthesis with latent diffusion models. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10684–10695, 2022. 1, 3

    2022

  39. [47]

    U- net: Convolutional networks for biomedical image segmen- tation

    Olaf Ronneberger, Philipp Fischer, and Thomas Brox. U- net: Convolutional networks for biomedical image segmen- tation. InInternational Conference on Medical image com- puting and computer-assisted intervention, pages 234–241. Springer, 2015. 9

    2015

  40. [48]

    Improved techniques for training gans.Advances in neural information processing systems, 29, 2016

    Tim Salimans, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, and Xi Chen. Improved techniques for training gans.Advances in neural information processing systems, 29, 2016. 6

    2016

  41. [49]

    Inception transformer.Advances in Neural Information Processing Systems, 35:23495–23509,

    Chenyang Si, Weihao Yu, Pan Zhou, Yichen Zhou, Xinchao Wang, and Shuicheng Yan. Inception transformer.Advances in Neural Information Processing Systems, 35:23495–23509,

  42. [50]

    Improving the diffusability of autoen- coders

    Ivan Skorokhodov, Sharath Girish, Benran Hu, Willi Mena- pace, Yanyu Li, Rameen Abdal, Sergey Tulyakov, and Ali- aksandr Siarohin. Improving the diffusability of autoen- coders. InForty-second International Conference on Ma- chine Learning, 2025. 2

    2025

  43. [51]

    Denois- ing diffusion implicit models.arXiv:2010.02502, 2020

    Jiaming Song, Chenlin Meng, and Stefano Ermon. Denois- ing diffusion implicit models.arXiv:2010.02502, 2020. 1

    2010 arXiv

  44. [52]

    Dmm: Build- ing a versatile image generation model via distillation-based model merging.arXiv preprint arXiv:2504.12364, 2025

    Tianhui Song, Weixin Feng, Shuai Wang, Xubin Li, Tiezheng Ge, Bo Zheng, and Limin Wang. Dmm: Build- ing a versatile image generation model via distillation-based model merging.arXiv preprint arXiv:2504.12364, 2025. 3

    2025

  45. [53]

    Roformer: Enhanced transformer with rotary position embedding.Neurocomputing, 568:127063,

    Jianlin Su, Murtadha Ahmed, Yu Lu, Shengfeng Pan, Wen Bo, and Yunfeng Liu. Roformer: Enhanced transformer with rotary position embedding.Neurocomputing, 568:127063,

  46. [54]

    Relay diffusion: Unifying diffusion process across resolutions for image syn- thesis.arXiv preprint arXiv:2309.03350, 2023

    Jiayan Teng, Wendi Zheng, Ming Ding, Wenyi Hong, Jian- qiao Wangni, Zhuoyi Yang, and Jie Tang. Relay diffusion: Unifying diffusion process across resolutions for image syn- thesis.arXiv preprint arXiv:2309.03350, 2023. 2, 3, 7

    2023

  47. [55]

    Dim: Diffusion mamba for efficient high-resolution image synthesis.arXiv preprint arXiv:2405.14224, 2024

    Yao Teng, Yue Wu, Han Shi, Xuefei Ning, Guohao Dai, Yu Wang, Zhenguo Li, and Xihui Liu. Dim: Diffusion mamba for efficient high-resolution image synthesis.arXiv preprint arXiv:2405.14224, 2024. 3

    2024

  48. [56]

    Llama: Open and efficient foundation language models

    Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timoth´ee Lacroix, Baptiste Rozi`ere, Naman Goyal, Eric Hambro, Faisal Azhar, et al. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971, 2023. 1

    2023 arXiv

  49. [57]

    Llama 2: Open foundation and fine-tuned chat models.arXiv preprint arXiv:2307.09288, 2023

    Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. Llama 2: Open foundation and fine-tuned chat models.arXiv preprint arXiv:2307.09288, 2023. 1

    2023 arXiv

  50. [58]

    Jetformer: An autoregressive generative model of raw images and text.arXiv preprint arXiv:2411.19722,

    Michael Tschannen, Andr ´e Susano Pinto, and Alexander Kolesnikov. Jetformer: An autoregressive generative model of raw images and text.arXiv preprint arXiv:2411.19722,

  51. [59]

    High-frequency component helps explain the generaliza- tion of convolutional neural networks

    Haohan Wang, Xindi Wu, Zeyi Huang, and Eric P Xing. High-frequency component helps explain the generaliza- tion of convolutional neural networks. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 8684–8694, 2020. 2

    2020

  52. [60]

    Exploring dcn-like ar- chitecture for fast image generation with arbitrary resolu- tion.Advances in Neural Information Processing Systems, 37:87959–87977, 2024

    Shuai Wang, Zexian Li, Tianhui Song, Xubin Li, Tiezheng Ge, Bo Zheng, and Limin Wang. Exploring dcn-like ar- chitecture for fast image generation with arbitrary resolu- tion.Advances in Neural Information Processing Systems, 37:87959–87977, 2024. 3

    2024

  53. [61]

    Pixnerd: Pixel neural field diffusion.arXiv preprint arXiv:2507.23268, 2025

    Shuai Wang, Ziteng Gao, Chenhui Zhu, Weilin Huang, and Limin Wang. Pixnerd: Pixel neural field diffusion.arXiv preprint arXiv:2507.23268, 2025. 1, 3, 6, 7, 8

    2025

  54. [62]

    Decoupled diffusion transformer.arXiv preprint arXiv:2504.05741, 2025

    Shuai Wang, Zhi Tian, Weilin Huang, and Limin Wang. Decoupled diffusion transformer.arXiv preprint arXiv:2504.05741, 2025. 3, 6, 1

    2025

  55. [63]

    Fregan: Exploit- ing frequency components for training gans under limited data.Advances in Neural Information Processing Systems, 35:33387–33399, 2022

    Zhe Wang, Ziqiu Chi, Yanbing Zhang, et al. Fregan: Exploit- ing frequency components for training gans under limited data.Advances in Neural Information Processing Systems, 35:33387–33399, 2022. 2

    2022

  56. [64]

    Native-resolution image synthesis.arXiv preprint arXiv:2506.03131, 2025

    Zidong Wang, Lei Bai, Xiangyu Yue, Wanli Ouyang, and Yiyuan Zhang. Native-resolution image synthesis.arXiv preprint arXiv:2506.03131, 2025. 1

    2025

  57. [65]

    Omni- gen2: Exploration to advanced multimodal generation.arXiv preprint arXiv:2506.18871, 2025

    Chenyuan Wu, Pengfei Zheng, Ruiran Yan, Shitao Xiao, Xin Luo, Yueze Wang, Wanli Li, Xiyan Jiang, Yexin Liu, Jun- jie Zhou, Ze Liu, Ziyi Xia, Chaofan Li, Haoge Deng, Jia- hao Wang, Kun Luo, Bo Zhang, Defu Lian, Xinlong Wang, Zhongyuan Wang, Tiejun Huang, and Zheng Liu. Omni- ge...

    2025 arXiv

  58. [66]

    Qwen3 technical report.arXiv preprint arXiv:2505.09388, 2025

    An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, et al. Qwen3 technical report.arXiv preprint arXiv:2505.09388, 2025. 8, 1

    2025 arXiv

  59. [67]

    Reconstruction vs

    Jingfeng Yao and Xinggang Wang. Reconstruction vs. gener- ation: Taming optimization dilemma in latent diffusion mod- els.arXiv preprint arXiv:2501.01423, 2025. 1, 3

    2025

  60. [68]

    Representation alignment for generation: Training diffu- sion transformers is easier than you think.arXiv preprint arXiv:2410.06940, 2024

    Sihyun Yu, Sangkyung Kwak, Huiwon Jang, Jongheon Jeong, Jonathan Huang, Jinwoo Shin, and Saining Xie. Representation alignment for generation: Training diffu- sion transformers is easier than you think.arXiv preprint arXiv:2410.06940, 2024. 3, 4, 6, 7, 1, 2

    2024 arXiv

  61. [69]

    Diffu- sion models need visual priors for image generation.arXiv preprint arXiv:2410.08531, 2024

    Xiaoyu Yue, Zidong Wang, Zeyu Lu, Shuyang Sun, Meng Wei, Wanli Ouyang, Lei Bai, and Luping Zhou. Diffu- sion models need visual priors for image generation.arXiv preprint arXiv:2410.08531, 2024. 3

    2024

  62. [70]

    Normalizing flows are capable generative models.arXiv preprint arXiv:2412.06329, 2024

    Shuangfei Zhai, Ruixiang Zhang, Preetum Nakkiran, David Berthelot, Jiatao Gu, Huangjie Zheng, Tianrong Chen, Miguel Angel Bautista, Navdeep Jaitly, and Josh Susskind. Normalizing flows are capable generative models.arXiv preprint arXiv:2412.06329, 2024. 3

    2024

  63. [71]

    Score identity distillation: Exponentially fast distillation of pretrained diffusion models for one-step generation

    Mingyuan Zhou, Huangjie Zheng, Zhendong Wang, Mingzhang Yin, and Hai Huang. Score identity distillation: Exponentially fast distillation of pretrained diffusion models for one-step generation. InForty-first International Confer- ence on Machine Learning, 2024. 3, 7 9

    2024

Pith tools

Reviewed May 17, 2026 · model on record in the stance chip above.