Pith. sign in

REVIEW 2 major objections 2 minor 303 cited by

High-Resolution Image Synthesis with Latent Diffusion Models

T0 review · 2 major / 2 minor · reviewed 2026-05-11 · grok-4.3

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Diffusion models trained in the latent space of pretrained autoencoders generate high-resolution images with substantially lower computational cost than pixel-space versions.

desk verdict LDMs move diffusion into pretrained VAE latents plus cross-attention conditioning, delivering competitive quality at far lower compute than pixel-space models. read the letter →

arxiv 2112.10752 v2 pith:XFBNG3P6 submitted 2021-12-20 cs.CV

Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer This is my paper · ORCID
classification cs.CV
keywords latentdiffusionmodelsimagesynthesisdenoisingautoencodersconditionalgenerationinpaintingsuper-resolutioncross-attention
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper establishes that diffusion models can be moved from raw pixel space into the compressed latent space of a fixed pretrained autoencoder. This shift preserves enough visual structure for high-fidelity synthesis while cutting the cost of training and sampling dramatically. Readers care because the same denoising process now supports conditioning via cross-attention layers, turning the model into a flexible generator for text, boxes, or masks without retraining. The result is practical high-resolution synthesis on ordinary hardware and new performance levels on inpainting.

What carries the argument

The latent diffusion model (LDM), which runs the forward and reverse diffusion processes on the lower-dimensional latent codes produced by a fixed variational autoencoder and uses cross-attention to incorporate conditioning signals such as text or spatial layouts.

What would settle it

High-resolution outputs that consistently exhibit uncorrectable artifacts or visible loss of fine detail relative to pixel-based diffusion models of comparable training effort would show the assumption does not hold.

Watch

Extended reading notes

Core claim

By applying the diffusion process to the latent representations of a pretrained autoencoder rather than to pixels, and by inserting cross-attention layers to accept arbitrary conditioning inputs, latent diffusion models reach a favorable trade-off between model capacity and perceptual fidelity while requiring far fewer resources than pixel-based diffusion models.

Load-bearing premise

The latent codes from the pretrained autoencoder already contain enough perceptual detail and spatial structure that the diffusion model can recover high-fidelity images without uncorrectable artifacts.

Editorial extensions

If this is right

  • Training and inference of powerful diffusion models become feasible on limited hardware while retaining visual quality.
  • High-resolution synthesis is performed directly in a convolutional manner without patch-wise processing.
  • Image inpainting reaches state-of-the-art results.
  • Unconditional generation, semantic scene synthesis, and super-resolution remain competitive with prior pixel-space methods.
  • Conditioning on text, bounding boxes, or other inputs is enabled without retraining the core model.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The separation of perceptual compression from the generative diffusion stage suggests similar latent-space training could be tested on other modalities once suitable autoencoders exist.
  • If the autoencoder is kept fixed, future improvements in autoencoder quality would immediately lift the upper bound on LDM fidelity without changing the diffusion architecture.
  • The approach implies that many existing pixel-based diffusion pipelines could be accelerated by first training a domain-specific autoencoder rather than scaling the diffusion model itself.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

2 major / 2 minor

Summary. The paper claims that applying diffusion models in the latent space of pretrained autoencoders enables efficient high-resolution image synthesis. Latent diffusion models (LDMs) reduce spatial dimensions via a KL-regularized VAE (with downsampling factors f=4/8/16) while preserving detail, incorporate cross-attention for conditioning on text or bounding boxes, and achieve new state-of-the-art inpainting results along with competitive performance on unconditional generation, semantic synthesis, and super-resolution, all at substantially lower computational cost than pixel-space DMs. Public code is released.

Significance. If the results hold, this has high significance for making diffusion-based synthesis practical at high resolutions with limited resources. Strengths include the public code release, direct ablations on autoencoder factors, and quantitative FID/LPIPS tables on ImageNet, Places2, and ADE20K that support the efficiency and quality claims. The stress-test concern on latent representation fidelity does not land as a load-bearing issue, since the f=8 model empirically recovers high-frequency detail without uncorrectable artifacts and matches or exceeds pixel DM quality.

major comments (2)
  1. [Ablations on autoencoder downsampling factors] Ablations on autoencoder downsampling factors: the claim of reaching a 'near-optimal point' between complexity reduction and detail preservation for f=8 rests on FID comparisons, but the exact spatial cost reduction (stated as ~1/64) should be derived explicitly from the UNet channel dimensions and latent resolution to allow verification of the efficiency gain.
  2. [Cross-attention layers] Cross-attention for conditioning: while cross-attention enables flexible conditioning, the manuscript does not include an ablation against simpler conditioning mechanisms (e.g., concatenation or FiLM), which would isolate whether this architecture choice is necessary for the flexibility and high-resolution claims.
minor comments (2)
  1. [Abstract] The abstract's reference to 'hundreds of GPU days' for pixel-space DM optimization would be strengthened by citing the specific prior works being compared.
  2. [Methods] Notation for the latent variable z and the diffusion forward/reverse processes in latent space could be clarified with an explicit equation reference or diagram early in the methods section.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the positive assessment, the recommendation of minor revision, and the constructive comments on our efficiency claims and conditioning design. We address each major comment below and have incorporated revisions to improve clarity.

read point-by-point responses

  1. Referee: Ablations on autoencoder downsampling factors: the claim of reaching a 'near-optimal point' between complexity reduction and detail preservation for f=8 rests on FID comparisons, but the exact spatial cost reduction (stated as ~1/64) should be derived explicitly from the UNet channel dimensions and latent resolution to allow verification of the efficiency gain.

    Authors: We agree that an explicit derivation would strengthen the presentation. The ~1/64 factor follows directly from reducing the spatial resolution of the UNet input by f=8 in each dimension (latent size H/8 × W/8), which quadratically reduces the number of spatial operations. Accounting for the UNet channel schedule (starting at 320 channels with doubling in down-blocks), the overall computational cost of the diffusion process scales by this factor relative to pixel-space models. In the revised manuscript we will add a short derivation in Section 3.1 (or an appendix table) that computes the reduction from the exact latent resolution and channel dimensions, enabling straightforward verification. revision: yes

  2. Referee: Cross-attention for conditioning: while cross-attention enables flexible conditioning, the manuscript does not include an ablation against simpler conditioning mechanisms (e.g., concatenation or FiLM), which would isolate whether this architecture choice is necessary for the flexibility and high-resolution claims.

    Authors: We appreciate the suggestion. Cross-attention is chosen because it supports conditioning inputs of arbitrary length and structure (e.g., variable-length text token sequences or unordered sets of bounding-box embeddings) without requiring fixed-dimensional inputs, which concatenation or FiLM layers would necessitate. This flexibility is central to the high-resolution text-to-image and layout-to-image results. A full retraining ablation is outside the scope of a minor revision, but we will add a concise discussion paragraph in Section 3.2 explaining the architectural rationale and contrasting it with simpler alternatives, thereby addressing the concern without misrepresenting the design. revision: partial

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity in the derivation chain

full rationale

The paper proposes applying diffusion models in the latent space of a separately pretrained autoencoder, with the central claims of state-of-the-art inpainting and competitive performance on generation tasks supported by direct empirical ablations (e.g., downsampling factors f=4/8/16) and quantitative comparisons to pixel-space baselines on ImageNet, Places2, and ADE20K. No load-bearing step reduces a result or prediction to its own inputs by construction, fitted parameters renamed as outputs, or a self-citation chain; the autoencoder training and latent diffusion training are independent stages, and all performance assertions rest on measured metrics rather than theoretical closure.

Assumptions & free parameters 0 free parameters · 1 assumptions · 0 invented entities

The central claim rests on the domain assumption that a pretrained autoencoder can compress images into a latent space that retains sufficient detail for diffusion-based generation; no free parameters are introduced in the abstract description, and no new entities are postulated.

assumptions (1)
  • domain assumption Pretrained autoencoders produce latent representations that preserve perceptual details necessary for high-fidelity image synthesis.
    Invoked to justify operating diffusion in latent space rather than pixels.

how reviews work

0 comments
Cite this review

Pith. "Pith review of High-Resolution Image Synthesis with Latent Diffusion Models." pith.science (2026). https://pith.science/paper/XFBNG3P6

@misc{pith2026211210752,
  author       = {Pith},
  title        = {Pith review of: High-Resolution Image Synthesis with Latent Diffusion Models},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/XFBNG3P6}},
  note         = {Machine review of arXiv:2112.10752}
}
read the original abstract

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a guiding mechanism to control the image generation process without retraining. However, since these models typically operate directly in pixel space, optimization of powerful DMs often consumes hundreds of GPU days and inference is expensive due to sequential evaluations. To enable DM training on limited computational resources while retaining their quality and flexibility, we apply them in the latent space of powerful pretrained autoencoders. In contrast to previous work, training diffusion models on such a representation allows for the first time to reach a near-optimal point between complexity reduction and detail preservation, greatly boosting visual fidelity. By introducing cross-attention layers into the model architecture, we turn diffusion models into powerful and flexible generators for general conditioning inputs such as text or bounding boxes and high-resolution synthesis becomes possible in a convolutional manner. Our latent diffusion models (LDMs) achieve a new state of the art for image inpainting and highly competitive performance on various tasks, including unconditional image generation, semantic scene synthesis, and super-resolution, while significantly reducing computational requirements compared to pixel-based DMs. Code is available at https://github.com/CompVis/latent-diffusion .

Discussion (0). Continue with ORCID to comment.

Forward citations

Showing 60 of 303 Pith papers that cite this

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. OpenAlex reports about 717 citations worldwide. See all 303 Pith citations

  1. Autoregressive Learning in Joint KL: Sharp Oracle Bounds and Lower Bounds

    cs.LG 2026-05 unverdicted novelty 8.0 of 10

    Joint KL yields horizon-free approximation but an information-theoretic lower bound of order Omega(H) for estimation error in autoregressive learning, with matching computationally efficient upper bounds.

  2. What Time Is It? How Data Geometry Makes Time Conditioning Optional for Flow Matching

    cs.LG 2026-05 unverdicted novelty 8.0 of 10

    Data geometry makes time identifiable from noisy interpolants at rate O(1/sqrt(d-k)), rendering the time-blindness gap asymptotically negligible relative to coupling variance.

  3. How to Guide Your Flow: Few-Step Alignment via Flow Map Reward Guidance

    cs.LG 2026-04 unverdicted novelty 8.0 of 10

    FMRG reformulates guidance as deterministic optimal control, deriving a single-trajectory method using the flow map that matches or exceeds baselines on reward-guided generation and inverse problems with 3 NFEs at tex...

  4. Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution

    cs.CL 2023-09 unverdicted novelty 8.0 of 10

    Promptbreeder evolves both task prompts and the mutation prompts that improve them using LLMs, outperforming Chain-of-Thought and Plan-and-Solve on arithmetic and commonsense reasoning benchmarks.

  5. The Score Hamiltonian: Mapping Diffusion Models to Adiabatic Transport

    math-ph 2026-05 unverdicted novelty 7.5 of 10

    Score-based diffusion sampling is shown to be adiabatic ground-state transport for a Score Hamiltonian, with error floor equal to terminal score-matching error over the square root of the spectral gap.

  6. SI-Edit: Toward Sketch-Instruction Guided Local Image Editing with Pixel-Level Precision

    cs.CV 2026-08 conditional novelty 7.0 of 10

    A new dataset and method let local image edits be guided by both a sketch and a text instruction, improving geometric and semantic control over sketch-only or text-only baselines.

  7. From Bit-Position Sensitivity to Unequal Error Protection for DNN Inference Memory

    cs.AR 2026-07 conditional novelty 7.0 of 10

    Per-bit fault injection on 16 DNNs yields safe-unprotected-bit floors (FP16:6, BF16:4, FP32:15) that power a selective-ECC codec with ~27.8% less ECC area and ~17% lower BF16 read energy.

  8. Tailor Made Embeddings for Quantum Machine Learning

    quant-ph 2026-06 unverdicted novelty 7.0 of 10

    A variational autoencoder learns quantum embeddings compressing ImageNet into 13 qubits and achieving 98.5% accuracy on MNIST 3-vs-5 classification with a quantum circuit, close to classical baselines and far above na...

  9. Ambient Diffusion Policy: Imitation Learning from Suboptimal Data in Robotics

    cs.RO 2026-06 unverdicted novelty 7.0 of 10

    Ambient Diffusion Policy enables better imitation learning from suboptimal robot data by leveraging spectral properties to restrict data usage to specific diffusion times.

  10. DRIFT: From Robustness Gaps to Invariance Manifolds for AI-Generated Image Detection

    cs.CV 2026-06 unverdicted novelty 7.0 of 10

    DRIFT learns a structured invariance manifold from real images via one-class supervision on decomposed robust and fragile subspaces of a frozen VFM to detect AI-generated images through margin violations.

  11. How Neural Losses Shape VAE Latents

    cs.LG 2026-05 unverdicted novelty 7.0 of 10

    Neural reconstruction losses in VAEs reduce latent information content and produce more isotropic latent geometries with even uncertainty distribution.

  12. Domain-Gated Latent Diffusion: Generative Inverse Design of HMX-Class Energetic Materials with First-Principles Validation

    physics.chem-ph 2026-05 unverdicted novelty 7.0 of 10

    DGLD applies domain-gated latent diffusion with label-quality gating and multi-task guidance to discover 12 novel energetic material leads validated by DFT, outperforming SMILES-LSTM, SELFIES-GA, and REINVENT baseline...

  13. Constrained Code Generation with Discrete Diffusion

    cs.CL 2026-05 unverdicted novelty 7.0 of 10

    Constrained Diffusion for Code (CDC) integrates constraint satisfaction into the reverse denoising process of discrete diffusion models via constraint-aware operators that use optimization and program analysis to stee...

  14. Seeking the Unfamiliar but Memorable: Conceptual Creativity as Meta-Learning

    cs.LG 2026-05 unverdicted novelty 7.0 of 10

    Creativity is defined as meta-learning where a frozen diffusion creator optimizes candidates for rapid improvement by an adapting appraiser such as an autoencoder or CLIP adapter.

  15. CreFlow: Corrective Reflow for Sparse-Reward Embodied Video Diffusion RL

    cs.CV 2026-05 conditional novelty 7.0 of 10

    CreFlow combines LTL compositional rewards with credit-aware NFT and corrective reflow losses in online RL to improve embodied video diffusion models, raising downstream task success by 23.8 percentage points on eight...

  16. AuraMask: An Extensible Pipeline for Developing Aesthetic Anti-Facial Recognition Image Filters

    cs.CV 2026-05 conditional novelty 7.0 of 10

    AuraMask produces 40 aesthetic anti-facial recognition filters that match or exceed prior adversarial effectiveness and achieve significantly higher user acceptance in a 630-person study.

  17. AIMIP Phase 1: systematic evaluations of AI weather and climate models

    physics.ao-ph 2026-05 unverdicted novelty 7.0 of 10

    Under one protocol, most AI climate models reproduce historical climatology and ENSO response as well as a CMIP6 model, but some underestimate warming trends and all diverge on +2/+4K SST experiments.

  18. Deep Dreams Are Made of This: Visualizing Monosemantic Features in Diffusion Models

    cs.LG 2026-05 unverdicted novelty 7.0 of 10

    LVO applies optimization-based feature visualization to latent diffusion models after disentangling their representations with sparse autoencoders, yielding recognizable concept images on a fine-tuned Stable Diffusion...

  19. Flow of Truth: Proactive Temporal Forensics for Image-to-Video Generation

    cs.CV 2026-04 unverdicted novelty 7.0 of 10

    Flow of Truth is the first proactive temporal forensics framework for image-to-video generation that uses a learnable forensic template following pixel motion and a template-guided flow module to decouple motion from content.

  20. Beyond Prompts: Unconditional 3D Inversion for Out-of-Distribution Shapes

    cs.CV 2026-04 unverdicted novelty 7.0 of 10

    Text-to-3D models lose prompt sensitivity for out-of-distribution shapes due to sink traps but retain geometric diversity via unconditional priors, enabling a decoupled inversion method for robust editing.

  21. VASR: Variance-Aware Systematic Resampling for Reward-Guided Diffusion

    cs.AI 2026-04 unverdicted novelty 7.0 of 10

    VASR separates continuation and residual variance in reward-guided diffusion SMC, using optimal mass allocation and systematic resampling to achieve up to 26% better FID scores and faster runtimes than prior SMC and M...

  22. Setting-Matched and Semantics-Scaled Benchmarking of One-Step Generative Models Against Multistep Diffusion and Flow Models

    cs.CV 2026-03 unverdicted novelty 7.0 of 10

    Matched benchmarking reveals FID misleads in few-step regimes under CFG, prompting CLIP-scaled and PickScore-scaled FID and IS variants for better semantic evaluation of one-step image generators.

  23. Latent Generative Solvers for Generalizable Long-Term Physics Simulation

    cs.AI 2026-02 unverdicted novelty 7.0 of 10

    LGS pretrained on 2.5M trajectories across 16 systems matches deterministic baselines at one step and halves 20-step error while using far less compute and adapting to held-out higher-resolution flows.

  24. Not All Denoising Steps Are Equal: Model Scheduling for Faster Masked Diffusion Language Models

    cs.LG 2026-02 unverdicted novelty 7.0 of 10

    Early and late denoising steps in masked diffusion LMs are robust to smaller-model replacement, enabling 17% FLOPs reduction with modest generative quality loss.

  25. Visual Diffusion Models are Geometric Solvers

    cs.CV 2025-10 unverdicted novelty 7.0 of 10

    Standard visual diffusion models operating in pixel space can approximate solutions to the inscribed square, Steiner tree, and simple polygon problems.

  26. Flow Matching Policy Gradients

    cs.LG 2025-07 conditional novelty 7.0 of 10

    FPO trains flow-based policies with PPO by replacing the likelihood ratio with an exponentiated flow matching loss difference.

  27. DiffCkt: A Diffusion Model-Based Hybrid Neural Network Framework for Automatic Transistor-Level Generation of Analog Circuits

    cs.ET 2025-07 conditional novelty 7.0 of 10

    DiffCkt uses three diffusion networks to predict amplifier component counts, topology, and transistor sizes from performance specifications, and reports 2.21x to 8365x higher generation efficiency than prior analog EDA tools.

  28. AR-RAG: Autoregressive Retrieval Augmentation for Image Generation

    cs.CV 2025-06 conditional novelty 7.0 of 10

    Autoregressive patch-level retrieval augmentation improves text-to-image generation on GenEval, DPG-Bench, and Midjourney-30K, with a training-free decoding variant and a fine-tuned variant.

  29. NSD-Imagery: A benchmark dataset for extending fMRI vision decoding methods to mental imagery

    cs.CV 2025-06 conditional novelty 7.0 of 10

    NSD-Imagery is a released benchmark of fMRI responses to imagined pictures from Natural Scenes Dataset participants, and benchmarks of five decoders show mental imagery performance is largely decoupled from seen-image...

  30. D-Fusion: Direct Preference Optimization for Aligning Diffusion Models with Visually Consistent Samples

    cs.CV 2025-05 conditional novelty 7.0 of 10

    Mask-guided self-attention fusion creates well-aligned target images that stay visually close to poorly-aligned base images, with full denoising trajectories, and DPO on these pairs improves alignment.

  31. ConceptAttention: Diffusion Transformers Learn Highly Interpretable Features

    cs.CV 2025-02 conditional novelty 7.0 of 10

    ConceptAttention shows that linear projections in the output space of DiT attention layers yield sharper concept-localizing saliency maps than cross-attention maps, reaching state-of-the-art zero-shot segmentation.

  32. Large Concept Models: Language Modeling in a Sentence Representation Space

    cs.CL 2024-12 conditional novelty 7.0 of 10

    A sentence-level language model trained to autoregressively predict SONAR sentence embeddings can summarize, expand, and generate text in unseen languages.

  33. FlashAttention on a Napkin: A Diagrammatic Approach to Deep Learning IO-Awareness

    cs.LG 2024-12 conditional novelty 7.0 of 10

    A diagrammatic framework for deriving IO-aware GPU algorithms and performance models, applied to matrix multiplication and FlashAttention-style attention.

  34. VIPaint: Image Inpainting with Pre-Trained Diffusion Models via Variational Inference

    cs.CV 2024-11 unverdicted novelty 7.0 of 10

    VIPaint uses hierarchical variational inference to optimize a non-Gaussian Markov approximation of the diffusion posterior, enabling better inpainting and inverse problems with pre-trained and latent diffusion models.

  35. LAION-5B: An open large-scale dataset for training next generation image-text models

    cs.CV 2022-10 accept novelty 7.0 of 10

    LAION-5B is an openly released dataset of 5.85 billion CLIP-filtered image-text pairs that enables replication of foundational vision-language models.

  36. A Decomposable Probe for Few-Step Diffusion Models: Prompt, Latent, and Score Selectivity across Backbone Families and Distillation Paradigms

    cs.CV 2026-07 conditional novelty 6.5 of 10

    A three-layer perturbation probe shows latent selectivity is a near-binary rectified-flow fingerprint that survives ADD distillation, while score selectivity tracks distillation objective across 23 T2I models.

  37. Sample-Adaptive Latent Rewards for Uncertainty-Guided Diffusion Post-Training

    cs.CV 2026-08 conditional novelty 6.0 of 10

    SURE learns sample-adaptive variance in a latent reward model and uses that variance to weight dense post-training feedback, improving image and video diffusion alignment in reported experiments.

  38. Simile Understanding in Text-to-Image Models: An Evaluation Framework

    cs.CV 2026-08 conditional novelty 6.0 of 10

    A YOLO-based evaluation framework shows that text-to-image models consistently render the literal vehicle of a simile, a failure that CLIPScore and PickScore miss.

  39. MDTD-ArtIR: Benchmarking Image Editing and Restoration Models for Art Image Restoration under Texture-Overlay Degradations

    cs.CV 2026-08 conditional novelty 6.0 of 10

    A new benchmark (MDTD-Art) shows image editing models generally beat dedicated restoration models on art images degraded by textured semi-transparent overlays.

  40. FairDiffuseVQVAE: Sampling-Time Fairness in Tabular Diffusion via Conditional Refinement of Vector-Quantized Latents

    cs.LG 2026-07 conditional novelty 6.0 of 10

    FairDiffuseVQVAE reaches state-of-the-art fairness on the standard tabular benchmark (DPR 0.702, EOR 0.686) by uniform protected-attribute sampling at inference, paying ~15 AUC points of utility.

  41. Parallel Decoding Distillation for Fast Image and Video Generation

    cs.CV 2026-07 conditional novelty 6.0 of 10

    A trajectory-based distillation method trains a student to predict multiple mean velocities per network evaluation, enabling 4-8 step generation with competitive quality and improved diversity.

  42. GeoStereo: A Unified Stereo Geometry Estimation Framework for Disparity and Surface Normal

    cs.CV 2026-07 conditional novelty 6.0 of 10

    A unified stereo framework couples feed-forward disparity matching with a diffusion-based normal estimator through disparity-to-normal initialization and warped right-view conditioning, claiming zero-shot SOTA on seve...

  43. Learning Sampling Parameters for Diffusion Models

    cs.LG 2026-07 conditional novelty 6.0 of 10

    An LLM policy trained with GRPO can emit prompt-conditioned, timestep-varying diffusion sampling parameters that beat fixed defaults and prior LLM schedulers on preference metrics.

  44. MedDiT4SR: Tri-Stream Joint Adaptation of Pre-Trained Diffusion Transformers for Medical Image Super-Resolution

    eess.IV 2026-07 conditional novelty 6.0 of 10

    A tri-stream joint-attention adaptation of SD3 diffusion transformers with local and semantic adapters improves medical image super-resolution across five modalities.

  45. From Dark Matter to Galaxies: Halo-Free Mock Generation via Conditional Point-Cloud Diffusion

    astro-ph.GA 2026-07 conditional novelty 6.0 of 10

    A conditional point-cloud diffusion model trained on IllustrisTNG generates galaxy mocks with SFR and stellar mass directly from dark-matter density fields, bypassing halo identification.

  46. ROMS-IMLE: A Minimalist Approach to Competitive Single-Step Generative Modelling

    cs.LG 2026-07 conditional novelty 6.0 of 10

    A single-step IMLE generator with per-stage supervision and a robust loss reports FID 2.56 on ImageNet-256 by filtering ~5% of samples at test time.

  47. MultiAnimate: A Unified Framework for Controllable Multi-Character Animation

    cs.CV 2026-07 conditional novelty 6.0 of 10

    A diffusion-based framework that animates multiple characters in one scene from separate reference images and pose sequences while preserving each character's identity.

  48. FlashDiff: Efficient Regional Execution and Scheduling for Diffusion Model Serving

    cs.DC 2026-07 conditional novelty 6.0 of 10

    FlashDiff reduces diffusion serving latency by 30–97% and raises throughput 1.2–2.2× by adaptively skipping refinement of latent regions that no longer need it.

  49. Analysis-by-Proxy: Localization Signals in VLMs Operating as Condition Encoders

    cs.CV 2026-07 conditional novelty 6.0 of 10

    A lightweight Q-Former proxy trained on VLM hidden states reveals that localization signals peak in input-dependent intermediate layers, not the final layers used by standard editing pipelines.

  50. AI Native Games: A Survey and Roadmap

    cs.AI 2026-07 unverdicted novelty 6.0 of 10

    The paper proposes a counterfactual definition of AI-native games, screens 53 examples, introduces a G/N taxonomy, and outlines a research roadmap for the field.

  51. The Illusion of High Utility in Safety Alignment of Text-to-Image Diffusion Models

    cs.CV 2026-07 unverdicted novelty 6.0 of 10

    Safety-aligned T2I diffusion models exhibit semantic collapse in text embeddings causing TIFA drops; SAGE regularization restores structured utility while retaining safety.

  52. Chronos: A Physics-Informed Full-History Framework for Non-Markovian Long-Horizon Manipulation

    cs.RO 2026-06 unverdicted novelty 6.0 of 10

    Chronos elevates full observation history to the policy's latent state via selective SSM tokens and a Schrödinger-inspired acceleration bridge, achieving large gains on memory-dependent robot tasks with fewer parameters.

  53. SpatialFlow-GRPO: Where Spatial Credit Drives Image Editing

    cs.CV 2026-06 unverdicted novelty 6.0 of 10

    SpatialFlow-GRPO improves image editing quality by converting region-aware rewards into semantic-region-level optimization signals aligned with latent positions during policy updates.

  54. Adversarial Diffusion Across Modalities: A Fusion Survey of Attacks, Defenses, and Evaluation for Text, Vision, and Vision-Language Models

    cs.CR 2026-06 unverdicted novelty 6.0 of 10

    A narrative survey that catalogs fifty papers on diffusion-based adversarial techniques across text, vision, and vision-language models, proposes a six-class taxonomy of diffusion roles plus a unified five-dimension e...

  55. One-Step Flow Matching for Generative Modeling of Path-Dependent Physical Fields

    cs.LG 2026-06 unverdicted novelty 6.0 of 10

    A one-step flow matching model using transformer in VAE latent space with non-Gaussian source and auxiliary networks generates accurate high-resolution path-dependent stress fields, achieving 6-7x CPU and ~100x GPU sp...

  56. Lighting-Consistent Object Transfer Across Radiance Fields

    cs.GR 2026-06 unverdicted novelty 6.0 of 10

    Diffusion-based per-view harmonization for lighting-consistent object transfer between 3DGS scenes, using heterogeneous training data and final 3D consolidation.

  57. UNITY: Attention Flow Networks for Adaptive Conditioning in Diffusion

    cs.CV 2026-06 unverdicted novelty 6.0 of 10

    UNITY is a two-stage adapter with Morphable Attention Flow networks for efficient single and composite conditioning in diffusion-based image generation.

  58. Training and Evaluating Diffusion Policies with Long Context Lengths

    cs.RO 2026-06 conditional novelty 6.0 of 10

    Naive long-context Diffusion Policies succeed with UNet+Cross-Attention and sufficient data; variable-history training cuts sample complexity in the low-data regime.

  59. Modality Forcing for Scalable Spatial Generation

    cs.CV 2026-06 unverdicted novelty 6.0 of 10

    Modality Forcing lets a single DiT produce image and depth outputs in any order after training on sparse real-world depth, with larger image-pretrained models yielding better depth accuracy and a 57% AbsRel reduction ...

  60. IDEAL: In-DEpth ALignment Makes A Discrete Representation AutoEncoder

    cs.CV 2026-06 unverdicted novelty 6.0 of 10

    IDEAL improves discrete representation autoencoders by jointly aligning quantized tokens with shallow and deep VFM features, reporting 0.61 rFID on ImageNet and 1.89 gFID for autoregressive image generation.

See all 303 Pith citations

Reference graph

Works this paper leans on

109 extracted references · 109 canonical work pages · cited by 303 Pith papers (see all)

  1. [1]

    NTIRE 2017 chal- lenge on single image super-resolution: Dataset and study

    Eirikur Agustsson and Radu Timofte. NTIRE 2017 chal- lenge on single image super-resolution: Dataset and study. In 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2017, Honolulu, HI, USA, July 21-26, 2017, pages 1122–1131. IEEE Com- puter Society, 2017. 1

    work page 2017

  2. [2]

    Wasserstein gan, 2017

    Martin Arjovsky, Soumith Chintala, and L ´eon Bottou. Wasserstein gan, 2017. 3

    work page 2017

  3. [3]

    Large scale GAN training for high fidelity natural image synthe- sis

    Andrew Brock, Jeff Donahue, and Karen Simonyan. Large scale GAN training for high fidelity natural image synthe- sis. In Int. Conf. Learn. Represent. , 2019. 1, 2, 7, 8, 22, 28

    work page 2019

  4. [4]

    Holger Caesar, Jasper R. R. Uijlings, and Vittorio Ferrari. Coco-stuff: Thing and stuff classes in context. In 2018 IEEE Conference on Computer Vision and Pattern Recog- nition, CVPR 2018, Salt Lake City, UT, USA, June 18- 22, 2018, pages 1209–1218. Computer Vision Foundation / IEEE Computer Society, 2018. 7, 20, 22

    work page 2018

  5. [5]

    Extracting training data from large language models

    Nicholas Carlini, Florian Tramer, Eric Wallace, Matthew Jagielski, Ariel Herbert-V oss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, Ulfar Erlingsson, et al. Extracting training data from large language models. In 30th USENIX Security Symposium (USENIX Security 21) , pages 2633–2650, 2021. 9

    work page 2021

  6. [6]

    Generative pre- training from pixels

    Mark Chen, Alec Radford, Rewon Child, Jeffrey Wu, Hee- woo Jun, David Luan, and Ilya Sutskever. Generative pre- training from pixels. In ICML, volume 119 of Proceedings of Machine Learning Research, pages 1691–1703. PMLR,

    work page

  7. [7]

    Weiss, Mo- hammad Norouzi, and William Chan

    Nanxin Chen, Yu Zhang, Heiga Zen, Ron J. Weiss, Mo- hammad Norouzi, and William Chan. Wavegrad: Estimat- ing gradients for waveform generation. In ICLR. OpenRe- view.net, 2021. 1

    work page 2021

  8. [8]

    Fast fourier convolu- tion

    Lu Chi, Borui Jiang, and Yadong Mu. Fast fourier convolu- tion. In NeurIPS, 2020. 8

    work page 2020

Show all 109 references
  1. [9]

    Very deep vaes generalize autoregressive models and can outperform them on images

    Rewon Child. Very deep vaes generalize autoregressive models and can outperform them on images. CoRR, abs/2011.10650, 2020. 3

    2011

  2. [10]

    Generating long sequences with sparse transformers

    Rewon Child, Scott Gray, Alec Radford, and Ilya Sutskever. Generating long sequences with sparse transformers. CoRR, abs/1904.10509, 2019. 3

    1904 arXiv

  3. [11]

    Bin Dai and David P. Wipf. Diagnosing and enhancing V AE models. In ICLR (Poster). OpenReview.net, 2019. 2, 3

    2019

  4. [12]

    Imagenet: A large-scale hierarchical im- age database

    Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Fei-Fei Li. Imagenet: A large-scale hierarchical im- age database. In CVPR, pages 248–255. IEEE Computer Society, 2009. 1, 5, 7, 22

    2009

  5. [13]

    Ethical considerations of generative ai

    Emily Denton. Ethical considerations of generative ai. AI for Content Creation Workshop, CVPR, 2021. 9

    2021

  6. [14]

    BERT: pre-training of deep bidirec- tional transformers for language understanding

    Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. BERT: pre-training of deep bidirec- tional transformers for language understanding. CoRR, abs/1810.04805, 2018. 7

    2018 arXiv

  7. [15]

    Diffusion models beat gans on image synthesis

    Prafulla Dhariwal and Alex Nichol. Diffusion models beat gans on image synthesis. CoRR, abs/2105.05233, 2021. 1, 2, 3, 4, 6, 7, 8, 18, 22, 25, 26, 28

    2021

  8. [16]

    Musings on typicality, 2020

    Sander Dieleman. Musings on typicality, 2020. 1, 3

    2020

  9. [17]

    Cogview: Mastering text-to- image generation via transformers

    Ming Ding, Zhuoyi Yang, Wenyi Hong, Wendi Zheng, Chang Zhou, Da Yin, Junyang Lin, Xu Zou, Zhou Shao, Hongxia Yang, and Jie Tang. Cogview: Mastering text-to- image generation via transformers. CoRR, abs/2105.13290,

  10. [18]

    Nice: Non-linear independent components estimation, 2015

    Laurent Dinh, David Krueger, and Yoshua Bengio. Nice: Non-linear independent components estimation, 2015. 3

    2015

  11. [19]

    Density estimation using real NVP

    Laurent Dinh, Jascha Sohl-Dickstein, and Samy Ben- gio. Density estimation using real NVP. In 5th Inter- national Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. OpenReview.net, 2017. 1, 3

    2017

  12. [20]

    Generating images with perceptual similarity metrics based on deep networks

    Alexey Dosovitskiy and Thomas Brox. Generating images with perceptual similarity metrics based on deep networks. In Daniel D. Lee, Masashi Sugiyama, Ulrike von Luxburg, Isabelle Guyon, and Roman Garnett, editors, Adv. Neural Inform. Process. Syst., pages 658–666, 2016. 3

    2016

  13. [21]

    Imagebart: Bidirectional context with multi- nomial diffusion for autoregressive image synthesis.CoRR, abs/2108.08827, 2021

    Patrick Esser, Robin Rombach, Andreas Blattmann, and Bj¨orn Ommer. Imagebart: Bidirectional context with multi- nomial diffusion for autoregressive image synthesis.CoRR, abs/2108.08827, 2021. 6, 7, 22

    2021

  14. [22]

    A note on data biases in generative models

    Patrick Esser, Robin Rombach, and Bj ¨orn Ommer. A note on data biases in generative models. arXiv preprint arXiv:2012.02516, 2020. 9

    2012

  15. [23]

    Taming transformers for high-resolution image synthesis

    Patrick Esser, Robin Rombach, and Bj ¨orn Ommer. Taming transformers for high-resolution image synthesis. CoRR, abs/2012.09841, 2020. 2, 3, 4, 6, 7, 21, 22, 29, 34, 36

    2012

  16. [24]

    Sex, lies, and videotape: Deep fakes and free speech delusions

    Mary Anne Franks and Ari Ezra Waldman. Sex, lies, and videotape: Deep fakes and free speech delusions. Md. L. Rev., 78:892, 2018. 9

    2018

  17. [25]

    Soros, and Olaf Witkowski

    Kevin Frans, Lisa B. Soros, and Olaf Witkowski. Clipdraw: Exploring text-to-drawing synthesis through language- image encoders. ArXiv, abs/2106.14843, 2021. 3

    2021

  18. [26]

    Make-a-scene: Scene- based text-to-image generation with human priors

    Oran Gafni, Adam Polyak, Oron Ashual, Shelly Sheynin, Devi Parikh, and Yaniv Taigman. Make-a-scene: Scene- based text-to-image generation with human priors. CoRR, abs/2203.13131, 2022. 6, 7, 16

    2022

  19. [27]

    Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron C

    Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron C. Courville, and Yoshua Bengio. Generative adversarial networks. CoRR, 2014. 1, 2

    2014

  20. [28]

    Improved training of wasserstein gans, 2017

    Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, and Aaron Courville. Improved training of wasserstein gans, 2017. 3

    2017

  21. [29]

    Gans trained by a two time-scale update rule converge to a local nash equi- librium

    Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. Gans trained by a two time-scale update rule converge to a local nash equi- librium. In Adv. Neural Inform. Process. Syst., pages 6626– 6637, 2017. 1, 5, 26

    2017

  22. [30]

    Denoising dif- fusion probabilistic models

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising dif- fusion probabilistic models. In NeurIPS, 2020. 1, 2, 3, 4, 6, 17

    2020

  23. [31]

    Fleet, Mohammad Norouzi, and Tim Salimans

    Jonathan Ho, Chitwan Saharia, William Chan, David J. Fleet, Mohammad Norouzi, and Tim Salimans. Cascaded diffusion models for high fidelity image generation.CoRR, abs/2106.15282, 2021. 1, 3, 22 10

    2021

  24. [32]

    Classifier-free diffusion guidance

    Jonathan Ho and Tim Salimans. Classifier-free diffusion guidance. In NeurIPS 2021 Workshop on Deep Generative Models and Downstream Applications, 2021. 6, 7, 16, 22, 28, 37, 38

    2021

  25. [33]

    Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A. Efros. Image-to-image translation with conditional adver- sarial networks. In CVPR, pages 5967–5976. IEEE Com- puter Society, 2017. 3, 4

    2017

  26. [34]

    Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A. Efros. Image-to-image translation with conditional adver- sarial networks. 2017 IEEE Conference on Computer Vi- sion and Pattern Recognition (CVPR) , pages 5967–5976,

    2017

  27. [35]

    H ´enaff, Matthew M

    Andrew Jaegle, Sebastian Borgeaud, Jean-Baptiste Alayrac, Carl Doersch, Catalin Ionescu, David Ding, Skanda Koppula, Daniel Zoran, Andrew Brock, Evan Shelhamer, Olivier J. H ´enaff, Matthew M. Botvinick, Andrew Zisserman, Oriol Vinyals, and Jo ˜ao Carreira. Perceiver IO: A gen...

    2021

  28. [36]

    Perceiver: General perception with iterative attention

    Andrew Jaegle, Felix Gimeno, Andy Brock, Oriol Vinyals, Andrew Zisserman, and Jo ˜ao Carreira. Perceiver: General perception with iterative attention. In Marina Meila and Tong Zhang, editors, Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-2...

    2021

  29. [37]

    High- resolution complex scene synthesis with transformers

    Manuel Jahn, Robin Rombach, and Bj ¨orn Ommer. High- resolution complex scene synthesis with transformers. CoRR, abs/2105.06458, 2021. 20, 22, 27

    2021

  30. [38]

    Imperfect ima- ganation: Implications of gans exacerbating biases on fa- cial data augmentation and snapchat selfie lenses

    Niharika Jain, Alberto Olmo, Sailik Sengupta, Lydia Manikonda, and Subbarao Kambhampati. Imperfect ima- ganation: Implications of gans exacerbating biases on fa- cial data augmentation and snapchat selfie lenses. arXiv preprint arXiv:2001.09528, 2020. 9

    2001

  31. [39]

    Progressive growing of gans for improved quality, sta- bility, and variation

    Tero Karras, Timo Aila, Samuli Laine, and Jaakko Lehti- nen. Progressive growing of gans for improved quality, sta- bility, and variation. CoRR, abs/1710.10196, 2017. 5, 6

    2017

  32. [40]

    A style-based generator architecture for generative adversarial networks

    Tero Karras, Samuli Laine, and Timo Aila. A style-based generator architecture for generative adversarial networks. In IEEE Conf. Comput. Vis. Pattern Recog. , pages 4401– 4410, 2019. 1

    2019

  33. [41]

    Karras, S

    T. Karras, S. Laine, and T. Aila. A style-based gener- ator architecture for generative adversarial networks. In 2019 IEEE/CVF Conference on Computer Vision and Pat- tern Recognition (CVPR), 2019. 5, 6

    2019

  34. [42]

    Analyzing and improv- ing the image quality of stylegan

    Tero Karras, Samuli Laine, Miika Aittala, Janne Hellsten, Jaakko Lehtinen, and Timo Aila. Analyzing and improv- ing the image quality of stylegan. CoRR, abs/1912.04958,

    1912

  35. [43]

    Score matching model for un- bounded data score

    Dongjun Kim, Seungjae Shin, Kyungwoo Song, Wanmo Kang, and Il-Chul Moon. Score matching model for un- bounded data score. CoRR, abs/2106.05527, 2021. 6

    2021

  36. [44]

    Glow: Generative flow with invertible 1x1 convolutions

    Durk P Kingma and Prafulla Dhariwal. Glow: Generative flow with invertible 1x1 convolutions. In S. Bengio, H. Wal- lach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, editors, Advances in Neural Information Process- ing Systems, 2018. 3

    2018

  37. [45]

    Kingma, Tim Salimans, Ben Poole, and Jonathan Ho

    Diederik P. Kingma, Tim Salimans, Ben Poole, and Jonathan Ho. Variational diffusion models. CoRR, abs/2107.00630, 2021. 1, 3, 16

    2021

  38. [46]

    Kingma and Max Welling

    Diederik P. Kingma and Max Welling. Auto-Encoding Vari- ational Bayes. In 2nd International Conference on Learn- ing Representations, ICLR, 2014. 1, 3, 4, 29

    2014

  39. [47]

    On fast sampling of diffusion probabilistic models

    Zhifeng Kong and Wei Ping. On fast sampling of diffusion probabilistic models. CoRR, abs/2106.00132, 2021. 3

    2021

  40. [48]

    Diffwave: A versatile diffusion model for audio synthesis

    Zhifeng Kong, Wei Ping, Jiaji Huang, Kexin Zhao, and Bryan Catanzaro. Diffwave: A versatile diffusion model for audio synthesis. In ICLR. OpenReview.net, 2021. 1

    2021

  41. [49]

    Alina Kuznetsova, Hassan Rom, Neil Alldrin, Jasper R. R. Uijlings, Ivan Krasin, Jordi Pont-Tuset, Shahab Kamali, Stefan Popov, Matteo Malloci, Tom Duerig, and Vittorio Ferrari. The open images dataset V4: unified image classi- fication, object detection, and visual relationship ...

    2018

  42. [50]

    Improved precision and re- call metric for assessing generative models

    Tuomas Kynk ¨a¨anniemi, Tero Karras, Samuli Laine, Jaakko Lehtinen, and Timo Aila. Improved precision and re- call metric for assessing generative models. CoRR, abs/1904.06991, 2019. 5, 26

    1904

  43. [51]

    Belongie, Lubomir D

    Tsung-Yi Lin, Michael Maire, Serge J. Belongie, Lubomir D. Bourdev, Ross B. Girshick, James Hays, Pietro Perona, Deva Ramanan, Piotr Doll´ar, and C. Lawrence Zit- nick. Microsoft COCO: common objects in context. CoRR, abs/1405.0312, 2014. 6, 7, 27

    2014

  44. [52]

    Region-wise generative adversarial imageinpainting for large missing ar- eas

    Yuqing Ma, Xianglong Liu, Shihao Bai, Le-Yi Wang, Ais- han Liu, Dacheng Tao, and Edwin Hancock. Region-wise generative adversarial imageinpainting for large missing ar- eas. ArXiv, abs/1909.12507, 2019. 9

    1909

  45. [53]

    Sdedit: Image synthesis and editing with stochastic differential equations

    Chenlin Meng, Yang Song, Jiaming Song, Jiajun Wu, Jun- Yan Zhu, and Stefano Ermon. Sdedit: Image synthesis and editing with stochastic differential equations. CoRR, abs/2108.01073, 2021. 1

    2021

  46. [54]

    Mescheder

    Lars M. Mescheder. On the convergence properties of GAN training. CoRR, abs/1801.04406, 2018. 3

    2018

  47. [55]

    Unrolled generative adversarial networks

    Luke Metz, Ben Poole, David Pfau, and Jascha Sohl- Dickstein. Unrolled generative adversarial networks. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. OpenReview.net, 2017. 3

    2017

  48. [56]

    Conditional generative adversarial nets

    Mehdi Mirza and Simon Osindero. Conditional generative adversarial nets. CoRR, abs/1411.1784, 2014. 4

    2014 arXiv

  49. [57]

    Engel, Curtis Hawthorne, and Ian Simon

    Gautam Mittal, Jesse H. Engel, Curtis Hawthorne, and Ian Simon. Symbolic music generation with diffusion models. CoRR, abs/2103.16091, 2021. 1

    2021

  50. [58]

    Qureshi, and Mehran Ebrahimi

    Kamyar Nazeri, Eric Ng, Tony Joseph, Faisal Z. Qureshi, and Mehran Ebrahimi. Edgeconnect: Generative im- age inpainting with adversarial edge learning. ArXiv, abs/1901.00212, 2019. 9

    1901

  51. [59]

    GLIDE: towards photorealistic image genera- tion and editing with text-guided diffusion models

    Alex Nichol, Prafulla Dhariwal, Aditya Ramesh, Pranav Shyam, Pamela Mishkin, Bob McGrew, Ilya Sutskever, and Mark Chen. GLIDE: towards photorealistic image genera- tion and editing with text-guided diffusion models. CoRR, abs/2112.10741, 2021. 6, 7, 16

    2021 arXiv

  52. [60]

    11 High-fidelity performance metrics for generative models in pytorch, 2020

    Anton Obukhov, Maximilian Seitzer, Po-Wei Wu, Se- men Zhydenko, Jonathan Kyl, and Elvis Yu-Jing Lin. 11 High-fidelity performance metrics for generative models in pytorch, 2020. Version: 0.3.0, DOI: 10.5281/zen- odo.4957738. 26, 27

    2020 doi

  53. [61]

    Semantic image synthesis with spatially-adaptive normalization

    Taesung Park, Ming-Yu Liu, Ting-Chun Wang, and Jun- Yan Zhu. Semantic image synthesis with spatially-adaptive normalization. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019. 4, 7

    2019

  54. [62]

    Semantic image synthesis with spatially-adaptive normalization

    Taesung Park, Ming-Yu Liu, Ting-Chun Wang, and Jun- Yan Zhu. Semantic image synthesis with spatially-adaptive normalization. In Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition (CVPR), June 2019. 22

    2019

  55. [63]

    Dual contradistinctive generative autoencoder

    Gaurav Parmar, Dacheng Li, Kwonjoon Lee, and Zhuowen Tu. Dual contradistinctive generative autoencoder. InIEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021 , pages 823–832. Computer Vision Foundation / IEEE, 2021. 6

    2021

  56. [64]

    On buggy resizing libraries and surprising subtleties in fid cal- culation

    Gaurav Parmar, Richard Zhang, and Jun-Yan Zhu. On buggy resizing libraries and surprising subtleties in fid cal- culation. arXiv preprint arXiv:2104.11222, 2021. 26

    2021

  57. [65]

    Patterson, Joseph Gonzalez, Quoc V

    David A. Patterson, Joseph Gonzalez, Quoc V . Le, Chen Liang, Lluis-Miquel Munguia, Daniel Rothchild, David R. So, Maud Texier, and Jeff Dean. Carbon emissions and large neural network training. CoRR, abs/2104.10350,

  58. [66]

    Zero-shot text-to-image generation

    Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea V oss, Alec Radford, Mark Chen, and Ilya Sutskever. Zero-shot text-to-image generation. CoRR, abs/2102.12092, 2021. 1, 2, 3, 4, 7, 21, 27

    2021

  59. [67]

    Gen- erating diverse high-fidelity images with VQ-V AE-2

    Ali Razavi, A ¨aron van den Oord, and Oriol Vinyals. Gen- erating diverse high-fidelity images with VQ-V AE-2. In NeurIPS, pages 14837–14847, 2019. 1, 2, 3, 22

    2019

  60. [68]

    Reed, Zeynep Akata, Xinchen Yan, Lajanugen Lo- geswaran, Bernt Schiele, and Honglak Lee

    Scott E. Reed, Zeynep Akata, Xinchen Yan, Lajanugen Lo- geswaran, Bernt Schiele, and Honglak Lee. Generative ad- versarial text to image synthesis. In ICML, 2016. 4

    2016

  61. [69]

    Stochastic backpropagation and approximate in- ference in deep generative models

    Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra. Stochastic backpropagation and approximate in- ference in deep generative models. In Proceedings of the 31st International Conference on International Conference on Machine Learning, ICML, 2014. 1, 4, 29

    2014

  62. [70]

    Network-to-network translation with conditional invertible neural networks

    Robin Rombach, Patrick Esser, and Bj ¨orn Ommer. Network-to-network translation with conditional invertible neural networks. In NeurIPS, 2020. 3

    2020

  63. [71]

    U- net: Convolutional networks for biomedical image segmen- tation

    Olaf Ronneberger, Philipp Fischer, and Thomas Brox. U- net: Convolutional networks for biomedical image segmen- tation. In MICCAI (3), volume 9351 of Lecture Notes in Computer Science, pages 234–241. Springer, 2015. 2, 3, 4

    2015

  64. [72]

    Fleet, and Mohammad Norouzi

    Chitwan Saharia, Jonathan Ho, William Chan, Tim Sal- imans, David J. Fleet, and Mohammad Norouzi. Im- age super-resolution via iterative refinement. CoRR, abs/2104.07636, 2021. 1, 4, 8, 16, 22, 23, 27

    2021

  65. [73]

    Tim Salimans, Andrej Karpathy, Xi Chen, and Diederik P. Kingma. Pixelcnn++: Improving the pixelcnn with dis- cretized logistic mixture likelihood and other modifications. CoRR, abs/1701.05517, 2017. 1, 3

    2017

  66. [74]

    NVIDIA Developer Blog

    Dave Salvator. NVIDIA Developer Blog. https : / / developer . nvidia . com / blog / getting - immediate- speedups- with- a100- tf32, 2020. 28

    2020

  67. [75]

    Noise estimation for generative diffusion models

    Robin San-Roman, Eliya Nachmani, and Lior Wolf. Noise estimation for generative diffusion models. CoRR, abs/2104.02600, 2021. 3

    2021

  68. [76]

    Projected gans converge faster

    Axel Sauer, Kashyap Chitta, Jens M ¨uller, and An- dreas Geiger. Projected gans converge faster. CoRR, abs/2111.01007, 2021. 6

    2021

  69. [77]

    A u- net based discriminator for generative adversarial networks

    Edgar Sch ¨onfeld, Bernt Schiele, and Anna Khoreva. A u- net based discriminator for generative adversarial networks. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020, pages 8204–8213. Computer Vision Founda-...

    2020

  70. [78]

    Laion- 400m: Open dataset of clip-filtered 400 million image-text pairs, 2021

    Christoph Schuhmann, Richard Vencu, Romain Beaumont, Robert Kaczmarczyk, Clayton Mullis, Aarush Katta, Theo Coombes, Jenia Jitsev, and Aran Komatsuzaki. Laion- 400m: Open dataset of clip-filtered 400 million image-text pairs, 2021. 6, 7

    2021

  71. [79]

    Very deep con- volutional networks for large-scale image recognition

    Karen Simonyan and Andrew Zisserman. Very deep con- volutional networks for large-scale image recognition. In Yoshua Bengio and Yann LeCun, editors, Int. Conf. Learn. Represent., 2015. 29, 43, 44, 45

    2015

  72. [80]

    D2C: diffusion-denoising models for few-shot con- ditional generation

    Abhishek Sinha, Jiaming Song, Chenlin Meng, and Stefano Ermon. D2C: diffusion-denoising models for few-shot con- ditional generation. CoRR, abs/2106.06819, 2021. 3

    2021

  73. [81]

    Alien Dreams: An Emerging Art Scene

    Charlie Snell. Alien Dreams: An Emerging Art Scene. https : / / ml . berkeley . edu / blog / posts / clip-art/, 2021. [Online; accessed November-2021]. 2

    2021

  74. [82]

    Weiss, Niru Mah- eswaranathan, and Surya Ganguli

    Jascha Sohl-Dickstein, Eric A. Weiss, Niru Mah- eswaranathan, and Surya Ganguli. Deep unsupervised learning using nonequilibrium thermodynamics. CoRR, abs/1503.03585, 2015. 1, 3, 4, 18

    2015

  75. [83]

    Learn- ing structured output representation using deep conditional generative models

    Kihyuk Sohn, Honglak Lee, and Xinchen Yan. Learn- ing structured output representation using deep conditional generative models. In C. Cortes, N. Lawrence, D. Lee, M. Sugiyama, and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 28. Curran Asso- ...

    2015

  76. [84]

    Denois- ing diffusion implicit models

    Jiaming Song, Chenlin Meng, and Stefano Ermon. Denois- ing diffusion implicit models. In ICLR. OpenReview.net,

  77. [85]

    Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole

    Yang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole. Score- based generative modeling through stochastic differential equations. CoRR, abs/2011.13456, 2020. 1, 3, 4, 18

    2011 arXiv

  78. [86]

    Energy and policy considerations for modern deep learn- ing research

    Emma Strubell, Ananya Ganesh, and Andrew McCallum. Energy and policy considerations for modern deep learn- ing research. In The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second In- novative Applications of Artificial Intelligence Conference,...

    2020

  79. [87]

    Learning layout and style re- configurable gans for controllable image synthesis

    Wei Sun and Tianfu Wu. Learning layout and style re- configurable gans for controllable image synthesis. CoRR, abs/2003.11571, 2020. 22, 27

    2003

  80. [88]

    Lempitsky

    Roman Suvorov, Elizaveta Logacheva, Anton Mashikhin, Anastasia Remizova, Arsenii Ashukha, Aleksei Silvestrov, Naejin Kong, Harshith Goka, Kiwoong Park, and Victor S. Lempitsky. Resolution-robust large mask inpainting with fourier convolutions. ArXiv, abs/2109.07161, 2021. 8, 9, 26, 32

    2021

  81. [89]

    De- von Hjelm, and Shikhar Sharma

    Tristan Sylvain, Pengchuan Zhang, Yoshua Bengio, R. De- von Hjelm, and Shikhar Sharma. Object-centric image gen- eration from layouts. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intellig...

    2021

  82. [90]

    This face does not exist

    Patrick Tinsley, Adam Czajka, and Patrick Flynn. This face does not exist... but it might be yours! identity leakage in generative models. In Proceedings of the IEEE/CVF Win- ter Conference on Applications of Computer Vision , pages 1320–1328, 2021. 9

    2021

  83. [91]

    Unbiased look at dataset bias

    Antonio Torralba and Alexei A Efros. Unbiased look at dataset bias. In CVPR 2011, pages 1521–1528. IEEE, 2011. 9

    2011

  84. [92]

    NV AE: A deep hierarchical variational autoencoder

    Arash Vahdat and Jan Kautz. NV AE: A deep hierarchical variational autoencoder. In NeurIPS, 2020. 3

    2020

  85. [93]

    Score- based generative modeling in latent space

    Arash Vahdat, Karsten Kreis, and Jan Kautz. Score- based generative modeling in latent space. CoRR, abs/2106.05931, 2021. 2, 3, 5, 6

    2021

  86. [94]

    Con- ditional image generation with pixelcnn decoders

    Aaron van den Oord, Nal Kalchbrenner, Lasse Espeholt, koray kavukcuoglu, Oriol Vinyals, and Alex Graves. Con- ditional image generation with pixelcnn decoders. In Ad- vances in Neural Information Processing Systems, 2016. 3

    2016

  87. [95]

    Pixel recurrent neural networks

    A ¨aron van den Oord, Nal Kalchbrenner, and Koray Kavukcuoglu. Pixel recurrent neural networks. CoRR, abs/1601.06759, 2016. 3

    2016

  88. [96]

    Neural discrete representation learning

    A ¨aron van den Oord, Oriol Vinyals, and Koray Kavukcuoglu. Neural discrete representation learning. In NIPS, pages 6306–6315, 2017. 2, 4, 29

    2017

  89. [97]

    Gomez, Lukasz Kaiser, and Illia Polosukhin

    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. Attention is all you need. In NIPS, pages 5998–6008, 2017. 3, 4, 5, 7

    2017

  90. [98]

    Tweet on Classifier-free guidance for autoregressive models

    Rivers Have Wings. Tweet on Classifier-free guidance for autoregressive models. https : / / twitter . com / RiversHaveWings / status / 1478093658716966912, 2022. 6

    2022

  91. [99]

    Huggingface’s transformers: State-of-the-art natural language processing

    Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chau- mond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, R ´emi Louf, Morgan Funtowicz, and Jamie Brew. Huggingface’s transformers: State-of-the-art natural language processing. CoRR, abs/1910.03771, 2019. 26

    1910 arXiv

  92. [100]

    V AEBM: A symbiosis between variational autoen- coders and energy-based models

    Zhisheng Xiao, Karsten Kreis, Jan Kautz, and Arash Vah- dat. V AEBM: A symbiosis between variational autoen- coders and energy-based models. In 9th International Con- ference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net, 2021. 6

    2021

  93. [101]

    Videogpt: Video generation using VQ-V AE and transformers

    Wilson Yan, Yunzhi Zhang, Pieter Abbeel, and Aravind Srinivas. Videogpt: Video generation using VQ-V AE and transformers. CoRR, abs/2104.10157, 2021. 3

    2021

  94. [102]

    LSUN: construction of a large-scale image dataset using deep learning with humans in the loop.CoRR, abs/1506.03365, 2015

    Fisher Yu, Yinda Zhang, Shuran Song, Ari Seff, and Jianx- iong Xiao. LSUN: construction of a large-scale image dataset using deep learning with humans in the loop.CoRR, abs/1506.03365, 2015. 5

    2015

  95. [103]

    Vector-quantized image modeling with improved vqgan, 2021

    Jiahui Yu, Xin Li, Jing Yu Koh, Han Zhang, Ruoming Pang, James Qin, Alexander Ku, Yuanzhong Xu, Jason Baldridge, and Yonghui Wu. Vector-quantized image modeling with improved vqgan, 2021. 3, 4

    2021

  96. [104]

    Lin, Jimei Yang, Xiaohui Shen, Xin Lu, and Thomas S

    Jiahui Yu, Zhe L. Lin, Jimei Yang, Xiaohui Shen, Xin Lu, and Thomas S. Huang. Free-form image inpainting with gated convolution. 2019 IEEE/CVF International Confer- ence on Computer Vision (ICCV), pages 4470–4479, 2019. 9

    2019

  97. [105]

    Zhang, Jingyun Liang, Luc Van Gool, and Radu Timo- fte

    K. Zhang, Jingyun Liang, Luc Van Gool, and Radu Timo- fte. Designing a practical degradation model for deep blind image super-resolution. ArXiv, abs/2103.14006, 2021. 23

    2021

  98. [106]

    Efros, Eli Shecht- man, and Oliver Wang

    Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Shecht- man, and Oliver Wang. The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recog- nition (CVPR), June 2018. 3, 8, 19

    2018

  99. [107]

    Large scale image completion via co-modulated generative adversarial net- works

    Shengyu Zhao, Jianwei Cui, Yilun Sheng, Yue Dong, Xiao Liang, Eric I-Chao Chang, and Yan Xu. Large scale image completion via co-modulated generative adversarial net- works. ArXiv, abs/2103.10428, 2021. 9

    2021

  100. [108]

    Places: A 10 million image database for scene recognition

    Bolei Zhou, `Agata Lapedriza, Aditya Khosla, Aude Oliva, and Antonio Torralba. Places: A 10 million image database for scene recognition. IEEE Transactions on Pattern Anal- ysis and Machine Intelligence , 40:1452–1464, 2018. 8, 9, 26

    2018

  101. [109]

    ablated UNet

    Yufan Zhou, Ruiyi Zhang, Changyou Chen, Chunyuan Li, Chris Tensmeyer, Tong Yu, Jiuxiang Gu, Jinhui Xu, and Tong Sun. LAFITE: towards language-free training for text-to-image generation. CoRR, abs/2111.13792, 2021. 6, 7, 16 13 Appendix Figure 12. Convolutional samples from the ...

    2021

Pith tools

Reviewed May 11, 2026 · model on record in the stance chip above.