The reviewed record of science sign in
Pith

arxiv: 1903.07291 · v2 · pith:62YUEOLV · submitted 2019-03-18 · cs.CV · cs.AI· cs.GR· cs.LG

Semantic Image Synthesis with Spatially-Adaptive Normalization

Taesung Park , Ming-Yu Liu , Ting-Chun Wang , Jun-Yan Zhu This is my paper

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:62YUEOLVrecord.jsonopen to challenge →

classification cs.CV cs.AIcs.GRcs.LG
keywords normalizationsemanticinputlayerslayoutspatially-adaptiveproposeactivations
0
0 comments X
read the original abstract

We propose spatially-adaptive normalization, a simple but effective layer for synthesizing photorealistic images given an input semantic layout. Previous methods directly feed the semantic layout as input to the deep network, which is then processed through stacks of convolution, normalization, and nonlinearity layers. We show that this is suboptimal as the normalization layers tend to ``wash away'' semantic information. To address the issue, we propose using the input layout for modulating the activations in normalization layers through a spatially-adaptive, learned transformation. Experiments on several challenging datasets demonstrate the advantage of the proposed method over existing approaches, regarding both visual fidelity and alignment with input layouts. Finally, our model allows user control over both semantic and style. Code is available at https://github.com/NVlabs/SPADE .

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Guided Image Generation with Conditional Invertible Neural Networks

    cs.CV 2019-07 unverdicted novelty 7.0

    Proposes cINN architecture for conditional image generation that by construction yields diverse sharp samples, demonstrated on MNIST digit generation and image colorization with latent space manipulation.

  2. Generating All the Roads to Rome: Road Layout Randomization for Improved Road Marking Segmentation

    cs.RO 2019-07 unverdicted novelty 6.0

    Road layout randomization on semantic labels produces synthetic training pairs that improve mIoU for rare road marking classes by over 12 percentage points in real-world urban deployment while retaining performance on...

  3. Stylistic-STORM (ST-STORM) : Perceiving the Semantic Nature of Appearance

    cs.CV 2026-04 unverdicted novelty 5.0

    ST-STORM introduces a dual-branch SSL framework that disentangles semantic content from stylistic appearance using gated latent streams, JEPA for content invariance, and adversarial constraints for style capture.

  4. HLGFA: High-Low Resolution Guided Feature Alignment for Unsupervised Anomaly Detection

    cs.CV 2026-02 unverdicted novelty 5.0

    HLGFA detects anomalies by identifying breakdowns in cross-resolution feature consistency between high- and low-resolution views of normal samples, guided by structure and detail priors, and reports 97.9% pixel AUROC ...