SAFE-DiT accelerates DiT inference at high resolutions by eliding mask-induced dispatch tax in attention while preserving semantics via selective scheduling, delivering up to 5x speedup and large memory savings with visual quality maintained.
Accelaes: Accelerat- ing diffusion transformers for training-free aesthetic-enhanced image generation
2 Pith papers cite this work. Polarity classification is still indexing.
abstract
Diffusion Transformers (DiTs) are a dominant backbone for high-fidelity text-to-image generation due to strong scalability and alignment at high resolutions. However, quadratic self-attention over dense spatial tokens leads to high inference latency and limits deployment. We observe that denoising is spatially non-uniform with respect to aesthetic descriptors in the prompt. Regions associated with aesthetic tokens receive concentrated cross-attention and show larger temporal variation, while low-affinity regions evolve smoothly with redundant computation. Based on this insight, we propose AccelAes, a training-free framework that accelerates DiTs through aesthetics-aware spatio-temporal reduction while improving perceptual aesthetics. AccelAes builds AesMask, a one-shot aesthetic focus mask derived from prompt semantics and cross-attention signals. When localized computation is feasible, SkipSparse reallocates computation and guidance to masked regions. We further reduce temporal redundancy using a lightweight step-level prediction cache that periodically replaces full Transformer evaluations. Experiments on representative DiT families show consistent acceleration and improved aesthetics-oriented quality. On Lumina-Next, AccelAes achieves a 2.11$\times$ speedup and improves ImageReward by +11.9% over the dense baseline. Code is available at https://github.com/xuanhuayin/AccelAes.
fields
cs.CV 2years
2026 2verdicts
UNVERDICTED 2representative citing papers
Aes3D creates the first 3D scene aesthetic assessment dataset and a model that regresses aesthetic scores from 3DGS representations alone.
citing papers explorer
-
SAFE-DiT: Semantics-Aware Fast-path Execution for High-Resolution Diffusion Transformers
SAFE-DiT accelerates DiT inference at high resolutions by eliding mask-induced dispatch tax in attention while preserving semantics via selective scheduling, delivering up to 5x speedup and large memory savings with visual quality maintained.
-
Aes3D: Aesthetic Assessment in 3D Gaussian Splatting
Aes3D creates the first 3D scene aesthetic assessment dataset and a model that regresses aesthetic scores from 3DGS representations alone.