Pith. sign in

REVIEW 10 cited by

CAR: Controllable Autoregressive Modeling for Visual Generation

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2410.04671 v1 pith:ZYERJU7R submitted 2024-10-07 cs.CV

Ziyu Yao , Jialin Li , Yifeng Zhou , Yong Liu , Xi Jiang , Chengjie Wang , Feng Zheng , Yuexian Zou
show 1 more author
Lei Li
This is my paper · ORCID
classification cs.CV
keywords autoregressivecontrolgenerationmodelsvisualcontrollablemodelmodeling
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Controllable generation, which enables fine-grained control over generated outputs, has emerged as a critical focus in visual generative models. Currently, there are two primary technical approaches in visual generation: diffusion models and autoregressive models. Diffusion models, as exemplified by ControlNet and T2I-Adapter, offer advanced control mechanisms, whereas autoregressive models, despite showcasing impressive generative quality and scalability, remain underexplored in terms of controllability and flexibility. In this study, we introduce Controllable AutoRegressive Modeling (CAR), a novel, plug-and-play framework that integrates conditional control into multi-scale latent variable modeling, enabling efficient control generation within a pre-trained visual autoregressive model. CAR progressively refines and captures control representations, which are injected into each autoregressive step of the pre-trained model to guide the generation process. Our approach demonstrates excellent controllability across various types of conditions and delivers higher image quality compared to previous methods. Additionally, CAR achieves robust generalization with significantly fewer training resources compared to those required for pre-training the model. To the best of our knowledge, we are the first to propose a control framework for pre-trained autoregressive visual generation models.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 10 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Structure-Detail Decoupled Autoregressive Generation for Fast and High-Fidelity Virtual Try-On

    cs.CV 2026-07 conditional novelty 6.5 of 10

    STAR-VTON decouples latent VAR structure synthesis from pixel-space matching-based detail recovery, yielding faster high-fidelity virtual try-on than diffusion baselines.

  2. Layout-Conditioned Autoregressive Text-to-Image Generation via Structured Masking

    cs.CV 2025-09 conditional novelty 6.0 of 10

    SMARLI achieves strong layout control in autoregressive text-to-image generation via structured attention masks and GRPO post-training with a CLIP-based layout reward.

  3. ARCON: Advancing Auto-Regressive Continuation for Driving Videos

    cs.CV 2024-12 conditional novelty 6.0 of 10

    Alternating semantic-map tokens and RGB tokens during autoregressive video continuation improves long-term consistency and FVD for driving videos.

  4. Collaborative Decoding Makes Visual Auto-Regressive Modeling Efficient

    cs.CV 2024-11 conditional novelty 6.0 of 10

    CoDe speeds up Visual Auto-Regressive image generation by using a 2B model for early coarse scales and a 0.3B model for later fine scales, with 1.7x-2.9x speedup and only a small FID increase.

  5. Lumina-mGPT 2.0: Stand-Alone AutoRegressive Image Modeling

    cs.CV 2025-07 conditional novelty 5.0 of 10

    A from-scratch, decoder-only autoregressive model reports text-to-image quality comparable to diffusion models and handles several image tasks in one framework.

  6. DC-AR: Efficient Masked Autoregressive Image Generation with Deep Compression Hybrid Tokenizer

    cs.CV 2025-07 conditional novelty 5.0 of 10

    DC-AR generates 512x512 images in 12 masked autoregressive steps plus 20 diffusion refinement steps, using a 32x compressed 2D tokenizer, and reports gFID 5.49 on MJHQ-30K.

  7. Memory-Efficient Visual Autoregressive Modeling with Scale-Aware KV Cache Compression

    cs.LG 2025-05 conditional novelty 5.0 of 10

    ScaleKV cuts KV cache memory for Visual Autoregressive text-to-image generation to 10% by classifying layers as drafters or refiners per scale and pruning low-attention tokens while keeping benchmark scores nearly unchanged.

  8. EarthMapper: Visual Autoregressive Models for Controllable Bidirectional Satellite-Map Translation

    cs.CV 2025-04 conditional novelty 5.0 of 10

    EarthMapper uses geo-conditioned joint scale autoregression with key-point guidance to set a new state of the art on bidirectional satellite-map translation, supported by a new 302k-pair Chinese city dataset.

  9. Visual Autoregressive Modeling for Image Super-Resolution

    cs.CV 2025-01 conditional novelty 5.0 of 10

    VARSR shows that next-scale visual autoregressive prediction, augmented with diffusion-based quantization residual refinement, can produce competitive perceptual-quality super-resolution at roughly ten times lower inf...

  10. Automated Parking Trajectory Generation Using Deep Reinforcement Learning

    cs.RO 2025-04 reject novelty 3.0 of 10

    The paper applies the standard SAC reinforcement learning algorithm to simulated parking and reports a small three-case timing comparison against Hybrid A*, DQN, and DDQN.

Pith tools