REVIEW 2 major objections 7 minor 17 cited by
MV-Adapter: Multi-view Consistent Image Generation Made Easy
T0 review · 2 major / 7 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read MV-Adapter aims to prove that multi-view image generation can be added to a frozen text-to-image model as a plug-in adapter—duplicating self-attention in parallel, zero-initialized—that outperforms full fine-tuning at higher resolution.
desk verdict Solid adapter method for multi-view generation, but the claimed prior-transfer mechanism is untested because the paper omits a random-initialization ablation. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is decoupled attention: the original spatial self-attention layer stays in place, and duplicate copies of it—initialized from the pre-trained weights with zero-initialized output projections—run in parallel to attend across views (multi-view attention) or to a reference image (image cross-attention). Parallel placement is the crucial detail because the copies receive exactly the same input features as the original self-attention layer, so the pre-trained initialization is in-domain and the adapter inherits image priors instead of learning from scratch as a serially appended layer would. The condition guider, a lightweight convolutional encoder that turns camera ray maps or position/normal maps into multi-scale U-Net features, is the second essential piece; it is what lets one adapter handle camera-guided, geometry-guided, text-based, and image-based generation.
What would settle it
A direct check is to train MV-Adapter on the same ~70k filtered 3D objects but with the duplicated attention layers randomly initialized while keeping the parallel zero-initialized architecture identical; if multi-view consistency metrics such as LPIPS and PSNR on the GSO benchmark stay essentially unchanged, then the claimed prior-transfer mechanism is not what carries the result. A complementary check is to test on object categories and styles absent from the training distribution: if multi-view consistency degrades sharply even though the frozen base model still generates high-quality single views, the small-data prior-transfer claim is falsified.
Extended reading notes
Core claim
The central discovery is that the prior needed for cross-view consistency already lives in the spatial self-attention layers of a pre-trained text-to-image model, and that a parallel, zero-initialized copy of those layers can extract and repurpose that prior without disturbing the original. Concretely, MV-Adapter duplicates each spatial self-attention block into a multi-view attention block and, optionally, an image cross-attention block, feeds the copies the same input features as the original, and initializes the new output projections to zero so the adapter starts as the identity and gradually adds geometric knowledge. A condition guider encodes camera rays or position-and-normal maps into multi-scale features added to the frozen U-Net, and the whole adapter is trained on a small filtered set of about 70,000 3D objects. In the paper's evaluation, this preserves the base model's image quality and style, transfers to community derivatives, and yields higher fidelity at 768 resolution than full fine-tuning baselines trained at 512.
Load-bearing premise
The assumption that carries the method is that copies of the model's own attention layers, initialized from the pre-trained weights and fed the same inputs as the originals, provide a strong enough starting point that roughly 70,000 filtered 3D objects can teach multi-view geometry; if those pre-trained attention features do not transfer usefully to cross-view reasoning, or if that small dataset is not representative enough, the quality and adaptability advantage over full fine-tuning would collapse.
Editorial extensions
If this is right
- A single trained adapter can be inserted into personalized, distilled, or spatially controlled derivative models without retraining, so multi-view capability becomes a drop-in property of the existing T2I ecosystem rather than a separate fine-tuned model.
- Because only adapter parameters are updated (about 127M for the SD2.1 variant and 490M for the SDXL variant), training at 768 resolution is feasible where full fine-tuning exceeds 80 GB of memory, and the base model's image quality is preserved.
- One unified condition encoder handles both camera rays and position/normal maps, so the same adapter supports camera-guided text-to-multiview, image-to-multiview, geometry-guided texturing, 3D reconstruction, and arbitrary-view generation from anchor views.
- The zero-initialized parallel design means the adapter starts as an identity mapping, which is what allows it to preserve the pre-trained feature space while learning multi-view geometry from a relatively small set of about 70,000 3D objects.
Reading between the lines
- Editorial inference: if the prior-transfer mechanism is as strong as the paper claims, the same parallel-duplication recipe should inject other new knowledge—consistent lighting, zoom effects, or temporal motion—into frozen T2I models with comparably small data; the paper lists these as future work but does not test them.
- Editorial inference: the comparison with multi-view LoRA suggests that non-overlapping trainable parameters are the real driver of downstream compatibility; a direct test would be to vary the adapter's parameter budget and measure whether compatibility with personalized models degrades as the layers begin to overlap.
- Editorial inference: the small-data claim implies a stress test the paper does not run—evaluate the trained adapter on object categories and styles that are absent from the roughly 70k filtered set; if multi-view consistency collapses there despite the base model generating strong single views, then the prior-transfer story would need revision.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes MV-Adapter, a plug-and-play adapter that turns pre-trained text-to-image diffusion models into multi-view image generators without modifying the base model's weights or feature space. The core design duplicates the pre-trained spatial self-attention layers into new multi-view attention and image cross-attention layers, organizes them in parallel with zero-initialized output projections, and adds a unified condition encoder for camera rays or geometry maps. The authors train 512-resolution (SD2.1) and 768-resolution (SDXL) adapters on roughly 70,000 filtered Objaverse samples and report quantitative results for text-to-multiview, image-to-multiview, and texture generation, as well as ablations on the parallel architecture and training cost. They also demonstrate adaptability to community T2I derivatives (e.g., DreamShaper, Animagine, ControlNet) and extensions to arbitrary-view synthesis.
Significance. If the reported results hold, MV-Adapter is a valuable contribution: it demonstrates a parameter-efficient route to multi-view generation at higher resolution than many full-fine-tuning methods, preserves the base model's feature space, and transfers to a wide range of T2I derivatives. The paper's architectural idea—parallel decoupled attention with duplicated self-attention weights—is conceptually clean and the efficiency comparison in Table 4 is a concrete strength. The qualitative results in Figures 5, 8, 10, and 11 are impressive and support the adaptability claims. However, the central mechanism is not yet fully isolated, and the quantitative evaluation is weakened by distribution overlap and missing error bars, so the 'new quality standard' claim is stronger than the current evidence.
major comments (2)
- [§4.2, Eq. (3), Table 5] The central claim that duplicating the pre-trained spatial self-attention weights allows the adapter to 'inherit the powerful priors' (Section 4.2) is not isolated by the reported experiments. The serial-versus-parallel ablation in Table 5 changes both the network topology and the feature domain seen by the new multi-view and image cross-attention layers, so it does not test whether the initialization of those layers with pre-trained weights is what drives the quality gain. A random-initialization control with the same parallel architecture and zero-initialized output projections would have an identical forward pass at the start of training and the same trainable parameter budget; without such a control, the efficiency and quality improvements in Tables 4 and 5 could be attributed to the parallel residual design and the large adapter capacity rather than to the transfer of pre-trained attention priors. I ask the authors to run this ablation and report the same PSNR/SSIM/LPIPS metrics as in Table 5.
- [§5.1, Table 1, Appendix A.2] The quantitative evidence for the 'new quality standard' claim is weakened by two issues. First, the text-to-multiview benchmark in Table 1 uses 1,000 prompts selected from the Objaverse dataset, which is the same distribution from which the filtered training subset of approximately 70,000 samples is drawn (Appendix A.2); this overlaps with the training distribution and may inflate the reported FID, IS, and CLIP scores. Second, Tables 1, 2, 3, 5, and 6 all report point estimates without error bars, confidence intervals, or significance tests, and several of the gaps are small (e.g., FID 31.24 versus 32.15 for Ours (SD2.1) versus MVDream in Table 1). I recommend evaluating on an out-of-distribution prompt set (e.g., user-written prompts or a benchmark such as DreamBench) and reporting bootstrap confidence intervals or standard errors across multiple runs.
minor comments (7)
- [Abstract / §1] The phrase 'the first adapter-based solution for multi-view image generation' appears in the abstract and introduction, but the paper itself cites NVS-Adapter (Jeong et al., 2025), a plug-and-play adapter for novel view synthesis from a single image, which is a closely related multi-view task; please qualify the novelty claim (e.g., first adapter for general multi-view generation with decoupled parallel attention) or compare to NVS-Adapter directly.
- [Table 1] Please specify how the CLIP Score is computed, including the CLIP model variant and whether the score is averaged over views or computed pairwise between views and the prompt; the same details should be provided for IS and FID (e.g., number of samples, resolution).
- [Figure 6] The 'Input' column in a text-to-multiview comparison is confusing; if it shows a reference image used for all rows or the text prompt, please label it clearly and describe it in the caption.
- [Table 4] The entry '>80G' for Era3D (SDXL) is imprecise; please report the exact memory consumption or note that the run exceeded available GPU memory.
- [§4.3 / Appendix A.2] The noise schedule shift by log(n) is described only verbally; please provide the exact formula or pseudocode for how the signal-to-noise ratio is shifted, citing the relevant equation in simple diffusion or stable video diffusion.
- [Appendix A.5.1] The user study reports preference rates but no statistical significance test, and it only evaluates the SD2.1-based MV-Adapter; consider including the SDXL version and reporting confidence intervals or a chi-square test.
- [Throughout] There are several typos and grammatical errors (e.g., 'trainging' in Appendix A.2 and 'makes the model to generate' in Section 1); please proofread the manuscript carefully.
Circularity Check
No circularity: MV-Adapter's claims rest on external training/evaluation and architectural ablations, not on self-referential derivation.
full rationale
The derivation chain is self-contained. The central mechanism (Sec. 4.2) duplicates pre-trained spatial self-attention weights, feeds the new layers the same f_in, and zero-initializes their output projections; this is an architectural initialization, not an equation that reduces to the claimed outcome. The 'inherit priors' statement is a literal property of weight copying and is then validated by external experiments on Objaverse/GSO and against MVDream, SPAD, Era3D, etc. The training loss (Eq. 4) is the standard diffusion MSE; no parameter is fitted to a benchmark and then renamed a prediction. Ablations (Table 5) compare serial vs parallel topology; although they do not isolate the copied initialization from topology (a random-init parallel ablation is absent), that is an experimental gap, not circularity. Self-citations (Epidiff, Ouroboros3D) appear only as related work or baselines and are not used to justify the adapter's effectiveness. The Appendix A.4 limitation that performance depends on the base backbone is an acknowledged empirical dependence, not a circular premise. The only notable inconsistency—calling MV-Adapter the 'first adapter-based' method while citing NVS-Adapter (Jeong et al., 2025)—is a priority/accuracy issue, not a circular derivation. Overall score 0.
Assumptions & free parameters
free parameters (4)
- Text-only classifier-free guidance scale =
7.0
- Image-condition guidance scale (alpha) =
3.0
- Text-condition guidance scale (beta) =
3.0
- Noise schedule SNR shift =
log(6)
assumptions (5)
- domain assumption Pre-trained T2I models (SD2.1, SDXL) retain their generative priors when used as frozen backbones.
- ad hoc to paper Duplicated spatial self-attention weights, initialized from pre-trained layers with zero-initialized output projections, provide a useful prior for multi-view attention.
- domain assumption Orthographic views at elevation 0 align epipolar lines with image rows and columns, so row-wise and column-wise attention enforce multi-view consistency.
- domain assumption The filtered 70,000-sample Objaverse subset, with Cap3D captions, is sufficiently large and unbiased to learn generalizable multi-view geometry inside an adapter.
- domain assumption FID, IS, CLIP Score, PSNR, SSIM, LPIPS, and KID measure the qualities claimed (fidelity, consistency, condition alignment).
Cite this review
Pith. "Pith review of MV-Adapter: Multi-view Consistent Image Generation Made Easy." pith.science (2026). https://pith.science/paper/MA3736K3
@misc{pith2026241203632,
author = {Pith},
title = {Pith review of: MV-Adapter: Multi-view Consistent Image Generation Made Easy},
year = {2026},
howpublished = {\url{https://pith.science/paper/MA3736K3}},
note = {Machine review of arXiv:2412.03632}
}
read the original abstract
Existing multi-view image generation methods often make invasive modifications to pre-trained text-to-image (T2I) models and require full fine-tuning, leading to (1) high computational costs, especially with large base models and high-resolution images, and (2) degradation in image quality due to optimization difficulties and scarce high-quality 3D data. In this paper, we propose the first adapter-based solution for multi-view image generation, and introduce MV-Adapter, a versatile plug-and-play adapter that enhances T2I models and their derivatives without altering the original network structure or feature space. By updating fewer parameters, MV-Adapter enables efficient training and preserves the prior knowledge embedded in pre-trained models, mitigating overfitting risks. To efficiently model the 3D geometric knowledge within the adapter, we introduce innovative designs that include duplicated self-attention layers and parallel attention architecture, enabling the adapter to inherit the powerful priors of the pre-trained models to model the novel 3D knowledge. Moreover, we present a unified condition encoder that seamlessly integrates camera parameters and geometric information, facilitating applications such as text- and image-based 3D generation and texturing. MV-Adapter achieves multi-view generation at 768 resolution on Stable Diffusion XL (SDXL), and demonstrates adaptability and versatility. It can also be extended to arbitrary view generation, enabling broader applications. We demonstrate that MV-Adapter sets a new quality standard for multi-view image generation, and opens up new possibilities due to its efficiency, adaptability and versatility.
Figures
Figures from the paper (22 more)
Forward citations
Cited by 17 Pith papers
-
VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Space
A training-free 3D editing method that inverts a source asset into TRELLIS latent space and replaces latents plus attention K/V tokens in unedited regions during re-denosing.
-
MV-RAG: Retrieval Augmented Multiview Diffusion
A retrieval-augmented multiview diffusion model conditions on web images to generate 3D-consistent views of rare concepts, trained with a hybrid 3D/2D objective and evaluated on a new OOD benchmark.
-
MVGBench: Comprehensive Benchmark for Multi-view Generation Models
MVGBench evaluates multi-view generators through self-consistency of 3D reconstructions and uses this protocol to rank 12 models and build a better one.
-
MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generation
MIDI extends pre-trained image-to-3D object generators to multi-instance diffusion with a multi-instance attention mechanism, producing spatially coherent 3D scenes from a single image in one pass.
-
TGRHuman: Text-Guided Realistic 3D Human Generation via Diffusion Renderer
TGRHuman generates an explicit, animatable 3D human mesh and texture from text in about five minutes by generating four-view normals, carving an SMPL-based mesh, and painting texture with a diffusion renderer.
-
EditFlow3D: Automated Local Editing of 3D Assets with Trajectory Preservation
Mask-guided differential flow with a soft preservation loss enables training-free local 3D editing that keeps unedited regions close to the source asset.
-
PixGS: Pixel-Space Diffusion for Direct 3D Gaussian Splat Generation
PixGS is a single-stage pixel-space diffusion model that directly produces high-quality 3D Gaussian Splats from text or images in ~1s, outperforming multi-stage latent methods on standard benchmarks.
-
TInR: Exploring Tool-Internalized Reasoning in Large Language Models
TInR-U internalizes tool knowledge into LLMs via bidirectional alignment, supervised fine-tuning, and reinforcement learning, outperforming standard tool-integrated reasoning in both in-domain and out-of-domain evaluations.
-
ViewMask-1-to-3: Multi-View Consistent Image Generation via Multimodal Discrete Diffusion Models
A masked discrete-diffusion transformer generates multiple consistent object views from a single image or text, reporting the best average PSNR/SSIM/LPIPS on GSO and 3D-FUTURE.
-
SeqTex: Generate Mesh Textures in Video Sequence
SeqTex adapts a pretrained video diffusion model to directly generate complete UV texture maps by jointly predicting four multi-view images and the UV map as a five-frame sequence.
-
Pro3D-Editor : A Progressive-Views Perspective for Consistent and Precise 3D Editing
Pro3D-Editor chooses the most editing-salient view, propagates the edit to other key views with per-view LoRA experts, and refines the 3D scene, improving multi-view consistency.
-
Pippo: High-Resolution Multi-View Humans from a Single Image
A single-image multi-view diffusion transformer generates 1K-resolution turnaround views of humans, with attention biasing for many views and a new reprojection-error metric.
-
ObjFiller3D: Scaling 3D Object Inpainting to Dense Multi-View Consistency
ObjFiller3D jointly optimizes a dense 360-degree ring of views to inpaint 3D objects with cross-view-consistent textures, reporting higher PSNR and LPIPS than per-view baselines at much lower runtime.
-
Follow-Your-Instruction: A Comprehensive MLLM Agent for World Data Synthesis
An MLLM-driven pipeline that composes 3D scenes from assets, optimizes them with multi-view VLM feedback, and renders videos, yielding synthetic data that modestly improves several 2D, 3D, and 4D generative baselines.
-
MVPainter: Accurate and Detailed 3D Texture Generation via Multi-View Diffusion with Geometric Control
MVPainter paints detailed, reference-consistent textures on 3D meshes by conditioning multi-view diffusion on normal and depth maps, reporting the best preference scores among tested open-source texture generators.
-
Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assets
An open-source-oriented image-to-3D system combines a VAE-DiT geometry generator and a diffusion texture module, claiming state-of-the-art quality over open-source rivals and near-proprietary performance.
-
Dialogue Director: Bridging the Gap in Dialogue Visualization for Multimodal Storytelling
Dialogue Director converts dialogue scripts into multi-view storyboards using GPT-4-based script analysis, multi-view diffusion, and cinematic layout planning, with mixed quantitative gains over baselines.
Reference graph
Works this paper leans on
-
[1]
write newline
" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 global.max substring 't := if while FUNCTION format.date year duplicate empty "emp...
-
[2]
ediff-i: Text-to-image diffusion models with an ensemble of expert denoisers
Yogesh Balaji, Seungjun Nah, Xun Huang, Arash Vahdat, Jiaming Song, Qinsheng Zhang, Karsten Kreis, Miika Aittala, Timo Aila, Samuli Laine, et al. ediff-i: Text-to-image diffusion models with an ensemble of expert denoisers. arXiv preprint arXiv:2211.01324, 2022
arXiv 2022
-
[3]
Meta 3d texturegen: Fast and consistent texture generation for 3d objects
Raphael Bensadoun, Yanir Kleiman, Idan Azuri, Omri Harosh, Andrea Vedaldi, Natalia Neverova, and Oran Gafni. Meta 3d texturegen: Fast and consistent texture generation for 3d objects. arXiv preprint arXiv:2407.02430, 2024
arXiv 2024
-
[4]
Stable video diffusion: Scaling latent video diffusion models to large datasets
Andreas Blattmann, Tim Dockhorn, Sumith Kulal, Daniel Mendelevitch, Maciej Kilian, Dominik Lorenz, Yam Levi, Zion English, Vikram Voleti, Adam Letts, et al. Stable video diffusion: Scaling latent video diffusion models to large datasets. arXiv preprint arXiv:2311.15127, 2023
arXiv 2023
-
[5]
Controllable generation with text-to-image diffusion models: A survey
Pu Cao, Feng Zhou, Qing Song, and Lu Yang. Controllable generation with text-to-image diffusion models: A survey. arXiv preprint arXiv:2403.04279, 2024
arXiv 2024
-
[6]
Text2tex: Text-driven texture synthesis via diffusion models
Dave Zhenyu Chen, Yawar Siddiqui, Hsin-Ying Lee, Sergey Tulyakov, and Matthias Nie ner. Text2tex: Text-driven texture synthesis via diffusion models. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 18558--18568, 2023
work page 2023
-
[7]
Objaverse: A universe of annotated 3d objects
Matt Deitke, Dustin Schwenk, Jordi Salvador, Luca Weihs, Oscar Michel, Eli VanderBilt, Ludwig Schmidt, Kiana Ehsani, Aniruddha Kembhavi, and Ali Farhadi. Objaverse: A universe of annotated 3d objects. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 13142--13153, 2023
2023
-
[8]
Flashtex: Fast relightable mesh texturing with lightcontrolnet
Kangle Deng, Timothy Omernick, Alexander Weiss, Deva Ramanan, Jun-Yan Zhu, Tinghui Zhou, and Maneesh Agrawala. Flashtex: Fast relightable mesh texturing with lightcontrolnet. arXiv preprint arXiv:2402.13251, 2024
arXiv 2024
Show all 76 references
-
[9]
Diffusion models beat gans on image synthesis
Prafulla Dhariwal and Alexander Nichol. Diffusion models beat gans on image synthesis. Advances in neural information processing systems, 34: 0 8780--8794, 2021
2021
-
[10]
Google scanned objects: A high-quality dataset of 3d scanned household items
Laura Downs, Anthony Francis, Nate Koenig, Brandon Kinman, Ryan Hickman, Krista Reymann, Thomas B McHugh, and Vincent Vanhoucke. Google scanned objects: A high-quality dataset of 3d scanned household items. In 2022 International Conference on Robotics and Automation (ICRA), pp...
2022
-
[11]
An image is worth one word: Personalizing text-to-image generation using textual inversion
Rinon Gal, Yuval Alaluf, Yuval Atzmon, Or Patashnik, Amit H Bermano, Gal Chechik, and Daniel Cohen-Or. An image is worth one word: Personalizing text-to-image generation using textual inversion. arXiv preprint arXiv:2208.01618, 2022
2022 arXiv
-
[12]
Cat3d: Create anything in 3d with multi-view diffusion models
Ruiqi Gao, Aleksander Holynski, Philipp Henzler, Arthur Brussee, Ricardo Martin-Brualla, Pratul Srinivasan, Jonathan T Barron, and Ben Poole. Cat3d: Create anything in 3d with multi-view diffusion models. arXiv preprint arXiv:2405.10314, 2024
2024 arXiv
-
[13]
Classifier-free diffusion guidance
Jonathan Ho and Tim Salimans. Classifier-free diffusion guidance. arXiv preprint arXiv:2207.12598, 2022
2022 arXiv
-
[14]
Denoising diffusion probabilistic models
Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffusion probabilistic models. Advances in neural information processing systems, 33: 0 6840--6851, 2020
2020
-
[15]
simple diffusion: End-to-end diffusion for high resolution images
Emiel Hoogeboom, Jonathan Heek, and Tim Salimans. simple diffusion: End-to-end diffusion for high resolution images. In International Conference on Machine Learning, pp.\ 13213--13232. PMLR, 2023
2023
-
[16]
Lora: Low-rank adaptation of large language models
Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. Lora: Low-rank adaptation of large language models. arXiv preprint arXiv:2106.09685, 2021
2021 arXiv
-
[17]
Epidiff: Enhancing multi-view synthesis via localized epipolar-constrained diffusion
Zehuan Huang, Hao Wen, Junting Dong, Yaohui Wang, Yangguang Li, Xinyuan Chen, Yan-Pei Cao, Ding Liang, Yu Qiao, Bo Dai, et al. Epidiff: Enhancing multi-view synthesis via localized epipolar-constrained diffusion. In Proceedings of the IEEE/CVF Conference on Computer Vision and...
2024
-
[18]
Nvs-adapter: Plug-and-play novel view synthesis from a single image
Yoonwoo Jeong, Jinwoo Lee, Chiheon Kim, Minsu Cho, and Doyup Lee. Nvs-adapter: Plug-and-play novel view synthesis from a single image. In European Conference on Computer Vision, pp.\ 449--466. Springer, 2025
2025
-
[19]
Spad: Spatially aware multi-view diffusers
Yash Kant, Aliaksandr Siarohin, Ziyi Wu, Michael Vasilkovsky, Guocheng Qian, Jian Ren, Riza Alp Guler, Bernard Ghanem, Sergey Tulyakov, and Igor Gilitschenski. Spad: Spatially aware multi-view diffusers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern ...
2024
-
[20]
Multi-concept customization of text-to-image diffusion
Nupur Kumari, Bingliang Zhang, Richard Zhang, Eli Shechtman, and Jun-Yan Zhu. Multi-concept customization of text-to-image diffusion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 1931--1941, 2023
1931
-
[21]
Black Forest Labs. Flux. [Online], 2024. https://github.com/black-forest-labs/flux
2024
-
[22]
Instant3d: Fast text-to-3d with sparse-view generation and large reconstruction model
Jiahao Li, Hao Tan, Kai Zhang, Zexiang Xu, Fujun Luan, Yinghao Xu, Yicong Hong, Kalyan Sunkavalli, Greg Shakhnarovich, and Sai Bi. Instant3d: Fast text-to-3d with sparse-view generation and large reconstruction model. arXiv preprint arXiv:2311.06214, 2023 a
2023 arXiv
-
[23]
Era3d: High-resolution multiview diffusion using efficient row-wise attention
Peng Li, Yuan Liu, Xiaoxiao Long, Feihu Zhang, Cheng Lin, Mengfei Li, Xingqun Qi, Shanghang Zhang, Wenhan Luo, Ping Tan, et al. Era3d: High-resolution multiview diffusion using efficient row-wise attention. arXiv preprint arXiv:2405.11616, 2024
2024 arXiv
-
[24]
Sweetdreamer: Aligning geometric priors in 2d diffusion for consistent text-to-3d
Weiyu Li, Rui Chen, Xuelin Chen, and Ping Tan. Sweetdreamer: Aligning geometric priors in 2d diffusion for consistent text-to-3d. arXiv preprint arXiv:2310.02596, 2023 b
2023 arXiv
-
[25]
Sdxl-lightning: Progressive adversarial diffusion distillation
Shanchuan Lin, Anran Wang, and Xiao Yang. Sdxl-lightning: Progressive adversarial diffusion distillation. arXiv preprint arXiv:2402.13929, 2024
2024 arXiv
-
[26]
Syncdreamer: Generating multiview-consistent images from a single-view image
Yuan Liu, Cheng Lin, Zijiao Zeng, Xiaoxiao Long, Lingjie Liu, Taku Komura, and Wenping Wang. Syncdreamer: Generating multiview-consistent images from a single-view image. arXiv preprint arXiv:2309.03453, 2023 a
2023 arXiv
-
[27]
Text-guided texturing by synchronized multi-view diffusion
Yuxin Liu, Minshan Xie, Hanyuan Liu, and Tien-Tsin Wong. Text-guided texturing by synchronized multi-view diffusion. arXiv preprint arXiv:2311.12891, 2023 b
2023 arXiv
-
[28]
Wonder3d: Single image to 3d using cross-domain diffusion
Xiaoxiao Long, Yuan-Chen Guo, Cheng Lin, Yuan Liu, Zhiyang Dou, Lingjie Liu, Yuexin Ma, Song-Hai Zhang, Marc Habermann, Christian Theobalt, et al. Wonder3d: Single image to 3d using cross-domain diffusion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Patter...
2024
-
[29]
Latent consistency models: Synthesizing high-resolution images with few-step inference
Simian Luo, Yiqin Tan, Longbo Huang, Jian Li, and Hang Zhao. Latent consistency models: Synthesizing high-resolution images with few-step inference. arXiv preprint arXiv:2310.04378, 2023
2023 arXiv
-
[30]
Scalable 3d captioning with pretrained models
Tiange Luo, Chris Rockwell, Honglak Lee, and Justin Johnson. Scalable 3d captioning with pretrained models. Advances in Neural Information Processing Systems, 36, 2024
2024
-
[31]
Subject-diffusion: Open domain personalized text-to-image generation without test-time fine-tuning
Jian Ma, Junhao Liang, Chen Chen, and Haonan Lu. Subject-diffusion: Open domain personalized text-to-image generation without test-time fine-tuning. In ACM SIGGRAPH 2024 Conference Papers, pp.\ 1--12, 2024
2024
-
[32]
On distillation of guided diffusion models
Chenlin Meng, Robin Rombach, Ruiqi Gao, Diederik Kingma, Stefano Ermon, Jonathan Ho, and Tim Salimans. On distillation of guided diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 14297--14306, 2023
2023
-
[33]
Null-text inversion for editing real images using guided diffusion models
Ron Mokady, Amir Hertz, Kfir Aberman, Yael Pritch, and Daniel Cohen-Or. Null-text inversion for editing real images using guided diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 6038--6047, 2023
2023
-
[34]
T2i-adapter: Learning adapters to dig out more controllable ability for text-to-image diffusion models
Chong Mou, Xintao Wang, Liangbin Xie, Yanze Wu, Jian Zhang, Zhongang Qi, and Ying Shan. T2i-adapter: Learning adapters to dig out more controllable ability for text-to-image diffusion models. Proceedings of the AAAI Conference on Artificial Intelligence, 38 0 (5): 0 4296--4304...
2024 doi
-
[35]
GLIDE: towards photorealistic image generation and editing with text-guided diffusion models
Alexander Quinn Nichol, Prafulla Dhariwal, Aditya Ramesh, Pranav Shyam, Pamela Mishkin, Bob McGrew, Ilya Sutskever, and Mark Chen. GLIDE: towards photorealistic image generation and editing with text-guided diffusion models. In International Conference on Machine Learning, ICM...
2022
-
[36]
Scalable diffusion models with transformers
William Peebles and Saining Xie. Scalable diffusion models with transformers. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 4195--4205, 2023
2023
-
[37]
SDXL: improving latent diffusion models for high-resolution image synthesis
Dustin Podell, Zion English, Kyle Lacey, Andreas Blattmann, Tim Dockhorn, Jonas M \" u ller, Joe Penna, and Robin Rombach. SDXL: improving latent diffusion models for high-resolution image synthesis. In The Twelfth International Conference on Learning Representations, ICLR 202...
2024
-
[38]
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervision. In International conference on machine learning, pp...
2021
-
[39]
Zero-shot text-to-image generation
Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever. Zero-shot text-to-image generation. In International conference on machine learning, pp.\ 8821--8831. Pmlr, 2021
2021
-
[40]
Hierarchical text-conditional image generation with clip latents
Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125, 1 0 (2): 0 3, 2022
2022 arXiv
-
[41]
Texture: Text-guided texturing of 3d shapes
Elad Richardson, Gal Metzer, Yuval Alaluf, Raja Giryes, and Daniel Cohen-Or. Texture: Text-guided texturing of 3d shapes. In ACM SIGGRAPH 2023 conference proceedings, pp.\ 1--11, 2023
2023
-
[42]
High-resolution image synthesis with latent diffusion models
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj \"o rn Ommer. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 10684--10695, 2022
2022
-
[43]
U-net: Convolutional networks for biomedical image segmentation
Olaf Ronneberger, Philipp Fischer, and Thomas Brox. U-net: Convolutional networks for biomedical image segmentation. In Medical image computing and computer-assisted intervention--MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, proceedings, part...
2015
-
[44]
Dreambooth: Fine tuning text-to-image diffusion models for subject-driven generation
Nataniel Ruiz, Yuanzhen Li, Varun Jampani, Yael Pritch, Michael Rubinstein, and Kfir Aberman. Dreambooth: Fine tuning text-to-image diffusion models for subject-driven generation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 22500-...
2023
-
[45]
Photorealistic text-to-image diffusion models with deep language understanding
Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily L Denton, Kamyar Ghasemipour, Raphael Gontijo Lopes, Burcu Karagol Ayan, Tim Salimans, et al. Photorealistic text-to-image diffusion models with deep language understanding. Advances in neural information...
2022
-
[46]
Scene representation transformer: Geometry-free novel view synthesis through set-latent scene representations
Mehdi SM Sajjadi, Henning Meyer, Etienne Pot, Urs Bergmann, Klaus Greff, Noha Radwan, Suhani Vora, Mario Lu c i \'c , Daniel Duckworth, Alexey Dosovitskiy, et al. Scene representation transformer: Geometry-free novel view synthesis through set-latent scene representations. In ...
2022
-
[47]
Ziplora: Any subject in any style by effectively merging loras
Viraj Shah, Nataniel Ruiz, Forrester Cole, Erika Lu, Svetlana Lazebnik, Yuanzhen Li, and Varun Jampani. Ziplora: Any subject in any style by effectively merging loras. arXiv preprint arXiv:2311.13600, 2023
2023
-
[48]
Instantbooth: Personalized text-to-image generation without test-time finetuning
Jing Shi, Wei Xiong, Zhe Lin, and Hyun Joon Jung. Instantbooth: Personalized text-to-image generation without test-time finetuning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 8543--8552, 2024
2024
-
[49]
Zero123++: a single image to consistent multi-view diffusion base model
Ruoxi Shi, Hansheng Chen, Zhuoyang Zhang, Minghua Liu, Chao Xu, Xinyue Wei, Linghao Chen, Chong Zeng, and Hao Su. Zero123++: a single image to consistent multi-view diffusion base model. arXiv preprint arXiv:2310.15110, 2023 a
2023 arXiv
-
[50]
Mvdream: Multi-view diffusion for 3d generation
Yichun Shi, Peng Wang, Jianglong Ye, Mai Long, Kejie Li, and Xiao Yang. Mvdream: Multi-view diffusion for 3d generation. arXiv preprint arXiv:2308.16512, 2023 b
2023 arXiv
-
[51]
Toss: High-quality text-guided novel view synthesis from a single image
Yukai Shi, Jianan Wang, He Cao, Boshi Tang, Xianbiao Qi, Tianyu Yang, Yukun Huang, Shilong Liu, Lei Zhang, and Heung-Yeung Shum. Toss: High-quality text-guided novel view synthesis from a single image. arXiv preprint arXiv:2310.10644, 2023 c
-
[52]
Denoising diffusion implicit models
Jiaming Song, Chenlin Meng, and Stefano Ermon. Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502, 2020
2010 arXiv
-
[53]
Moma: Multimodal llm adapter for fast personalized image generation
Kunpeng Song, Yizhe Zhu, Bingchen Liu, Qing Yan, Ahmed Elgammal, and Xiao Yang. Moma: Multimodal llm adapter for fast personalized image generation. arXiv preprint arXiv:2404.05674, 2024
2024 arXiv
-
[54]
Consistency models
Yang Song, Prafulla Dhariwal, Mark Chen, and Ilya Sutskever. Consistency models. arXiv preprint arXiv:2303.01469, 2023
2023 arXiv
-
[55]
Resolution-robust large mask inpainting with fourier convolutions
Roman Suvorov, Elizaveta Logacheva, Anton Mashikhin, Anastasia Remizova, Arsenii Ashukha, Aleksei Silvestrov, Naejin Kong, Harshith Goka, Kiwoong Park, and Victor Lempitsky. Resolution-robust large mask inpainting with fourier convolutions. In Proceedings of the IEEE/CVF winte...
2022
-
[56]
Mvdiffusion: Enabling holistic multi-view image generation with correspondence-aware diffusion
Shitao Tang, Fuyang Zhang, Jiacheng Chen, Peng Wang, and Yasutaka Furukawa. Mvdiffusion: Enabling holistic multi-view image generation with correspondence-aware diffusion. arXiv, 2023
2023
-
[57]
Mvdiffusion++: A dense high-resolution multi-view diffusion model for single or sparse-view 3d object reconstruction
Shitao Tang, Jiacheng Chen, Dilin Wang, Chengzhou Tang, Fuyang Zhang, Yuchen Fan, Vikas Chandra, Yasutaka Furukawa, and Rakesh Ranjan. Mvdiffusion++: A dense high-resolution multi-view diffusion model for single or sparse-view 3d object reconstruction. arXiv preprint arXiv:240...
2024 arXiv
-
[58]
Kolors: Effective training of diffusion model for photorealistic text-to-image synthesis
Kolors Team. Kolors: Effective training of diffusion model for photorealistic text-to-image synthesis. arXiv preprint, 2024
2024
-
[59]
Sv3d: Novel multi-view synthesis and 3d generation from a single image using latent video diffusion
Vikram Voleti, Chun-Han Yao, Mark Boss, Adam Letts, David Pankratz, Dmitry Tochilkin, Christian Laforte, Robin Rombach, and Varun Jampani. Sv3d: Novel multi-view synthesis and 3d generation from a single image using latent video diffusion. arXiv preprint arXiv:2403.12008, 2024
2024 arXiv
-
[60]
Instantstyle: Free lunch towards style-preserving in text-to-image generation
Haofan Wang, Qixun Wang, Xu Bai, Zekui Qin, and Anthony Chen. Instantstyle: Free lunch towards style-preserving in text-to-image generation. arXiv preprint arXiv:2404.02733, 2024 a
2024 arXiv
-
[61]
Imagedream: Image-prompt multi-view diffusion for 3d generation
Peng Wang and Yichun Shi. Imagedream: Image-prompt multi-view diffusion for 3d generation. arXiv preprint arXiv:2312.02201, 2023
2023 arXiv
-
[62]
Neus: Learning neural implicit surfaces by volume rendering for multi-view reconstruction
Peng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt, Taku Komura, and Wenping Wang. Neus: Learning neural implicit surfaces by volume rendering for multi-view reconstruction. arXiv preprint arXiv:2106.10689, 2021
2021 arXiv
-
[63]
Crm: Single image to 3d textured mesh with convolutional reconstruction model
Zhengyi Wang, Yikai Wang, Yifei Chen, Chendong Xiang, Shuo Chen, Dajiang Yu, Chongxuan Li, Hang Su, and Jun Zhu. Crm: Single image to 3d textured mesh with convolutional reconstruction model. arXiv preprint arXiv:2403.05034, 2024 b
2024 arXiv
-
[64]
Novel view synthesis with diffusion models
Daniel Watson, William Chan, Ricardo Martin-Brualla, Jonathan Ho, Andrea Tagliasacchi, and Mohammad Norouzi. Novel view synthesis with diffusion models. arXiv preprint arXiv:2210.04628, 2022
2022 arXiv
-
[65]
Ouroboros3d: Image-to-3d generation via 3d-aware recursive diffusion
Hao Wen, Zehuan Huang, Yaohui Wang, Xinyuan Chen, Yu Qiao, and Lu Sheng. Ouroboros3d: Image-to-3d generation via 3d-aware recursive diffusion. arXiv preprint arXiv:2406.03184, 2024
2024 arXiv
-
[66]
Cogvideox: Text-to-video diffusion models with an expert transformer
Zhuoyi Yang, Jiayan Teng, Wendi Zheng, Ming Ding, Shiyu Huang, Jiazheng Xu, Yuanming Yang, Wenyi Hong, Xiaohan Zhang, Guanyu Feng, et al. Cogvideox: Text-to-video diffusion models with an expert transformer. arXiv preprint arXiv:2408.06072, 2024
2024 arXiv
-
[67]
Stablenormal: Reducing diffusion variance for stable and sharp normal
Chongjie Ye, Lingteng Qiu, Xiaodong Gu, Qi Zuo, Yushuang Wu, Zilong Dong, Liefeng Bo, Yuliang Xiu, and Xiaoguang Han. Stablenormal: Reducing diffusion variance for stable and sharp normal. ACM Transactions on Graphics (TOG), 2024
2024
-
[68]
Ip-adapter: Text compatible image prompt adapter for text-to-image diffusion models
Hu Ye, Jun Zhang, Sibo Liu, Xiao Han, and Wei Yang. Ip-adapter: Text compatible image prompt adapter for text-to-image diffusion models. arXiv preprint arXiv:2308.06721, 2023
2023 arXiv
-
[69]
Mvimgnet: A large-scale dataset of multi-view images
Xianggang Yu, Mutian Xu, Yidan Zhang, Haolin Liu, Chongjie Ye, Yushuang Wu, Zizheng Yan, Chenming Zhu, Zhangyang Xiong, Tianyou Liang, et al. Mvimgnet: A large-scale dataset of multi-view images. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognit...
2023
-
[70]
Paint3d: Paint anything 3d with lighting-less texture diffusion models
Xianfang Zeng, Xin Chen, Zhongqi Qi, Wen Liu, Zibo Zhao, Zhibin Wang, Bin Fu, Yong Liu, and Gang Yu. Paint3d: Paint anything 3d with lighting-less texture diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 4252--4262, 2024
2024
-
[71]
Adding conditional control to text-to-image diffusion models
Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Adding conditional control to text-to-image diffusion models. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 3836--3847, 2023
2023
-
[72]
Free3d: Consistent novel view synthesis without 3d representation
Chuanxia Zheng and Andrea Vedaldi. Free3d: Consistent novel view synthesis without 3d representation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 9720--9731, 2024
2024
-
[73]
Open-sora: Democratizing efficient video production for all, March 2024
Zangwei Zheng, Xiangyu Peng, Tianji Yang, Chenhui Shen, Shenggui Li, Hongxin Liu, Yukun Zhou, Tianyi Li, and Yang You. Open-sora: Democratizing efficient video production for all, March 2024. URL https://github.com/hpcaitech/Open-Sora
2024
-
[74]
@esa (Ref
\@ifxundefined[1] #1\@undefined \@firstoftwo \@secondoftwo \@ifnum[1] #1 \@firstoftwo \@secondoftwo \@ifx[1] #1 \@firstoftwo \@secondoftwo [2] @ #1 \@temptokena #2 #1 @ \@temptokena \@ifclassloaded agu2001 natbib The agu2001 class already includes natbib coding, so you should ...
-
[75]
\@lbibitem[] @bibitem@first@sw\@secondoftwo \@lbibitem[#1]#2 \@extra@b@citeb \@ifundefined br@#2\@extra@b@citeb \@namedef br@#2 \@nameuse br@#2\@extra@b@citeb \@ifundefined b@#2\@extra@b@citeb @num @parse #2 @tmp #1 NAT@b@open@#2 NAT@b@shut@#2 \@ifnum @merge>\@ne @bibitem@firs...
-
[76]
@open @close @open @close and [1] URL: #1 \@ifundefined chapter * \@mkboth \@ifxundefined @sectionbib * \@mkboth * \@mkboth\@gobbletwo \@ifclassloaded amsart * \@ifclassloaded amsbook * \@ifxundefined @heading @heading NAT@ctr thebibliography [1] @ \@biblabel @NAT@ctr \@bibset...
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.