Pith. sign in

REVIEW 3 major objections 5 minor 60 references

Controllable Human Image Generation with Personalized Multi-Garments

T0 review · 3 major / 5 minor · reviewed 2026-08-12 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read BootComp generates human images wearing multiple reference garments by bootstrapping synthetic training pairs from single-garment datasets, reporting a 30% improvement in garment fidelity over prior methods.

desk verdict BootComp's synthetic-data pipeline is a genuinely useful idea and the experiments back it up, but missing artifacts and an unquantified filter bias keep it from being settled. read the letter →

arxiv 2411.16801 v3 pith:UXOEQZPZ submitted 2024-11-25 cs.CV

Yisol Choi , Sangkyung Kwak , Sihyun Yu , Hyungwon Choi , Jinwoo Shin This is my paper · ORCID
classification cs.CV
keywords controllablehumanimagegenerationmulti-garmentconditioningdiffusionmodelssyntheticdatadecompositionnetworkDreamSimfilteringvirtualtry-onextendedself-attention
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

BootComp claims that the main obstacle to controllable human image generation with multiple reference garments is data, not architecture: no large dataset exists of humans paired with every garment they wear. The paper's solution is to bootstrap one: a decomposition network, trained only on easy-to-collect single-garment/human pairs, extracts a product-view image of each garment from any human photo, and a DreamSim-based filter discards low-quality extractions. Using the resulting 54K synthetic multi-garment pairs, BootComp fine-tunes a two-path diffusion model (a frozen generator plus a trained image encoder) to generate a human wearing all reference garments while preserving fine details. The paper reports a 30% improvement in MP-LPIPS over prior methods, and shows the same frozen generator can be paired with pose, style, face, and text conditions without additional fine-tuning. If correct, this makes multi-garment controllable generation trainable from data that already exists.

What carries the argument

The load-bearing mechanism is the decomposition network $f_\phi$: a text-to-image diffusion model fine-tuned with the objective in Eq. (1) to map a segmented garment $x_s = S(y,m)$ to a product-view garment image $x$, conditioned by the text prompt 'A product photo of {category}'. This single-garment model is what turns cheap single-pair datasets into the synthetic multi-garment dataset built from 240K human images. The second mechanism is the extended self-attention layer used in both modules, where key and value vectors of reference garment hidden states are concatenated with the target hidden states, injecting reference features into the generation path while the generator's weights stay frozen. The third mechanism is the filtering step: pairs are kept only when the DreamSim distance $d(x_s, \tilde{x})$ between the segment and the generated garment is below threshold $\tau = 0.4$, which the paper finds matches human perception better than LPIPS or CLIP scores.

What would settle it

On a test set with ground-truth garment photos (e.g., DressCode or VITON-HD test pairs), run the decomposition network on each human image and compare its generated garment images to the ground truth under the same DreamSim threshold; if a substantial share of accepted pairs (those with distance below 0.4) still show visible mismatches, or if removing the filter entirely leaves MP-LPIPS unchanged, the filtering strategy is not doing the load-bearing work the paper claims.

Watch

Extended reading notes

Core claim

On its own terms, BootComp's central discovery is that a model trained to produce a single product-style garment image from a segmented human photo can be repurposed as a data engine: applied to 240K human images, it yields synthetic pairs of one human with all worn garments, and filtering those pairs by DreamSim similarity keeps only the reliable ones. The composition module then learns the conditional distribution of a human image given multiple garment images by conditioning a frozen SDXL generator on garment features extracted by a second, trainable SDXL encoder whose key and value vectors are concatenated into the generator's self-attention layers. BootComp reports that this two-stage recipe lowers MP-LPIPS from 0.267 (Parts2Whole) and 0.276 (MIP-Adapter) to 0.187, while also improving DINO, M-DINO, and FID, and that the frozen generator makes pose-guided, stylized, and personalized generation available without task-specific fine-tuning.

Load-bearing premise

Everything rests on the decomposition network, trained only on single-garment/human pairs, producing a faithful product-style image of every garment it extracts from 240K human photos, and on the DreamSim threshold of 0.4 catching exactly the failures; if the network systematically distorts patterns or textures that DreamSim tolerates, the composition module is trained on silently corrupted data.

Editorial extensions

If this is right

  • Training on synthetic multi-garment pairs produced by the decomposition network yields better garment fidelity and image realism than training on directly segmented garment images (MP-LPIPS 0.197 vs 0.374 in the controlled comparison).
  • BootComp generalizes to garment categories and combinations that the single-pair training data did not emphasize, such as bags, shoes, and unusual pairings like swimsuits with soccer cleats.
  • Because the generator is frozen during training, BootComp can be combined with external condition adapters to add pose, style, face, or background control without fine-tuning for each task.
  • The filtering threshold matters: stricter DreamSim filtering consistently improves DINO similarity, so dataset quality, not just dataset size, is a main driver of performance.
  • Scaling the synthetic dataset monotonically improves both garment fidelity and FID (DINO rises from 0.337 at 5K to 0.360 at 50K pairs), supporting the claim that the bootstrapping pipeline is a scalable data source.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The decomposition-network bottleneck suggests that improving the human parser or training the decomposition module on more hat and accessory images would directly expand BootComp's reliable category coverage; the paper itself notes hats are the weak spot.
  • Because the filter is a binary gate at tau=0.4, it may be discarding hard-but-learnable examples (intricate patterns, inner layers) that a curriculum or a soft weighting scheme could exploit instead of discarding.
  • The same bootstrapping recipe should transfer to other multi-object conditioned generation tasks, given the paper's experiment showing the decomposition module can extract common objects from scene images into paired data.
  • The large gap between segmented and synthetic training pairs suggests that most of BootComp's gain comes from the data representation, not from the two-path architecture; an ablation that keeps the architecture fixed and varies only the data would test this directly.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper presents BootComp, a two-stage framework for controllable human image generation conditioned on multiple reference garment images. In the first stage, a decomposition network f_phi is trained on single-garment/human pairs to map a segmented garment from a person image into a product-view garment image. This network is applied to 240K human images to bootstrap synthetic multi-garment training pairs, which are then filtered by a DreamSim perceptual-similarity threshold (Eq. (2)). In the second stage, a composition module with two parallel diffusion paths (a frozen generator and a trainable image encoder) is trained on the 54K surviving synthetic pairs to generate human images while preserving garment details. Experiments on DressCode, VITON-HD, and DeepFashion report improvements over MIP-Adapter and Parts2Whole on MP-LPIPS, DINO, M-DINO, and FID, and qualitative results demonstrate applications such as virtual try-on, pose control, stylization, and text-driven generation.

Significance. If the empirical claims hold, BootComp addresses a real bottleneck: the lack of large-scale paired data of humans wearing multiple garments. The idea of bootstrapping such data with a learned decomposition network plus perceptual filtering is novel and potentially impactful beyond fashion, as the appendix suggests (MVImgNet extension). The paper provides useful ablations showing that synthetic data outperforms segmented data and that dataset scale improves performance. The main strengths are the clear two-stage formulation, the model-agnostic design, and the breadth of demonstrated applications. However, the significance is tempered by the lack of statistical validation for the main quantitative results and by an unvalidated filtering step that is central to the data pipeline.

major comments (3)
  1. [Section 3.1, Eq. (2)] The DreamSim filter compares the generated product view \tilde{x} with the same segmentation x_s that was used as input to the decomposition network. When the human parsing model S is incorrect, the segmentation and the generated image share the same corruption, so a hallucinated product view can achieve d(x_s, \tilde{x}) < τ and be accepted by the filter. The paper reports that only 54K of 240K pairs survive filtering, so the filter is doing substantial work, but it provides no estimate of the false-accept rate. This is load-bearing because the synthetic dataset quality is the core of the method. I request a concrete validation: manually inspect a random sample (e.g., 100–200 pairs) of accepted synthetic pairs, or use an independent parsing/verification method, and report the fraction of accepted pairs where the generated garment does not actually correspond to the garment worn in the human image. This would quantify the risk that the composition module is trained on corrupted conditioning data.
  2. [Table 1] No error bars, confidence intervals, or significance tests are reported for any of the four metrics. The improvement over Parts2Whole on DINO (0.379 vs. 0.362) and FID (27.63 vs. 28.39) is small, and without uncertainty estimates it is unclear whether these differences are statistically meaningful. The central claim that BootComp outperforms both baselines on all four metrics would be strengthened by reporting standard deviations over at least three random seeds or a paired bootstrap test. This is especially important given that the FID gap over Parts2Whole is about 2.7%, which could easily arise from random variation.
  3. [Section 4.3] All ablations (Tables 2–4) are conducted with Stable Diffusion v1.5, while the main experiments use SDXL. In particular, the threshold τ=0.4 in Table 4 is selected on SD1 and then applied to the SDXL-based composition module. The paper should justify that the optimal threshold transfers across backbone models, or repeat the threshold ablation with SDXL. The monotonic improvement with stricter filtering suggests the exact value may not be critical, but the choice of τ is a free parameter and its sensitivity on the actual backbone should be reported for reproducibility.
minor comments (5)
  1. [Section 4.1] The evaluation protocol for MP-LPIPS, DINO, and M-DINO is under-specified. Please clarify how the 5,000 garment sets are paired with human images, what the conditioning and ground-truth inputs are, and how the metrics are computed (e.g., which regions of the generated image are compared with the reference garments).
  2. [Section 4.1] The FID evaluation uses 30,000 human images from test sets, but the paper does not state whether these images overlap with the 240K images used for synthetic data generation. Please explicitly confirm that the training (including the synthetic data generation) and evaluation splits are disjoint to avoid potential data leakage.
  3. [Appendix A.3] The dual-condition CFG formula defines two guidance scales wc and wg, but Section 4.1 mentions only a single guidance scale w=2.0. Please clarify whether wc=wg=2.0 is used in all experiments and report the values in the main text.
  4. [Section 3.1] In Eq. (2), the filtering criterion is written as an inequality but is labeled as an equation. Consider labeling it as a filtering condition or inequality to avoid confusion.
  5. [Section 5] The related work section refers to the baseline as 'FromParts2Whole', but the reference [16] is titled 'From Parts to Whole'. Please ensure consistent naming throughout.

Circularity Check

0 steps flagged · score 1.0 of 10

No substantive circularity: the core claims rest on an external benchmark chain, not on a self-referential reduction.

full rationale

BootComp's derivation is empirical and self-contained: the decomposition network f_phi is trained on real single-garment/human pairs (Eq. 1); it bootstraps synthetic multi-garment pairs; the DreamSim filter (Eq. 2) removes low-quality extractions; the composition module is trained on the surviving pairs (Eq. 4); and the main claims are measured against external reference garments from DressCode/VITON-HD/DeepFashion with held-out metrics (MP-LPIPS, DINO, M-DINO, FID). No equation-level prediction reduces to a fitted parameter or to a self-citation. The DreamSim filter compares the generated product view with the segmentation used to generate it, so a systematic segmentation error can in principle pass filtering; however, this is a data-quality assumption and a recognized limitation (Fig. 5, Appendix B), not a circular derivation of the reported results. The paper cites its own prior work [6, 24] only in related-work context and does not use a self-citation to justify the central claim. Score 1 reflects the absence of load-bearing circularity despite a minor non-load-bearing self-citation.

Assumptions & free parameters 2 free parameters · 5 assumptions · 0 invented entities

The central claim rests on the decomposition network's ability to produce trustworthy garment images from segmented regions, the DreamSim filter's ability to identify failures, and the extended self-attention conditioning's ability to transfer multiple garments into a frozen generator. These are all learned or empirical assumptions; the paper provides no formal guarantee. No novel physical entities are introduced.

free parameters (2)
  • DreamSim filtering threshold tau = 0.4
    Chosen by visual inspection of DreamSim distances in Appendix B and ablated in Table 4; it directly determines which 54K of 240K synthetic pairs are kept for training.
  • Classifier-free guidance scales wc and wg = wc=2.0, wg=2.0
    Sampling hyperparameters fixed for all experiments in Appendix A.3; they trade text adherence against garment image adherence and affect all reported generation results.
assumptions (5)
  • domain assumption The decomposition network f_phi, initialized from SDXL and trained with Eq.(1), can translate a segmented garment region into a faithful product-view garment image.
    The entire synthetic dataset is built from this mapping, and the paper only validates it indirectly through final generation metrics and visual inspection in Section 3.1 and Appendix B.
  • domain assumption SegFormer-based human parsing S provides accurate enough garment segments xs for all categories in the data generation phase.
    Segmentation errors are cited as the main cause of low-quality decomposition outputs, so the pipeline relies on S being correct sufficiently often, as noted in Section 3.1 and Fig.5.
  • domain assumption DreamSim distance is a valid proxy for whether the extracted garment matches the garment worn in the human image.
    The filtering threshold tau is defined on DreamSim distances; the choice is justified qualitatively in Appendix B, not by a quantitative calibration against human labels.
  • domain assumption The paired datasets VITON-HD, DressCode, and LAION-Fashion contain correct single-reference garment and human image correspondences.
    These pairs are the only supervision for the decomposition module; any systematic misalignment would propagate into the synthetic dataset, as described in Section A.2.
  • domain assumption Injecting reference garment hidden states into the self-attention key and value of a frozen generator, as in Eq.(3), can condition generation on an arbitrary number of garments without retraining the generator.
    This is the architectural premise of the composition module; its validity is shown only empirically in Section 4.2.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Controllable Human Image Generation with Personalized Multi-Garments." pith.science (2026). https://pith.science/paper/UXOEQZPZ

@misc{pith2026241116801,
  author       = {Pith},
  title        = {Pith review of: Controllable Human Image Generation with Personalized Multi-Garments},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/UXOEQZPZ}},
  note         = {Machine review of arXiv:2411.16801}
}
read the original abstract

We present BootComp, a novel framework based on text-to-image diffusion models for controllable human image generation with multiple reference garments. Here, the main bottleneck is data acquisition for training: collecting a large-scale dataset of high-quality reference garment images per human subject is quite challenging, i.e., ideally, one needs to manually gather every single garment photograph worn by each human. To address this, we propose a data generation pipeline to construct a large synthetic dataset, consisting of human and multiple-garment pairs, by introducing a model to extract any reference garment images from each human image. To ensure data quality, we also propose a filtering strategy to remove undesirable generated data based on measuring perceptual similarities between the garment presented in human image and extracted garment. Finally, by utilizing the constructed synthetic dataset, we train a diffusion model having two parallel denoising paths that use multiple garment images as conditions to generate human images while preserving their fine-grained details. We further show the wide-applicability of our framework by adapting it to different types of reference-based generation in the fashion domain, including virtual try-on, and controllable human image generation with other conditions, e.g., pose, face, etc.

Figures

Figures reproduced from arXiv: 2411.16801 by the authors.

Figure 1
Figure 1. Generated images by BootComp. (a) BootComp generates high-quality human images wearing multiple reference garments, with support for extended categories such as bag, shoes, even in unusual garment combinations (e.g., swimming suit with soccer cleats). We show BootComp’s generalization capability through various conditional image generations, such as (b) virtual try-on, (c) pose guided generation, (d) stylization, an… view at source ↗
Figure 2
Figure 2. Limitations of previous data curation approaches used in controllable generation. Previous approaches on controllable generation often use a paired dataset consisting of low-quality segmented garments and human images for training. It leads to several undesirable artifacts as shown in right (generated with baselines). For example, garments are directly replicated from the reference images in (a), shirts and skirts a… view at source ↗
Figure 3
Figure 3. Overview of BootComp. We propose a two-stage framework: synthetic data generation and composition module training for controllable human image generation. (a) We train a decomposition network that maps from a segmented garment image to a product garment image. (b) We bootstrap synthetic paired data of human and multiple garment images. (c) We finally train our composition module with the synthetic paired dataset ena… view at source ↗
Figures from the paper (14 more)
Figure 4
Figure 4. Figure 4: Extended self-attention architecture. In a extended self-attention layer, reference hidden states are concatenated with the target hidden states in the key and value matrices. This archi￾tecture enables injecting reference image features within the target image. Note t…
Figure 5
Figure 5. Figure 5: Examples of high&low-quality generated garments. When human parsing results are not precise, the decomposition network struggles to generate product garment images accurately, resulting in low-quality garment images. We filter out these cases. are initialized with the …
Figure 6
Figure 6. Figure 6: Qualitative comparison of human image generation with multiple garments. BootComp generates realistic human images with multiple reference garments even with non-straightforward combinations of garments without losing details of each reference. For example, Parts2Whole…
Figure 7
Figure 7. Figure 7: More applications of BootComp. We showcase the extensive applications of our method, BootComp. BootComp creates human images by controlling the (a) poses and (b) styles of the generated human images. BootComp also enables (c) personalized human image generation by taki…
Figure 8
Figure 8. Figure 8: Visualization of segmented paired data and our syn￾thetic paired data. We provide a visual comparison between seg￾mented and synthetic pairs. Given a single garment and a human image pair, we segment out other garments from the human image in the segmented paired data …
Figure 9
Figure 9. Figure 9: Visual comparison on data construction methods. Vi￾sual comparison between generated human images where each model is trained on segmented and synthetic pairs. The model trained on segmented pair data struggles to generate naturally har￾monized human images (red) [PIT…
Figure 10
Figure 10. Figure 10: Examples of training data for decomposition mod￾ule. We collect pairs of a human image and a single reference gar￾ment image from public datasets including VITON-HD, Dress￾Code, and LAION-Fashion. It consists of various garments in dif￾ferent categories, e.g., shirts,…
Figure 11
Figure 11. Figure 11: Examples of pairs filtered out by different similar￾ity metrics. We present examples of generated garment images and their corresponding human images that were excluded based on various image similarity metrics. Using LPIPS, garments with complicated patterns are filt…
Figure 13
Figure 13. Figure 13: Examples of our synthetic paired data. We visualize our synthetic pairs of a human image and multiple garment im￾ages. Our decomposition module generates high-quality garment images in product view on different categories including shirts, pants, shoes and bags [PITH…
Figure 14
Figure 14. Figure 14: Examples of synthetic paired data generated by the decomposition module trained on MVImgNet [55]. We show the potential extension of our decomposition module to the general domain. Given an image containing common objects such as cups, chairs, and broccoli, the decomp…
Figure 16
Figure 16. Figure 16: Limitations of BootComp. BootComp struggles on naturally dressing hats and preserving tiny details like letters [PITH_FULL_IMAGE:figures/full_fig_p015_16.png]
Figure 17
Figure 17. Figure 17: More qualitative comparisons. BootComp generates realistic human images wearing multiple reference garments, faithfully preserving fine-details of each garment, while baselines often generate inconsistent garment images and blend reference garments [PITH_FULL_IMAGE:f…
Figure 18
Figure 18. Figure 18: Generated human images by BootComp. BootComp can realistically dress humans with diverse categories of garments, including bags and shoes, which are not available for previous approaches. BootComp is capable of dressing complex combinations such as jackets and inner l…
Figure 19
Figure 19. Figure 19: Application results by BootComp. BootComp is capable of generating human images with various conditions. By using structural conditions, it can control poses in the generated images. With text prompts, BootComp can manipulate the backgrounds of images. Additionally, i…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

60 extracted references · 31 canonical work pages

  1. [1]

    In- structpix2pix: Learning to follow image editing instructions

    Tim Brooks, Aleksander Holynski, and Alexei A Efros. In- structpix2pix: Learning to follow image editing instructions. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 18392–18402, 2023. 2, 8, 1

    work page 2023

  2. [2]

    Wear-any-way: Manip- ulable virtual try-on via sparse correspondence alignment

    Mengting Chen, Xi Chen, Zhonghua Zhai, Chen Ju, Xuewen Hong, Jinsong Lan, and Shuai Xiao. Wear-any-way: Manip- ulable virtual try-on via sparse correspondence alignment. In European Conference on Computer Vision, 2024. 8

    work page 2024

  3. [3]

    Magic clothing: Controllable garment-driven image synthe- sis

    Weifeng Chen, Tao Gu, Yuhao Xu, and Chengcai Chen. Magic clothing: Controllable garment-driven image synthe- sis. arXiv preprint arXiv:2404.09512, 2024. 3, 5, 8

    arXiv 2024

  4. [4]

    Anydoor: Zero-shot object-level im- age customization

    Xi Chen, Lianghua Huang, Yu Liu, Yujun Shen, Deli Zhao, and Hengshuang Zhao. Anydoor: Zero-shot object-level im- age customization. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 6593–6602, 2023. 2

    work page 2023

  5. [5]

    Viton-hd: High-resolution virtual try-on via misalignment-aware normalization

    Seunghwan Choi, Sunghyun Park, Minsoo Lee, and Jaegul Choo. Viton-hd: High-resolution virtual try-on via misalignment-aware normalization. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021. 2, 5, 8

    work page 2021

  6. [6]

    Improving diffusion models for au- thentic virtual try-on in the wild

    Yisol Choi, Sangkyung Kwak, Kyungmin Lee, Hyungwon Choi, and Jinwoo Shin. Improving diffusion models for au- thentic virtual try-on in the wild. InEuropean Conference on Computer Vision, 2024. 2, 8

    work page 2024

  7. [7]

    Scaling recti- fied flow transformers for high-resolution image synthesis

    Patrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari, Jonas M ¨uller, Harry Saini, Yam Levi, Dominik Lorenz, Axel Sauer, Frederic Boesel, et al. Scaling recti- fied flow transformers for high-resolution image synthesis. In Forty-first International Conference on Machine Learn- ing, 2024. 2, 3

    2024

  8. [8]

    Dream- sim: Learning new dimensions of human visual similarity us- ing synthetic data

    Stephanie Fu, Netanel Tamir, Shobhita Sundaram, Lucy Chai, Richard Zhang, Tali Dekel, and Phillip Isola. Dream- sim: Learning new dimensions of human visual similarity us- ing synthetic data. Advances in Neural Information Process- ing Systems, 36, 2024. 4

    work page 2024

Show all 60 references
  1. [9]

    Lcm- lookahead for encoder-based text-to-image personalization

    Rinon Gal, Or Lichter, Elad Richardson, Or Patashnik, Amit H Bermano, Gal Chechik, and Daniel Cohen-Or. Lcm- lookahead for encoder-based text-to-image personalization. arXiv preprint arXiv:2404.03620, 2024. 8

    2024 arXiv

  2. [10]

    Prompt-to-prompt image editing with cross attention control

    Amir Hertz, Ron Mokady, Jay Tenenbaum, Kfir Aberman, Yael Pritch, and Daniel Cohen-Or. Prompt-to-prompt image editing with cross attention control. In International Confer- ence on Learning Representations, 2023. 2

    2023

  3. [11]

    Style aligned image generation via shared atten- tion

    Amir Hertz, Andrey V oynov, Shlomi Fruchter, and Daniel Cohen-Or. Style aligned image generation via shared atten- tion. In Proceedings of the IEEE/CVF Conference on Com- puter Vision and Pattern Recognition , pages 4775–4785,

  4. [12]

    Gans trained by a two time-scale update rule converge to a local nash equilib- rium

    Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. Gans trained by a two time-scale update rule converge to a local nash equilib- rium. Advances in neural information processing systems , 30, 2017. 5

    2017

  5. [13]

    Classifier-free diffusion guidance

    Jonathan Ho and Tim Salimans. Classifier-free diffusion guidance. arXiv preprint arXiv:2207.12598, 2022. 5, 1

    2022 arXiv

  6. [14]

    Denoising dif- fusion probabilistic models

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising dif- fusion probabilistic models. Advances in neural information processing systems, 33:6840–6851, 2020. 3, 5, 1

    2020

  7. [15]

    Resolving multi-condition confusion for finetuning-free personalized image generation

    Qihan Huang, Siming Fu, Jinlong Liu, Hao Jiang, Yipeng Yu, and Jie Song. Resolving multi-condition confusion for finetuning-free personalized image generation. arXiv preprint arXiv:2409.17920, 2024. 2, 5, 6

    2024 arXiv

  8. [16]

    From parts to whole: A unified reference framework for controllable human image generation

    Zehuan Huang, Hongxing Fan, Lipeng Wang, and Lu Sheng. From parts to whole: A unified reference framework for controllable human image generation. arXiv preprint arXiv:2404.15267, 2024. 2, 5, 6, 8

    2024 arXiv

  9. [17]

    Estimation of non- normalized statistical models by score matching

    Aapo Hyv ¨arinen and Peter Dayan. Estimation of non- normalized statistical models by score matching. Journal of Machine Learning Research, 6(4), 2005. 3

    2005

  10. [18]

    Identity decoupling for multi-subject per- sonalization of text-to-image models

    Sangwon Jang, Jaehyeong Jo, Kimin Lee, and Sung Ju Hwang. Identity decoupling for multi-subject per- sonalization of text-to-image models. arXiv preprint arXiv:2404.04243, 2024. 8

    2024 arXiv

  11. [19]

    Elucidating the design space of diffusion-based generative models

    Tero Karras, Miika Aittala, Timo Aila, and Samuli Laine. Elucidating the design space of diffusion-based generative models. In Advances in neural information processing sys- tems, pages 26565–26577, 2022. 3

    2022

  12. [20]

    Analyzing and improving the training dynamics of diffusion models

    Tero Karras, Miika Aittala, Jaakko Lehtinen, Janne Hellsten, Timo Aila, and Samuli Laine. Analyzing and improving the training dynamics of diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024. 3

    2024

  13. [21]

    Stableviton: Learning semantic correspon- dence with latent diffusion model for virtual try-on

    Jeongho Kim, Guojung Gu, Minho Park, Sunghyun Park, and Jaegul Choo. Stableviton: Learning semantic correspon- dence with latent diffusion model for virtual try-on. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8176–8185, 2024. 2, 8

    2024

  14. [22]

    Adam: A method for stochastic optimization

    Diederik P Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 ,

    arXiv

  15. [23]

    Large-scale text-to-image gen- eration models for visual artists’ creative works

    Hyung-Kwon Ko, Gwanmo Park, Hyeon Jeon, Jaemin Jo, Juho Kim, and Jinwook Seo. Large-scale text-to-image gen- eration models for visual artists’ creative works. InProceed- ings of the 28th international conference on intelligent user interfaces, 2023. 2

    2023

  16. [24]

    Direct consistency optimization for robust customiza- tion of text-to-image diffusion models

    Kyungmin Lee, Sangkyung Kwak, Kihyuk Sohn, and Jinwoo Shin. Direct consistency optimization for robust customiza- tion of text-to-image diffusion models. Advances in neural information processing systems, 2024. 2

    2024

  17. [25]

    Lrvs- fashion: Extending visual search with referring instructions

    Simon Lepage, J ´er´emie Mary, and David Picard. Lrvs- fashion: Extending visual search with referring instructions. arXiv:2306.02928, 2023. 2, 5

    2023 arXiv

  18. [26]

    Blip-diffusion: Pre-trained subject representation for controllable text-to- image generation and editing

    Dongxu Li, Junnan Li, and Steven CH Hoi. Blip-diffusion: Pre-trained subject representation for controllable text-to- image generation and editing. In Advances in Neural Infor- mation Processing Systems, 2023. 8

    2023

  19. [27]

    Gligen: Open-set grounded text-to-image generation

    Yuheng Li, Haotian Liu, Qingyang Wu, Fangzhou Mu, Jian- wei Yang, Jianfeng Gao, Chunyuan Li, and Yong Jae Lee. Gligen: Open-set grounded text-to-image generation. InPro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 22511–22521, 2023. 8

    2023

  20. [28]

    Microsoft coco: Common objects in context

    Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Doll´ar, and C Lawrence Zitnick. Microsoft coco: Common objects in context. In Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceeding...

    2014

  21. [29]

    Visual instruction tuning

    Haotian Liu, Chunyuan Li, Qingyang Wu, and Yong Jae Lee. Visual instruction tuning. Advances in Neural Information Processing Systems, 36, 2023. 5

    2023

  22. [30]

    Deepfashion: Powering robust clothes recognition and retrieval with rich annotations

    Ziwei Liu, Ping Luo, Shi Qiu, Xiaogang Wang, and Xiaoou Tang. Deepfashion: Powering robust clothes recognition and retrieval with rich annotations. In Proceedings of IEEE Con- ference on Computer Vision and Pattern Recognition, 2016. 5

    2016

  23. [31]

    Sdedit: Guided image synthesis and editing with stochastic differential equations

    Chenlin Meng, Yutong He, Yang Song, Jiaming Song, Jiajun Wu, Jun-Yan Zhu, and Stefano Ermon. Sdedit: Guided image synthesis and editing with stochastic differential equations. arXiv preprint arXiv:2108.01073, 2021. 2

    2021 arXiv

  24. [32]

    Dress code: High- resolution multi-category virtual try-on

    Davide Morelli, Matteo Fincato, Marcella Cornia, Federico Landi, Fabio Cesari, and Rita Cucchiara. Dress code: High- resolution multi-category virtual try-on. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 2231–2235, 2022. 2, 5, 6, 8

    2022

  25. [33]

    LaDI- VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-On

    Davide Morelli, Alberto Baldrati, Giuseppe Cartella, Mar- cella Cornia, Marco Bertini, and Rita Cucchiara. LaDI- VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-On. In Proceedings of the ACM International Confer- ence on Multimedia, 2023. 2

    2023

  26. [34]

    Compositional text-to-image gen- eration with dense blob representations

    Weili Nie, Sifei Liu, Morteza Mardani, Chao Liu, Benjamin Eckart, and Arash Vahdat. Compositional text-to-image gen- eration with dense blob representations. In International Conference on Machine Learning, 2024. 2

    2024

  27. [35]

    Compositional text-to-image generation with dense blob representations

    Weili Nie, Sifei Liu, Morteza Mardani, Chao Liu, Benjamin Eckart, and Arash Vahdat. Compositional text-to-image generation with dense blob representations. arXiv preprint arXiv:2405.08246, 2024. 8

    2024 arXiv

  28. [36]

    Maxime Oquab, Timoth ´ee Darcet, Th´eo Moutakanni, Huy V . V o, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel HAZIZA, Francisco Massa, Alaaeldin El-Nouby, Mido Assran, Nicolas Ballas, Wojciech Galuba, Russell Howes, Po-Yao Huang, Shang-Wen Li, Ishan Misra, Michael ...

    2024

  29. [37]

    Kosmos-G: Generating images in context with multimodal large language models

    Xichen Pan, Li Dong, Shaohan Huang, Zhiliang Peng, Wenhu Chen, and Furu Wei. Kosmos-G: Generating images in context with multimodal large language models. In Inter- national Conference on Learning Representations, 2024. 2, 8

    2024

  30. [38]

    Full-body virtual try-on using top and bottom garments with wearing style control

    Soonchan Park and Jinah Park. Full-body virtual try-on using top and bottom garments with wearing style control. Com- puter Vision and Image Understanding , 251:104259, 2025. 8

    2025

  31. [39]

    Sdxl: Improving latent diffusion models for high-resolution image synthesis

    Dustin Podell, Zion English, Kyle Lacey, Andreas Blattmann, Tim Dockhorn, Jonas M ¨uller, Joe Penna, and Robin Rombach. Sdxl: Improving latent diffusion models for high-resolution image synthesis. International Conference on Learning Representations, 2024. 2, 3, 5

    2024

  32. [40]

    Learn- ing transferable visual models from natural language super- vision

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learn- ing transferable visual models from natural language super- vision. In International Conference on Machine Learning...

    2021

  33. [41]

    Exploring the limits of transfer learning with a unified text-to-text transformer

    Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of machine learning research, 21(140):1–67, 2020. 3

    2020

  34. [42]

    High-resolution image synthesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj ¨orn Ommer. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10684–10695, 2022. 2, 3

    2022

  35. [43]

    Dreambooth: Fine tuning text-to-image diffusion models for subject-driven generation

    Nataniel Ruiz, Yuanzhen Li, Varun Jampani, Yael Pritch, Michael Rubinstein, and Kfir Aberman. Dreambooth: Fine tuning text-to-image diffusion models for subject-driven generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023. 2, 8, 3

    2023

  36. [44]

    Photorealistic text-to-image diffusion models with deep language understanding

    Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily L Denton, Kamyar Ghasemipour, Raphael Gontijo Lopes, Burcu Karagol Ayan, Tim Salimans, et al. Photorealistic text-to-image diffusion models with deep language understanding. Advances in neural information...

    2022

  37. [45]

    Imagdressing-v1: Customizable virtual dressing

    Fei Shen, Xin Jiang, Xin He, Hu Ye, Cong Wang, Xiaoyu Du, Zechao Li, and Jinhui Tang. Imagdressing-v1: Customizable virtual dressing. arXiv preprint arXiv:2407.12705, 2024. 8

    2024 arXiv

  38. [46]

    Deep unsupervised learning using nonequilibrium thermodynamics

    Jascha Sohl-Dickstein, Eric Weiss, Niru Maheswaranathan, and Surya Ganguli. Deep unsupervised learning using nonequilibrium thermodynamics. In International confer- ence on machine learning, pages 2256–2265. PMLR, 2015. 3

    2015

  39. [47]

    Score-based generative modeling through stochastic differential equa- tions

    Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Ab- hishek Kumar, Stefano Ermon, and Ben Poole. Score-based generative modeling through stochastic differential equa- tions. arXiv preprint arXiv:2011.13456, 2020. 3

    2011 arXiv

  40. [48]

    Ms-diffusion: Multi-subject zero-shot im- age personalization with layout guidance

    X Wang, Siming Fu, Qihan Huang, Wanggui He, and Hao Jiang. Ms-diffusion: Multi-subject zero-shot im- age personalization with layout guidance. arXiv preprint arXiv:2406.07209, 2024. 2, 5, 8

    2024 arXiv

  41. [49]

    Stylediffusion: Controllable disentangled style transfer via diffusion models

    Zhizhong Wang, Lei Zhao, and Wei Xing. Stylediffusion: Controllable disentangled style transfer via diffusion models. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 7677–7689, 2023. 2

    2023

  42. [50]

    Objectdrop: Bootstrap- ping counterfactuals for photorealistic object removal and in- sertion

    Daniel Winter, Matan Cohen, Shlomi Fruchter, Yael Pritch, Alex Rav-Acha, and Yedid Hoshen. Objectdrop: Bootstrap- ping counterfactuals for photorealistic object removal and in- sertion. arXiv preprint arXiv:2403.18818, 2024. 8

    2024 arXiv

  43. [51]

    Freeman, Fr ´edo Durand, and Song Han

    Guangxuan Xiao, Tianwei Yin, William T. Freeman, Fr ´edo Durand, and Song Han. Fastcomposer: Tuning-free multi- subject image generation with localized attention. Interna- tional Journal of Computer Vision, 2024. 8

    2024

  44. [52]

    Omnigen: Unified image generation

    Shitao Xiao, Yueze Wang, Junjie Zhou, Huaying Yuan, Xin- grun Xing, Ruiran Yan, Shuting Wang, Tiejun Huang, and Zheng Liu. Omnigen: Unified image generation. arXiv preprint arXiv:2409.11340, 2024. 3

    2024 arXiv

  45. [53]

    Segformer: Simple and effi- cient design for semantic segmentation with transformers

    Enze Xie, Wenhai Wang, Zhiding Yu, Anima Anandkumar, Jose M Alvarez, and Ping Luo. Segformer: Simple and effi- cient design for semantic segmentation with transformers. In Advances in neural information processing systems, 2021. 4

    2021

  46. [54]

    Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models

    Hu Ye, Jun Zhang, Sibo Liu, Xiao Han, and Wei Yang. Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models. arXiv preprint arxiv:2308.06721 ,

    arXiv

  47. [55]

    Mvimgnet: A large-scale dataset of multi-view images

    Xianggang Yu, Mutian Xu, Yidan Zhang, Haolin Liu, Chongjie Ye, Yushuang Wu, Zizheng Yan, Chenming Zhu, Zhangyang Xiong, Tianyou Liang, et al. Mvimgnet: A large-scale dataset of multi-view images. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognit...

    2023

  48. [56]

    Jedi: Joint- image diffusion models for finetuning-free personalized text- to-image generation

    Yu Zeng, Vishal M Patel, Haochen Wang, Xun Huang, Ting- Chun Wang, Ming-Yu Liu, and Yogesh Balaji. Jedi: Joint- image diffusion models for finetuning-free personalized text- to-image generation. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recogni...

    2024

  49. [57]

    Adding conditional control to text-to-image diffusion models

    Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Adding conditional control to text-to-image diffusion models. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 3836–3847, 2023. 7

    2023

  50. [58]

    Mmtryon: Multi-modal multi-reference control for high-quality fashion generation

    Xujie Zhang, Ente Lin, Xiu Li, Yuxuan Luo, Michael Kampffmeyer, Xin Dong, and Xiaodan Liang. Mmtryon: Multi-modal multi-reference control for high-quality fashion generation. arXiv preprint arXiv:2405.00448, 2024. 8

    2024 arXiv

  51. [59]

    Tryondiffusion: A tale of two un- ets

    Luyang Zhu, Dawei Yang, Tyler Zhu, Fitsum Reda, William Chan, Chitwan Saharia, Mohammad Norouzi, and Ira Kemelmacher-Shlizerman. Tryondiffusion: A tale of two un- ets. In Proceedings of the IEEE/CVF Conference on Com- puter Vision and Pattern Recognition (CVPR), pages 4606– 4615, 2023

    2023

  52. [60]

    … in front of the Eiffel Tower

    Luyang Zhu, Yingwei Li, Nan Liu, Hao Peng, Dawei Yang, and Ira Kemelmacher-Shlizerman. M&m vto: Multi-garment virtual try-on and editing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024. 8 Controllable Human Image Generation wi...

    2024

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.