Pith. sign in

REVIEW 4 major objections 7 minor 14 cited by

Insert Anything: Image Insertion via In-Context Editing in DiT

T0 review · 4 major / 7 minor · reviewed 2026-08-16 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read A single diffusion-transformer model, trained once on 120K prompt-image pairs, can insert any object from a reference photo into a target scene under mask or text control, and outperforms task-specific and unified alternatives on person…

desk verdict The dataset and mask-prompt results are solid and worth referee time; the text-prompt half of the claim rests on a circular benchmark that should be redone before publication. read the letter →

arxiv 2504.15009 v1 pith:326CZJQ3 submitted 2025-04-21 cs.CV

Wensong Song , Hong Jiang , Zongxing Yang , Ruijie Quan , Yi Yang This is my paper · ORCID
classification cs.CV
keywords imageinsertionreference-basededitingin-contextdiffusiontransformerpolyptychpromptingAnydatasetvirtualtry-onmulti-modalcontrol
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper seeks to establish that image insertion—taking an object, person, or garment from one photograph and placing it into another—can be solved by one model rather than by a collection of task-specific systems. It introduces Insert Anything, a framework trained once on a new dataset of 120K prompt-image pairs (AnyInsertion) that covers person, object, and garment insertion under both mask and text control. On the AnyInsertion, DreamBooth, and VTON-HD benchmarks, the authors report that this single model outperforms all compared alternatives, including specialized try-on models and unified editing frameworks, across every reported metric. A sympathetic reader would take the paper's contribution to be a shared architecture and prompting scheme for the whole insertion problem, with a public dataset to support it.

What carries the argument

The load-bearing mechanism is polyptych in-context editing within a DiT: the reference image, with background removed, is concatenated in the channel dimension with the masked source (diptych) or with the source plus an empty panel (triptych), and the binary mask is appended as an extra channel. These visual tokens enter the image branch of the transformer while CLIP image features from the reference and T5 text features enter the text branch; multimodal attention then lets the generated region draw on both. This design treats the reference as context rather than as a separate conditioning stream, which the paper argues preserves high-frequency identity details while harmonizing style, color, and texture with the target scene. The whole model is a LoRA fine-tune of the FLUX.1 Fill inpainting model, so the training and inference pipeline is comparatively light.

What would settle it

Assemble a text-prompt test set of 50 to 100 pairs in which the source image is an unmodified real photograph, with edit instructions written by humans rather than synthesized by FLUX.1 Fill, and compute Insert Anything's LPIPS and FID against AnyEdit on this set; if the reported advantage disappears or reverses, the claim that the model generalizes across text-prompt insertion scenes is refuted.

Watch

Extended reading notes

Core claim

The paper's central claim is that a diffusion transformer (DiT) can act as a universal insertion engine when it is fine-tuned on a mixed insertion dataset and fed a 'polyptych' of images. For mask-guided insertion, the input is a diptych that places the background-segmented reference image beside the partially masked source image; for text-guided insertion, it is a triptych of reference, source, and an empty target panel. Multimodal attention inside the DiT jointly attends to text, mask, and image tokens, so the same weights handle both control modes. The paper reports that this approach, without auxiliary modules such as ControlNet, beats AnyDoor, MimicBrush, and ACE++ on mask-guided object and person insertion, AnyEdit on text-guided insertion, and CatVTON and OOTDiffusion on garment insertion, including on the standard VTON-HD benchmark.

Load-bearing premise

The load-bearing premise is that the text-prompt training and evaluation data—whose source images were generated by FLUX.1 Fill, the same model Insert Anything is a LoRA fine-tune of—are representative of real user scenes; if they are not, the reported text-prompt gains may measure how well the model reproduces its base model's outputs rather than how well it generalizes.

Editorial extensions

If this is right

  • A single trained model can replace separate systems for person, object, and garment insertion, so downstream applications such as virtual try-on, scene composition, and content creation need not train or maintain several editing models.
  • The same model accepts either a mask or a text description as control, giving users the choice of specifying where to insert an element geometrically or describing the change in language.
  • Because the method requires no auxiliary networks like ControlNet, its weight footprint and inference graph are simpler than those of prior insertion systems while the reported quality is higher.
  • The AnyInsertion dataset, with roughly 160K training pairs at 1–2K resolution across both prompt types, provides a common training and evaluation ground for future unified insertion research.
  • On VTON-HD, a general insertion model outperforms dedicated virtual try-on models, suggesting that unification does not sacrifice task-specific quality.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the text-prompt results hold up on non-synthetic sources, the polyptych formulation could be transferred to other in-context editing problems, such as multi-object insertion or exemplar-based style transfer, by simply rearranging the panels.
  • The paper presents adaptive crop-and-zoom only as an inference-time trick; one could test whether training the same model with a scale-augmented objective would make the trick unnecessary.
  • Since the model is built on FLUX.1 Fill, its strong text-prompt performance might partly stem from reproducing that base model's own editing behavior; a clean ablation would retrain the LoRA on a different DiT inpainting base and compare.
  • The authors' future-work list (physics-aware constraints, mixture-of-experts, more conditioning types) suggests the next practical ceiling is physical plausibility rather than identity fidelity; a concrete extension would add a contact or depth consistency loss during training.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 7 minor

Summary. The paper proposes Insert Anything, a unified framework for reference-based image insertion built on FLUX.1 Fill by fine-tuning with LoRA. The method supports two control modes, mask-prompt and text-prompt, through two in-context prompting layouts: a mask-prompt diptych and a text-prompt triptych. The authors introduce a new dataset, AnyInsertion, containing mask- and text-prompt pairs for person, object, and garment insertion, and evaluate the trained model on AnyInsertion, DreamBooth, and VTON-HD against task-specific and unified baselines. The main claims are that a single model handles multiple insertion tasks under two control modes and consistently outperforms existing alternatives. The mask-prompt experiments use real paired images and independent benchmarks, while the text-prompt experiment relies on synthetic source images generated by FLUX.1 Fill, which is also the base model that the method fine-tunes. The manuscript reports several inconsistent dataset and test-set counts, and the central ablation for the dataset contribution uses a training-free base model rather than a controlled training comparison.

Significance. If the central claims hold, the contribution is practically valuable: a single DiT-based model covering person, object, and garment insertion with both mask and text control would simplify deployment, and the AnyInsertion dataset, with roughly 160K pairs, would be a useful resource for the community. The idea of using polyptych prompting to turn reference-based insertion into an in-context editing problem is interesting and is in line with recent DiT in-context work. The mask-prompt results on real paired data, including strong improvements on VTON-HD over specialized try-on methods, provide partial independent support. However, the text-prompt evaluation is weakened by the synthetic-source circularity, the reported numbers lack error bars on small test sets, and the dataset-ablation claim is not supported by a controlled experiment. The significance of the paper is therefore currently contingent on fixing these evaluation issues and on the promised dataset/code release.

major comments (4)
  1. [§3.2, §5.1, Table 3] The text-prompt evaluation is potentially circular. The source images for text-prompt pairs are generated with FLUX.1 Fill [dev] (Section 3.2, 'Source Image Generation'), and Insert Anything is itself a LoRA fine-tune of FLUX.1 Fill (Section 5.1). The AnyInsertion test set is a subset of the same dataset built by the same pipeline, so the model sees test pairs drawn from the exact distribution of its own base model's outputs. Consequently, the reported text-prompt gains over AnyEdit may largely reflect the ability to invert FLUX.1 Fill's own edits rather than a general text-guided insertion capability on arbitrary user scenes. To support the headline claim, the authors should evaluate text-prompt insertion on independently created source-target pairs (e.g., real images of the same scene with and without an object, or sources generated by a different model) and report results separately for FLUX-generated and non-FLUX sources.
  2. [§3.3 vs. §5.1, §5.4, Tables 5 and 6] The test-set sizes are internally inconsistent, which makes the quantitative claims difficult to verify. Section 3.3 states that the mask-prompt test set has 120 pairs, including 60 person pairs (30 simple and 30 complex); Section 5.1 says the person test set has 30 simple-scene samples; and Section 5.4's weighting uses 40 object, 30 garment, and 30 person pairs, totaling 100. Table 5 reports person-insertion numbers without stating whether they are computed on 30 or 60 pairs, and Table 6 is ambiguous about which subset it is aggregated over. The authors must give exact per-table test-set sizes and recompute any weighted averages accordingly.
  3. [§5.4, Table 6] The 'w/o AnyInsertion' row is not a controlled ablation of the dataset. The text says the model relies on a 'training-free model for inference,' which is the base FLUX.1 Fill inpainting model, so this comparison conflates the effect of the AnyInsertion data with the effect of LoRA fine-tuning, the training loss, and the prompting format. The observed degradation therefore cannot be attributed to the training data. A valid ablation would train the same framework on an alternative dataset or ablate the data while keeping the training procedure identical; otherwise, the claim that the AnyInsertion dataset drives the improvement is unsupported.
  4. [Tables 2–5] The benchmark sizes are very small and no error bars or significance tests are reported: the text-prompt object test set has 16 pairs, the garment test sets have 30 pairs, the person test set has 30 or 60 pairs, and FID is computed on these tiny samples. The claim that the method 'consistently outperforms' all baselines on every metric is not statistically established. The authors should report per-metric confidence intervals, per-image standard deviations, or significance tests, and ideally release the test set and evaluation code so the numbers are independently reproducible.
minor comments (7)
  1. [Abstract, §1, §6, §3.3, Table 1] The dataset size is reported inconsistently: the abstract, introduction bullet, and conclusion say 120K prompt-image pairs, while Section 3.3 and Table 1 report 159,908 (58,188 mask + 101,720 text). The authors should use one consistent number throughout.
  2. [§3.3, Table 3] The paper says the text-prompt test subset contains 38 pairs (16 object, 22 garment), but Table 3 reports only object insertion and no garment text-prompt results. It should be stated whether garment text-prompt pairs were evaluated and, if so, where the numbers are.
  3. [§1, §6] The claim that AnyInsertion is 'the first open-source dataset for image insertion' is not substantiated in the manuscript, which provides no download link, license, or release plan. Either provide the release details or soften the claim.
  4. [§5.4, supplementary Table 7] The ablation study is limited to mask-prompt insertion; there is no ablation of the text-prompt triptych format, the text template, or the contribution of the text branch. Given that text-prompt control is half of the central claim, an ablation for that mode should be added.
  5. [Appendix A, Eq. (7)] The adaptive crop strategy introduces hyperparameters β and T, but the paper does not report sensitivity to these values or show that the chosen values are robust across object, person, and garment insertion. A small sensitivity analysis would strengthen the appendix.
  6. [Table 1] The resolution entry 'Mainly 1–2K' is vague; the paper should report the actual resolution distribution of the dataset, including how many samples fall below 1K and how resizing to 768×768 affects the higher-resolution claims.
  7. [References, related work] The related work entry for OmniControl appears as 'Ominicontrol' in the text; the reference list should be checked for consistency and typos.

Circularity Check

1 steps flagged · score 4.0 of 10

Text-prompt evaluation is partly circular: AnyInsertion text-prompt source images are FLUX.1 Fill outputs, and Insert Anything is a LoRA fine-tune of FLUX.1 Fill.

  1. fitted input called prediction [§3.2 Data Generation; §5.1 Implementation Details; Table 3]
    "Source Image Generation. Source images are generated by applying replacement or removal operations to the target images. For replacements, ... we employ FLUX.1 Fill [dev] [18] that preserves unedited regions while allowing modifications within masked areas. | Our method builds upon FLUX.1 Fill [dev], an inpainting model based on DiT architecture."

    The text-prompt test samples come from AnyInsertion, whose text-prompt construction creates the source image by editing the target with FLUX.1 Fill (replacement branch). Insert Anything is itself a LoRA fine-tune of FLUX.1 Fill, so at test time it sees exactly the distribution of (source, target) pairs its base model was used to manufacture. The reported text-prompt gains (Table 3) therefore measure, at least in part, how well the LoRA inverts FLUX.1 Fill's own editing outputs rather than a general text-guided insertion capability on arbitrary user-supplied scenes. This does not impeach the mask-prompt experiments on real pairs, DreamBooth, or VTON-HD, but it leaves the text-control half of the headline claim supported only by an in-distribution inversion benchmark.

full rationale

Score 4. The mask-prompt half is largely self-contained: target/reference pairs come from real internet images, HumanVid frames, and MVImgNet views, and evaluation on DreamBooth and VTON-HD provides external grounding. The text-prompt half is moderately circular: the replacement-derived source images in AnyInsertion are generated by FLUX.1 Fill, the very model on which Insert Anything is LoRA-fine-tuned, so Table 3's text-prompt superiority over AnyEdit on AnyInsertion may reflect in-domain inversion of the base model rather than a demonstrated general text-guided insertion capability. There is no load-bearing self-citation or uniqueness-import step; the related-work self-citations are not used to justify the method. The paper's internal inconsistencies (120K vs. 159,908 samples; 60 vs. 30 person test pairs) are correctness concerns, not circularity. Overall, the central claim is not forced by definition, but the text-control evaluation should be discounted accordingly.

Assumptions & free parameters 4 free parameters · 4 assumptions · 0 invented entities

No new physical or theoretical entities are introduced. The central claim rests on the validity of the new AnyInsertion dataset, on the choice of FLUX.1 Fill as base model and as generator of text-prompt source images, and on several hand-tuned hyperparameters; these are the main unfounded supports.

free parameters (4)
  • LoRA rank = 256
    Model capacity hyperparameter for fine-tuning; chosen by hand, affects identity preservation vs adaptability.
  • Adaptive crop beta = 0.6
    Minimum crop area fraction at r=0 (Supp. Eq. 7), hand-tuned to balance context vs detail.
  • Adaptive crop threshold T = 0.1
    Area ratio threshold below which cropping kicks in, hand-tuned.
  • Hybrid mask composition = box + augmented box + dilated segmentation per category
    Mask type per category is hand-designed and affects pose guidance vs precision.
assumptions (4)
  • domain assumption AnyInsertion dataset distribution matches real-world insertion tasks
    The model is trained and evaluated on this dataset; its representativeness is assumed.
  • domain assumption FLUX.1 Fill-generated source images are valid ground truth for text-prompt editing
    The text-prompt test and training pairs use source images synthesized by FLUX.1 Fill; errors in these sources become the learning target.
  • domain assumption Standard image quality metrics correlate with insertion quality
    PSNR, SSIM, LPIPS, and FID are used without a human study validation.
  • domain assumption The base FLUX.1 Fill model provides a suitable prior for insertion
    The method is a LoRA fine-tune of FLUX.1 Fill; this inheritance is not examined.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Insert Anything: Image Insertion via In-Context Editing in DiT." pith.science (2026). https://pith.science/paper/326CZJQ3

@misc{pith2026250415009,
  author       = {Pith},
  title        = {Pith review of: Insert Anything: Image Insertion via In-Context Editing in DiT},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/326CZJQ3}},
  note         = {Machine review of arXiv:2504.15009}
}
read the original abstract

This work presents Insert Anything, a unified framework for reference-based image insertion that seamlessly integrates objects from reference images into target scenes under flexible, user-specified control guidance. Instead of training separate models for individual tasks, our approach is trained once on our new AnyInsertion dataset--comprising 120K prompt-image pairs covering diverse tasks such as person, object, and garment insertion--and effortlessly generalizes to a wide range of insertion scenarios. Such a challenging setting requires capturing both identity features and fine-grained details, while allowing versatile local adaptations in style, color, and texture. To this end, we propose to leverage the multimodal attention of the Diffusion Transformer (DiT) to support both mask- and text-guided editing. Furthermore, we introduce an in-context editing mechanism that treats the reference image as contextual information, employing two prompting strategies to harmonize the inserted elements with the target scene while faithfully preserving their distinctive features. Extensive experiments on AnyInsertion, DreamBooth, and VTON-HD benchmarks demonstrate that our method consistently outperforms existing alternatives, underscoring its great potential in real-world applications such as creative content generation, virtual try-on, and scene composition.

Figures

Figures reproduced from arXiv: 2504.15009 by the authors.

Figure 1
Figure 1. Applications of Insert Anything. Our unified image insertion framework supports diverse practical scenarios, including artistic creation, realistic face swapping, cinematic scene composition, virtual garment try-on, accessory customization, and digital prop replace￾ment, demonstrating its versatility and effectiveness in various image editing tasks. Abstract This work presents Insert Anything, a unified framework fo… view at source ↗
Figure 2
Figure 2. Overview of AnyInsertion dataset, highlighting its source and example (a) and diversity (b). [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 3
Figure 3. Overview of the Insert Anything model framework. Given different types of prompts, our unified framework processes polyptych inputs (concatenation of reference, source, and masks) through a frozen VAE encoder to preserve high-frequency details, and extracts semantic guidance from image and text encoders. These embeddings are combined and fed into learnable DiT transformer blocks for in-context learning, enabling pre… view at source ↗
Figures from the paper (4 more)
Figure 4
Figure 4. Figure 4: Qualitative comparison of mask-prompt image insertion results. Our method consistently preserves identity and maintains visual coherence across diverse insertion tasks (person, object, and garment) compared to existing methods (AnyDoor [3], MimicBrush [2], Ace++ [25], …
Figure 5
Figure 5. Figure 5: Qualitative comparisons with AnyEdit [49] on text￾prompt object and garment insertion. See [PITH_FULL_IMAGE:figures/full_fig_p008_5.png]
Figure 6
Figure 6. Figure 6: Ablation study on mask prompt insertion. Omitting polyptych in-context, semantic guidance, or AnyInsertion data de￾grades visual fidelity, sacrificing fine details and semantic cues [PITH_FULL_IMAGE:figures/full_fig_p009_6.png]
Figure 8
Figure 8. Figure 8: Ablation study on adaptive cropping and hybrid masking strategies. Removing adaptive cropping reduces detail preservation for small objects, while using only box or instance masks compromises either pose adaptability or mask-guided pre￾cision. Our combined strategy ach…

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 14 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. UniGeo: Unifying Geometric Guidance for Camera-Controllable Image Editing via Video Models

    cs.CV 2026-04 unverdicted novelty 7.0 of 10

    UniGeo unifies geometric guidance across three levels in video models to reduce geometric drift and improve consistency in camera-controllable image editing.

  2. Rule-VLN: Bridging Perception and Compliance via Semantic Reasoning and Geometric Rectification

    cs.AI 2026-04 unverdicted novelty 7.0 of 10

    Rule-VLN is the first large-scale benchmark injecting 177 regulatory categories into an urban environment, and the proposed SNRM module equips pre-trained VLN agents with zero-shot semantic reasoning and detour planni...

  3. InnoText: A Unified Model for Visual Text Generation and Editing

    cs.CV 2026-07 conditional novelty 6.0 of 10

    A unified DiT model with font-size-aware modulation and region-weighted loss outperforms existing visual text generation and editing systems on bilingual benchmarks.

  4. Appearance Pointers -- Multimodal Region Control of Diffusion Transformers

    cs.CV 2026-07 conditional novelty 6.0 of 10

    Appearance pointers are compact tokens that let a diffusion transformer apply text, image, or combined prompts to specific image regions in a single pass.

  5. Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing

    cs.HC 2026-04 conditional novelty 6.0 of 10

    SOTA diffusion image editors score poorly on implicit physical, environmental, cultural, causal, and referential constraints, which a lightweight reasoning-guided post-edit can partially fix.

  6. HOComp: Interaction-Aware Human-Object Composition

    cs.CV 2025-07 conditional novelty 6.0 of 10

    A diffusion-transformer method that composes a foreground object into a human image with MLLM-chosen interaction regions, pose keypoint supervision, and appearance/background consistency losses, plus a new paired dataset.

  7. UNIC: Unified In-Context Video Editing

    cs.CV 2025-06 conditional novelty 6.0 of 10

    One diffusion transformer handles ID insert, swap, delete, stylization, propagation, and re-camera control in a single model using in-context token concatenation with task-aware positional encoding and bias.

  8. DiffDecompose: Layer-Wise Decomposition of Alpha-Composited Images via Diffusion Transformers

    cs.CV 2025-05 conditional novelty 6.0 of 10

    DiffDecompose recovers foreground and background layers from alpha-composited images using in-context diffusion with position encoding cloning, trained and evaluated on a new six-task synthetic dataset.

  9. DreamSwapV: Mask-guided Subject Swapping for Any Customized Video Editing

    cs.CV 2025-08 unverdicted novelty 5.0 of 10

    DreamSwapV performs mask-guided, subject-agnostic subject swapping in videos using multiple conditions, an adaptive mask strategy, and a new benchmark.

  10. FullDiT2: Efficient In-Context Conditioning for Video Diffusion Transformers

    cs.CV 2025-06 conditional novelty 5.0 of 10

    FullDiT2 accelerates FullDiT-style in-context conditioning for video by dynamic token selection and selective context caching, cutting per-step time by 2-3x with minimal quality loss.

  11. RelationAdapter: Learning and Transferring Visual Relation with Diffusion Transformers

    cs.CV 2025-06 conditional novelty 5.0 of 10

    A decoupled-attention adapter transfers image-pair edits to new photos in diffusion transformers, trained with a new 218-task visual editing dataset.

  12. Borrowing from anything: A generalizable framework for reference-guided instance editing

    cs.CV 2025-12 conditional novelty 4.0 of 10

    GENIE uses spatial alignment, residual feature scaling, and progressive attention fusion to transfer a reference's appearance onto a target, achieving state-of-the-art scores on AnyInsertion.

  13. In-Context Brush: Zero-shot Customized Subject Insertion with Context-Aware Latent Space Manipulation

    cs.CV 2025-05 conditional novelty 4.0 of 10

    In-Context Brush performs zero-shot customized subject insertion by amplifying prompt and reference attention and reweighting attention heads in a pre-trained Flux-Fill diffusion transformer.

  14. MIND-Edit: MLLM Insight-Driven Editing via Language-Vision Projection

    cs.CV 2025-05 reject novelty 4.0 of 10

    MIND-Edit combines instruction rewriting with MLLM-derived visual embeddings to guide diffusion-based image editing, but the reported numbers only partly support the claim of state-of-the-art performance.

Reference graph

Works this paper leans on

54 extracted references · 19 canonical work pages · cited by 14 Pith papers

  1. [1]

    In- structpix2pix: Learning to follow image editing instructions

    Tim Brooks, Aleksander Holynski, and Alexei A Efros. In- structpix2pix: Learning to follow image editing instructions. In Proceedings of the IEEE/CVF conference on computer vi- sion and pattern recognition, pages 18392–18402, 2023. 2

    2023

  2. [2]

    Zero-shot image editing with reference imitation

    Xi Chen, Yutong Feng, Mengting Chen, Yiyang Wang, Shi- long Zhang, Yu Liu, Yujun Shen, and Hengshuang Zhao. Zero-shot image editing with reference imitation. arXiv preprint arXiv:2406.07547, 2024. 2, 3, 6, 7, 8

    arXiv 2024

  3. [3]

    Anydoor: Zero-shot object-level im- age customization

    Xi Chen, Lianghua Huang, Yu Liu, Yujun Shen, Deli Zhao, and Hengshuang Zhao. Anydoor: Zero-shot object-level im- age customization. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 6593–6602, 2024. 2, 3, 5, 6, 7, 8

    work page 2024

  4. [4]

    Unireal: Universal image generation and editing via learning real-world dynamics

    Xi Chen, Zhifei Zhang, He Zhang, Yuqian Zhou, Soo Ye Kim, Qing Liu, Yijun Li, Jianming Zhang, Nanxuan Zhao, Yilin Wang, et al. Unireal: Universal image generation and editing via learning real-world dynamics. arXiv preprint arXiv:2412.07774, 2024. 3

    arXiv 2024

  5. [5]

    Viton-hd: High-resolution virtual try-on via misalignment-aware normalization

    Seunghwan Choi, Sunghyun Park, Minsoo Lee, and Jaegul Choo. Viton-hd: High-resolution virtual try-on via misalignment-aware normalization. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 14131–14140, 2021. 2, 3, 6

    2021

  6. [6]

    Catvton: Concatenation is all you need for virtual try- on with diffusion models

    Zheng Chong, Xiao Dong, Haoxiang Li, Shiyue Zhang, Wenqing Zhang, Xujie Zhang, Hanqing Zhao, and Xiaodan Liang. Catvton: Concatenation is all you need for virtual try- on with diffusion models. arXiv preprint arXiv:2407.15886,

    arXiv

  7. [7]

    Style injec- tion in diffusion: A training-free approach for adapting large- scale diffusion models for style transfer

    Jiwoo Chung, Sangeek Hyun, and Jae-Pil Heo. Style injec- tion in diffusion: A training-free approach for adapting large- scale diffusion models for style transfer. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 8795–8805, 2024. 2

    work page 2024

  8. [8]

    On the representation and methodology for 9 wide and short range head pose estimation

    Alejandro Cobo, Roberto Valle, Jos ´e M Buenaposada, and Luis Baumela. On the representation and methodology for 9 wide and short range head pose estimation. Pattern Recog- nition, 149:110263, 2024. 4

    work page 2024

Show all 54 references
  1. [9]

    Sample and computation redistribution for effi- cient face detection

    Jia Guo, Jiankang Deng, Alexandros Lattas, and Stefanos Zafeiriou. Sample and computation redistribution for effi- cient face detection. arXiv preprint arXiv:2105.04714, 2021. 1

    2021 arXiv

  2. [10]

    Ace: All- round creator and editor following instructions via diffusion transformer

    Zhen Han, Zeyinzi Jiang, Yulin Pan, Jingfeng Zhang, Chao- jie Mao, Chenwei Xie, Yu Liu, and Jingren Zhou. Ace: All- round creator and editor following instructions via diffusion transformer. arXiv preprint arXiv:2410.00086, 2024. 3

    arXiv

  3. [11]

    Freeedit: Mask-free reference-based image editing with multi-modal instruction

    Runze He, Kai Ma, Linjiang Huang, Shaofei Huang, Jialin Gao, Xiaoming Wei, Jiao Dai, Jizhong Han, and Si Liu. Freeedit: Mask-free reference-based image editing with multi-modal instruction. arXiv preprint arXiv:2409.18071 ,

    arXiv

  4. [12]

    Gans trained by a two time-scale update rule converge to a local nash equilib- rium

    Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. Gans trained by a two time-scale update rule converge to a local nash equilib- rium. Advances in neural information processing systems , 30, 2017. 8

    2017

  5. [13]

    Denoising dif- fusion probabilistic models

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising dif- fusion probabilistic models. Advances in neural information processing systems, 33:6840–6851, 2020. 2

    2020

  6. [14]

    In-context lora for diffusion transformers

    Lianghua Huang, Wei Wang, Zhi-Fan Wu, Yupeng Shi, Huanzhang Dou, Chen Liang, Yutong Feng, Yu Liu, and Jin- gren Zhou. In-context lora for diffusion transformers. arXiv preprint arXiv:2410.23775, 2024. 3

    2024 arXiv

  7. [15]

    Designedit: Multi- layered latent decomposition and fusion for unified & accu- rate image editing

    Yueru Jia, Yuhui Yuan, Aosong Cheng, Chuke Wang, Ji Li, Huizhu Jia, and Shanghang Zhang. Designedit: Multi- layered latent decomposition and fusion for unified & accu- rate image editing. arXiv preprint arXiv:2403.14487, 2024. 4

    2024 arXiv

  8. [16]

    Segment any- thing

    Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer White- head, Alexander C Berg, Wan-Yen Lo, et al. Segment any- thing. In Proceedings of the IEEE/CVF international confer- ence on computer vision, pages 4015–4026, 2023. 4, 2

    2023

  9. [17]

    Putting people in their place: Affordance-aware hu- man insertion into scenes

    Sumith Kulal, Tim Brooks, Alex Aiken, Jiajun Wu, Jimei Yang, Jingwan Lu, Alexei A Efros, and Krishna Kumar Singh. Putting people in their place: Affordance-aware hu- man insertion into scenes. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition...

    2023

  10. [18]

    Black Forest Labs. Flux. https://github.com/ black-forest-labs/flux, 2024. 4

    2024

  11. [19]

    Drip: Unleashing diffusion priors for joint foreground and alpha prediction in image matting.Advances in Neural Information Processing Systems, 37:79868–79888, 2024

    Xiaodi Li, Zongxin Yang, Ruijie Quan, and Yi Yang. Drip: Unleashing diffusion priors for joint foreground and alpha prediction in image matting.Advances in Neural Information Processing Systems, 37:79868–79888, 2024. 2

    2024

  12. [20]

    Lightglue: Local feature matching at light speed

    Philipp Lindenberger, Paul-Edouard Sarlin, and Marc Polle- feys. Lightglue: Local feature matching at light speed. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 17627–17638, 2023. 3, 1

    2023

  13. [21]

    Flow matching for generative mod- eling

    Yaron Lipman, Ricky TQ Chen, Heli Ben-Hamu, Maximil- ian Nickel, and Matt Le. Flow matching for generative mod- eling. arXiv preprint arXiv:2210.02747, 2022. 6

    2022 arXiv

  14. [22]

    Grounding dino: Marrying dino with grounded pre-training for open-set object detection

    Shilong Liu, Zhaoyang Zeng, Tianhe Ren, Feng Li, Hao Zhang, Jie Yang, Qing Jiang, Chunyuan Li, Jianwei Yang, Hang Su, et al. Grounding dino: Marrying dino with grounded pre-training for open-set object detection. In European Conference on Computer Vision , pages 38–55. Springe...

    2024

  15. [23]

    Qwen2vl-flux: Unifying image and text guidance for controllable image generation, 2024

    Pengqi Lu. Qwen2vl-flux: Unifying image and text guidance for controllable image generation, 2024. 3

    2024

  16. [24]

    Repaint: Inpainting using denoising diffusion probabilistic models

    Andreas Lugmayr, Martin Danelljan, Andres Romero, Fisher Yu, Radu Timofte, and Luc Van Gool. Repaint: Inpainting using denoising diffusion probabilistic models. In Proceed- ings of the IEEE/CVF conference on computer vision and pattern recognition, pages 11461–11471, 2022. 2

    2022

  17. [25]

    Ace++: Instruction- based image creation and editing via context-aware content filling

    Chaojie Mao, Jingfeng Zhang, Yulin Pan, Zeyinzi Jiang, Zhen Han, Yu Liu, and Jingren Zhou. Ace++: Instruction- based image creation and editing via context-aware content filling. arXiv preprint arXiv:2501.02487, 2025. 2, 3, 6, 7, 8

    2025 arXiv

  18. [26]

    Prodigy: An expeditiously adaptive parameter-free learner.arXiv preprint arXiv:2306.06101, 2023

    Konstantin Mishchenko and Aaron Defazio. Prodigy: An expeditiously adaptive parameter-free learner.arXiv preprint arXiv:2306.06101, 2023. 6

    2023 arXiv

  19. [27]

    Dinov2: Learning robust visual features without supervision

    Maxime Oquab, Timoth ´ee Darcet, Th ´eo Moutakanni, Huy V o, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193, 2023. 3

    2023 arXiv

  20. [28]

    Synthesizing environment-specific people in pho- tographs

    Mirela Ostrek, Carol O’Sullivan, Michael J Black, and Jus- tus Thies. Synthesizing environment-specific people in pho- tographs. In European Conference on Computer Vision , pages 292–309. Springer, 2024. 3

    2024

  21. [29]

    Text2place: Affordance-aware text guided human placement

    Rishubh Parihar, Harsh Gupta, Sachidanand VS, and R Venkatesh Babu. Text2place: Affordance-aware text guided human placement. In European Conference on Com- puter Vision, pages 57–77. Springer, 2024. 2, 3

    2024

  22. [30]

    Diatom auto- focusing in brightfield microscopy: a comparative study

    Jos ´e Luis Pech-Pacheco, Gabriel Crist´obal, Jes´us Chamorro- Martinez, and Joaqu ´ın Fern ´andez-Valdivia. Diatom auto- focusing in brightfield microscopy: a comparative study. In Proceedings 15th International Conference on Pattern Recognition. ICPR-2000, pages 314–317. IEE...

    2000

  23. [31]

    Scalable diffusion models with transformers

    William Peebles and Saining Xie. Scalable diffusion models with transformers. In Proceedings of the IEEE/CVF inter- national conference on computer vision , pages 4195–4205,

  24. [32]

    Exploring the limits of transfer learning with a unified text-to-text transformer

    Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of machine learning research, 21(140):1–67, 2020. 6

    2020

  25. [33]

    U- net: Convolutional networks for biomedical image segmen- tation

    Olaf Ronneberger, Philipp Fischer, and Thomas Brox. U- net: Convolutional networks for biomedical image segmen- tation. In Medical image computing and computer-assisted intervention–MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, proceedings, pa...

    2015

  26. [34]

    Dreambooth: Fine tuning text-to-image diffusion models for subject-driven generation

    Nataniel Ruiz, Yuanzhen Li, Varun Jampani, Yael Pritch, Michael Rubinstein, and Kfir Aberman. Dreambooth: Fine tuning text-to-image diffusion models for subject-driven generation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 2250...

    2023

  27. [35]

    Audioscenic: Audio-driven video scene editing.arXiv preprint arXiv:2404.16581, 2024

    Kaixin Shen, Ruijie Quan, Linchao Zhu, Jun Xiao, and Yi Yang. Audioscenic: Audio-driven video scene editing.arXiv preprint arXiv:2404.16581, 2024. 2

    2024 arXiv

  28. [36]

    Tarpro: Targeted protection against malicious image editing

    Kaixin Shen, Ruijie Quan, Jiaxu Miao, Jun Xiao, and Yi Yang. Tarpro: Targeted protection against malicious image editing. arXiv preprint arXiv:2503.13994, 2025. 2

    2025 arXiv

  29. [37]

    Large-scale text-to-image model with inpainting is a zero-shot subject-driven image generator

    Chaehun Shin, Jooyoung Choi, Heeseung Kim, and Sungroh Yoon. Large-scale text-to-image model with inpainting is a zero-shot subject-driven image generator. arXiv preprint arXiv:2411.15466, 2024. 3, 5

    2024 arXiv

  30. [38]

    Styledrop: Text-to-image generation in any style

    Kihyuk Sohn, Nataniel Ruiz, Kimin Lee, Daniel Castro Chin, Irina Blok, Huiwen Chang, Jarred Barber, Lu Jiang, Glenn Entis, Yuanzhen Li, et al. Styledrop: Text-to-image generation in any style. arXiv preprint arXiv:2306.00983 ,

    arXiv

  31. [39]

    Imprint: Generative object compositing by learning identity-preserving representation

    Yizhi Song, Zhifei Zhang, Zhe Lin, Scott Cohen, Brian Price, Jianming Zhang, Soo Ye Kim, He Zhang, Wei Xiong, and Daniel Aliaga. Imprint: Generative object compositing by learning identity-preserving representation. In Proceedings of the IEEE/CVF Conference on Computer Vision ...

    2024

  32. [40]

    Ominicontrol: Minimal and uni- versal control for diffusion transformer

    Zhenxiong Tan, Songhua Liu, Xingyi Yang, Qiaochu Xue, and Xinchao Wang. Ominicontrol: Minimal and uni- versal control for diffusion transformer. arXiv preprint arXiv:2411.15098, 3, 2024. 3

    2024 arXiv

  33. [41]

    Tam- ing rectified flow for inversion and editing

    Jiangshan Wang, Junfu Pu, Zhongang Qi, Jiayi Guo, Yue Ma, Nisha Huang, Yuxin Chen, Xiu Li, and Ying Shan. Tam- ing rectified flow for inversion and editing. arXiv preprint arXiv:2411.04746, 2024. 2

    2024 arXiv

  34. [42]

    Instantid: Zero-shot identity-preserving generation in seconds

    Qixun Wang, Xu Bai, Haofan Wang, Zekui Qin, Anthony Chen, Huaxia Li, Xu Tang, and Yao Hu. Instantid: Zero-shot identity-preserving generation in seconds. arXiv preprint arXiv:2401.07519, 2024. 3

    2024 arXiv

  35. [43]

    Humanvid: Demystifying training data for camera-controllable human image animation

    Zhenzhi Wang, Yixuan Li, Yanhong Zeng, Youqing Fang, Yuwei Guo, Wenran Liu, Jing Tan, Kai Chen, Tianfan Xue, Bo Dai, et al. Humanvid: Demystifying training data for camera-controllable human image animation. In The Thirty- eight Conference on Neural Information Processing Syst...

    2024

  36. [44]

    Smartbrush: Text and shape guided object inpainting with diffusion model

    Shaoan Xie, Zhifei Zhang, Zhe Lin, Tobias Hinz, and Kun Zhang. Smartbrush: Text and shape guided object inpainting with diffusion model. In Proceedings of the IEEE/CVF con- ference on computer vision and pattern recognition , pages 22428–22437, 2023. 2

    2023

  37. [45]

    Oot- diffusion: Outfitting fusion based latent diffusion for control- lable virtual try-on

    Yuhao Xu, Tao Gu, Weifeng Chen, and Chengcai Chen. Oot- diffusion: Outfitting fusion based latent diffusion for control- lable virtual try-on. arXiv preprint arXiv:2403.01779, 2024. 2, 3, 7, 8

    2024 arXiv

  38. [46]

    Gg-editor: Locally editing 3d avatars with multimodal large language model guidance

    Yunqiu Xu, Linchao Zhu, and Yi Yang. Gg-editor: Locally editing 3d avatars with multimodal large language model guidance. In Proceedings of the 32nd ACM International Conference on Multimedia, pages 10910–10919, 2024. 2

    2024

  39. [47]

    Paint by example: Exemplar-based image editing with diffusion mod- els

    Binxin Yang, Shuyang Gu, Bo Zhang, Ting Zhang, Xuejin Chen, Xiaoyan Sun, Dong Chen, and Fang Wen. Paint by example: Exemplar-based image editing with diffusion mod- els. In Proceedings of the IEEE/CVF conference on com- puter vision and pattern recognition , pages 18381–18391,

  40. [48]

    Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models

    Hu Ye, Jun Zhang, Sibo Liu, Xiao Han, and Wei Yang. Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models. arXiv preprint arXiv:2308.06721,

    arXiv

  41. [49]

    Anyedit: Mastering unified high-quality image editing for any idea

    Qifan Yu, Wei Chow, Zhongqi Yue, Kaihang Pan, Yang Wu, Xiaoyang Wan, Juncheng Li, Siliang Tang, Hanwang Zhang, and Yueting Zhuang. Anyedit: Mastering unified high-quality image editing for any idea. arXiv preprint arXiv:2411.15738, 2024. 3, 6, 8

    2024 arXiv

  42. [50]

    Mvimgnet: A large-scale dataset of multi-view images

    Xianggang Yu, Mutian Xu, Yidan Zhang, Haolin Liu, Chongjie Ye, Yushuang Wu, Zizheng Yan, Chenming Zhu, Zhangyang Xiong, Tianyou Liang, et al. Mvimgnet: A large-scale dataset of multi-view images. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognit...

    2023

  43. [51]

    Sigmoid loss for language image pre-training

    Xiaohua Zhai, Basil Mustafa, Alexander Kolesnikov, and Lucas Beyer. Sigmoid loss for language image pre-training. In Proceedings of the IEEE/CVF international conference on computer vision, pages 11975–11986, 2023. 6

    2023

  44. [52]

    Magicbrush: A manually annotated dataset for instruction- guided image editing

    Kai Zhang, Lingbo Mo, Wenhu Chen, Huan Sun, and Yu Su. Magicbrush: A manually annotated dataset for instruction- guided image editing. Advances in Neural Information Pro- cessing Systems, 36:31428–31449, 2023. 2

    2023

  45. [53]

    Adding conditional control to text-to-image diffusion models

    Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Adding conditional control to text-to-image diffusion models. In Proceedings of the IEEE/CVF international conference on computer vision, pages 3836–3847, 2023. 3

    2023

  46. [54]

    Inversion-based style transfer with diffusion models

    Yuxin Zhang, Nisha Huang, Fan Tang, Haibin Huang, Chongyang Ma, Weiming Dong, and Changsheng Xu. Inversion-based style transfer with diffusion models. In Pro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10146–10156, 2023. 2 11 Insert A...

    2023

Pith tools

Reviewed August 16, 2026 · model on record in the stance chip above.