Pith. sign in

REVIEW 4 major objections 5 minor 53 references

MagicNaming: Consistent Identity Generation by Finding a "Name Space" in T2I Diffusion Models

T0 review · 4 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash

Pith's one-line read A predicted 'name' embedding, inserted into a text prompt, lets SDXL generate any given face with consistent identity, no fine-tuning.

desk verdict Neat trick—mapping faces to celebrity-name embeddings and prepending them—but the paper's own identity metric never checks generated images against the reference face, so the central claim is currently unproven. read the letter →

arxiv 2412.14902 v1 pith:JBWWKHVH submitted 2024-12-19 cs.CV

classification cs.CV
keywords MagicNamingNameSpaceidentity-consistentgenerationtext-to-imagediffusionmodelsimageencodertextembeddingLaionCeledatasetSDXL
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper sets out to prove that a text-to-image diffusion model such as SDXL contains a 'Name Space': a region of its text-embedding space, spanned by celebrity names, in which every point encodes a specific identity. If that holds, any generic face can be given a 'name' by a learned image encoder that predicts the face's location in this space, and prepending that predicted name embedding to a prompt makes the model generate that same person across varying scenes, styles, and emotions. The payoff is consistent identity generation without fine-tuning the generative model, so the model's original semantic capabilities remain intact. The paper also argues that name embeddings are disentangled from textual semantics, so the identity stays fixed when the prompt changes and the prompt's content stays fixed when the identity changes.

What carries the argument

The load-bearing object is the 'Name Space' (N Space): the subspace of SDXL's text-embedding space spanned by the text-encoder embeddings of celebrity names, where each point is treated as a name for a specific identity. The mechanism that carries the argument is an image encoder that concatenates features from two CLIP image encoders and passes them through a three-layer fully connected network to predict an $8 \times 2048$ embedding that matches the ground-truth celebrity name embedding via MSE loss. At inference the predicted name embedding is prepended to the text embedding between the start token and the first semantic token, then recalibrated by $F'_{ID} = F^{mean}_{ID} + \delta(F_{ID} - F^{mean}_{ID})$ and normalized by a scale factor $\eta$ before guiding the U-Net.

What would settle it

Use a face-verification model to compare the generated images against the actual reference face photo for non-celebrity identities that were never in LaionCele, across the paper's four prompt categories; if the match rate is no better than for a randomly selected different face, the Name Space generalization claim fails. A complementary check is whether two different photos of the same non-celebrity person produce name embeddings that cluster together in the Name Space while embeddings of different people separate.

Watch

Extended reading notes

Core claim

The central discovery is that in SDXL, the text embeddings of celebrities' names function as identity tokens: they can be extracted from the text encoder, inserted at a fixed position in the prompt embedding (immediately after the start token), and combined with arbitrary semantic prompts, and the model then produces images of that specific person. The paper shows these name embeddings are disentangled from prompt semantics, and that an image encoder trained with mean-squared-error loss on the LaionCele dataset (42,000 celebrity identities, 810,000 images) can map an arbitrary reference portrait to its predicted name embedding in this Name Space. Prepending that predicted embedding, then recalibrating it with a mean-based classifier-free guidance rule and norm scaling, yields stable identity while preserving the model's scene construction, stylization, action control, and emotional editing abilities, without any fine-tuning of the U-Net.

Load-bearing premise

The image encoder trained only on celebrity name-image pairs must generalize to arbitrary, non-celebrity faces, meaning the text-embedding space contains name-like embeddings for every conceivable identity and the encoder can find them.

Editorial extensions

If this is right

  • Any SDXL-derived variant (for example a style-specialized U-Net) becomes identity-aware by simply plugging in the predicted name embedding, with no re-training or adapter.
  • Because name embeddings and semantics are disentangled, fixing the name embedding while changing the prompt keeps the identity unchanged, and changing the name embedding while fixing the prompt keeps the scene and style unchanged.
  • Interpolating between two name embeddings in the Name Space creates new fictional characters that themselves support consistent identity generation.
  • Fine-tuning the U-Net or a LoRA improves reference similarity and identity consistency but measurably reduces semantic fidelity (CLIP-TI), supporting the paper's choice not to fine-tune.
  • Training the image encoder on the LaionCele dataset rather than on images generated by SDXL is necessary; the generated-image-trained encoder produces artifacts and inconsistent identities.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same image-encoder-to-text-embedding trick could extend to other attributes SDXL already encodes implicitly, such as art styles, objects, or environments, not just identities.
  • If the Name Space is as dense as claimed, identity could be treated as a fixed, prompt-independent control signal, which would make identity-preserving video generation and multi-image editing straightforward.
  • A direct test the paper does not report: whether generated images match the actual reference face (not just each other) for non-celebrity identities; the main quantitative evaluation only measures pairwise consistency among generated images, so a reference-matching experiment would settle the generalization claim.
  • The Name Space is built from celebrity distributions in Laion5B, so coverage may be uneven across demographics and less common face types, a bias inherited from the training data.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper proposes MagicNaming, a method for identity-consistent text-to-image generation of generic (non-celebrity) identities. The authors construct a large dataset (LaionCele) of celebrity name–image pairs, use SDXL's text encoder to obtain name embeddings for celebrity names, and train an image encoder with an MSE loss to predict such a name embedding from a reference face image. At inference, the predicted embedding is prepended to the text embedding of an arbitrary prompt, and the combined embedding is fed to an unmodified SDXL model. The paper claims that this 'Name Space' embedding is disentangled from prompt semantics, so identity is preserved across prompt variations while the original generative capabilities of SDXL are retained. The authors also show qualitative results on scene construction, action control, stylization, and emotional editing, and compare against IP-Adapter and PhotoMaker. The main quantitative claims rely on CLIP-TI, FID, and an ID-consistency score computed with FaceNet.

Significance. If the central claim is established, the contribution is significant: identity-consistent generation without fine-tuning, with the ability to plug the learned name embeddings into any SDXL derivative, would be a simple and practical mechanism. The LaionCele dataset (42,000 identities, ~810,000 images) is itself a sizable resource. The conceptual shift from per-identity textual inversion to a learned mapping into an existing 'name embedding' space is interesting and potentially reusable. However, the current evaluation does not directly test the paper's headline claim. The primary identity metric is an intra-set consistency score among generated images rather than a similarity to the reference face, and the only reference-similarity number is confined to an ablation with no comparison to prior methods. Until reference-based identity fidelity is measured against baselines, the significance of the method for identity preservation remains unverified.

major comments (4)
  1. [Quantitative Evaluation (Table 1) and Supplementary, 'Evaluation dataset'] The ID Cons. metric is computed by randomly pairing each generated image with another image from the same 1,000-image test set, not by comparing generated images to the reference face. This measures intra-set consistency (and, because pairs are drawn across all identities, largely cross-identity similarity), so it does not test whether the predicted name embedding actually encodes the reference person's identity. A method that always produces a similar-looking generic face, or one that applies a consistent style, could score well. The central claim that the predicted embedding preserves individual identity requires a reference-based metric, e.g., FaceNet similarity between each generated image and the reference face, reported separately for each test identity.
  2. [Table 2 and 'How does fine-tuning impair generative capacity?'] The only reference-similarity number in the paper, Ref Simi., appears in the fine-tuning ablation: Ours(w/o fine-tune) is 0.4008, which is below every fine-tuned row. This number is never defined, and no comparison against IP-Adapter, PhotoMaker, or SDXL is provided on this metric. Without such a comparison, the paper does not substantiate that its method preserves identity better than or even comparably to existing methods; the absence of a reference-based comparison is a load-bearing gap for the main claim.
  3. [Encoder for Image to N Space and Eq. (3); Supplementary, 'Dataset Construction'] The image encoder is trained with MSE loss against celebrity name embeddings from LaionCele, and the evaluation of identity consistency uses the FaceNet network. The LaionCele construction pipeline (supplementary steps 5 and 7) also uses a face-recognition model to filter name embeddings and images by pairwise identity consistency. This coupling means the training data were selected to be separable by the same face-recognition approach used in the evaluation, which can inflate reported ID-consistency scores. The paper should either report results with an independent identity metric or provide evidence that this overlap does not bias the comparison.
  4. [Quantitative Evaluation (Table 1); Supplementary, 'Evaluation dataset'] No error bars, standard deviations, or significance tests are reported for any of the quantitative results. With 20 test identities and 40 prompts, and with differences as small as 0.5624 vs. 0.5466 in ID Cons., the claim of superiority over PhotoMaker is not statistically supported. The authors should report per-identity or per-seed variance and, where appropriate, paired tests. This applies to the CLIP-TI, FID, and ID Cons. columns.
minor comments (5)
  1. [Abstract] The phrase 'promising the generated image with good identity consistency' is unclear; it should be 'producing an image with good identity consistency' or similar.
  2. [Table 3] The emotional-editing prompt 'a person is superised' contains a typo; it should read 'surprised'.
  3. [Conclusions and Related Works] There are several typos in the text: 'aethetics' should be 'aesthetics' in the Conclusions, and 'dose not' should be 'does not' in the Related Works.
  4. [Supplementary, Implementation details] 'Stableb Diffusion XL' should read 'Stable Diffusion XL'.
  5. [Table 2 and Figure 15] The fine-tuning ablation refers to an 'Ins700' dataset in Table 2, while Figure 15's caption mentions a 'web200 dataset'; these appear to be the same or related datasets and the naming should be made consistent and defined.

Circularity Check

0 steps flagged · score 0.0 of 10

No load-bearing circularity: the encoder is trained on external celebrity name embeddings and evaluated on held-out identities; the main weakness is an evaluation gap (no reference-identity metric), which is a correctness risk rather than a circular reduction.

full rationale

The claimed derivation chain is: (1) define the "Name Space" as the set of SDXL text embeddings for celebrity names; (2) filter this set using FaceNet consistency of SDXL-generated portraits; (3) train an image encoder with MSE (Eq. 3) to map face images to these name embeddings; (4) prepend the predicted embedding to arbitrary prompts and generate. None of these steps defines the predicted identity in terms of the evaluation metric. The training labels are real text embeddings of celebrity names, the test faces are explicitly chosen to be absent from the training set and not name-generatable by SDXL, and the final identity metric is applied to generated images of these unseen identities. Thus the reported ID Cons. is a genuine empirical result about generalization, not a quantity forced by construction. The one legitimate concern is that ID Cons. (Supplementary, quantitative evaluation) averages FaceNet similarity between pairs of generated images sharing the same predicted embedding; this tests cross-prompt consistency of the predicted embedding but not fidelity to the reference face. A model mapping all references to one generic identity could score well on this metric. This is a missing reference-based evaluation for the central claim, and Table 2's "Ref Simi." row for Ours (0.4008) is not compared against baselines. That is a correctness risk, but it is not a circular derivation: no equation in the paper makes the predicted embedding equal to the measured quantity, and no load-bearing self-citation is used. The paper is self-contained against external baselines (IP-Adapter, PhotoMaker) on CLIP-TI, FID, and ID Cons., so under the stated criteria there is no significant circularity.

Assumptions & free parameters 4 free parameters · 5 assumptions · 1 invented entities

The central method is an empirical mapping; it relies on SDXL's pretrained name-to-identity capability, a disentanglement assumption, and an encoder generalization assumption. The free parameters are inference-time hyperparameters tuned on the evaluation set.

free parameters (4)
  • gamma (CFG guidance scale) = 7
    Empirically set in supplementary; controls overall guidance strength.
  • delta (name guidance strength) = 5
    Empirically set; controls how far the predicted name embedding is pushed from the mean.
  • eta (name embedding norm scale) = 80
    Empirically set; rescales the name embedding to a tuned norm.
  • name token count = 8
    Number of token positions used to represent the name embedding; arbitrary truncation of the 77-token sequence.
assumptions (5)
  • domain assumption SDXL can generate identity-consistent images of celebrities from their names.
    The whole method depends on SDXL's built-in ability to map name embeddings to a consistent face; if this failed, the name embeddings would carry no identity information.
  • domain assumption The text encoder's embedding for a name is disentangled from semantic content.
    The Name Prepending operation assumes that inserting the name embedding after the start token will not corrupt the prompt's meaning; the paper provides only qualitative evidence (Figure 2).
  • domain assumption An encoder trained on celebrity name-image pairs generalizes to non-celebrity identities.
    The method's central claim for 'generic identities' requires the image encoder to predict useful name embeddings for faces outside LaionCele.
  • domain assumption The face recognition model used to filter LaionCele and to compute ID consistency is a valid identity measure.
    Both dataset construction (supplementary steps 5 and 7) and evaluation use face recognition; any systematic bias will inflate consistency scores.
  • domain assumption Prepended name embeddings do not shift the text embedding space.
    The paper argues lower FID to SDXL shows preserved semantics, relying on the assumption that name prepending does not distort the conditioning signal.
invented entities (1)
  • Name Space (N Space) independent evidence
    purpose: A hypothesized continuous space of name embeddings where each point corresponds to an identity; used to justify predicting an embedding for arbitrary faces and to support interpolation for fictional identities.
    The paper provides testable handles: sampling an interpolated point yields a generated identity, so the space is falsifiable in principle. However, the paper does not show the space is dense or that every point corresponds to a valid identity.

how reviews work

0 comments
Cite this review

Pith. "Pith review of MagicNaming: Consistent Identity Generation by Finding a "Name Space" in T2I Diffusion Models." pith.science (2026). https://pith.science/paper/JBWWKHVH

@misc{pith2026241214902,
  author       = {Pith},
  title        = {Pith review of: MagicNaming: Consistent Identity Generation by Finding a "Name Space" in T2I Diffusion Models},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/JBWWKHVH}},
  note         = {Machine review of arXiv:2412.14902}
}
read the original abstract

Large-scale text-to-image diffusion models, (e.g., DALL-E, SDXL) are capable of generating famous persons by simply referring to their names. Is it possible to make such models generate generic identities as simple as the famous ones, e.g., just use a name? In this paper, we explore the existence of a "Name Space", where any point in the space corresponds to a specific identity. Fortunately, we find some clues in the feature space spanned by text embedding of celebrities' names. Specifically, we first extract the embeddings of celebrities' names in the Laion5B dataset with the text encoder of diffusion models. Such embeddings are used as supervision to learn an encoder that can predict the name (actually an embedding) of a given face image. We experimentally find that such name embeddings work well in promising the generated image with good identity consistency. Note that like the names of celebrities, our predicted name embeddings are disentangled from the semantics of text inputs, making the original generation capability of text-to-image models well-preserved. Moreover, by simply plugging such name embeddings, all variants (e.g., from Civitai) derived from the same base model (i.e., SDXL) readily become identity-aware text-to-image models. Project homepage: \url{https://magicfusion.github.io/MagicNaming/}.

Figures

Figures reproduced from arXiv: 2412.14902 by the authors.

Figure 1
Figure 1. Consistent Identity Generation by fetching”names” from the ”Name Space”. [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Name embeddings and textual semantics are dis [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗
Figure 3
Figure 3. Overview of the Proposed Method. (a) Dataset Construction. Celebrity images and their corresponding names were [PITH_FULL_IMAGE:figures/full_fig_p003_3.png] view at source ↗
Figures from the paper (12 more)
Figure 4
Figure 4. Figure 4: Visualization and Comparison. The results concludes four tasks, i.e., scene construction, stylization, action control [PITH_FULL_IMAGE:figures/full_fig_p006_4.png]
Figure 5
Figure 5. Figure 5: A fictional character is created by interpolating, [PITH_FULL_IMAGE:figures/full_fig_p007_5.png]
Figure 7
Figure 7. Figure 7: Application on StyleUnet: By integrating a “name” [PITH_FULL_IMAGE:figures/full_fig_p007_7.png]
Figure 8
Figure 8. Figure 8: U-Net Fine-Tuning Flowchart. Concurrently with [PITH_FULL_IMAGE:figures/full_fig_p011_8.png]
Figure 9
Figure 9. Figure 9: This figure demonstrates the identity and semantic consistency of our work in the decorative generation tasks. [PITH_FULL_IMAGE:figures/full_fig_p014_9.png]
Figure 10
Figure 10. Figure 10: The supplementary cases demonstrating ID consistency and semantic consistency in the emotional editing tasks. [PITH_FULL_IMAGE:figures/full_fig_p015_10.png]
Figure 11
Figure 11. Figure 11: The supplementary cases demonstrating ID consistency and semantic consistency in the stylization generation tasks. [PITH_FULL_IMAGE:figures/full_fig_p016_11.png]
Figure 12
Figure 12. Figure 12: The supplementary cases demonstrating ID consistency and semantic consistency in the action control generation [PITH_FULL_IMAGE:figures/full_fig_p017_12.png]
Figure 13
Figure 13. Figure 13: The supplementary cases demonstrating ID consistency and semantic consistency in the action control generation [PITH_FULL_IMAGE:figures/full_fig_p018_13.png]
Figure 14
Figure 14. Figure 14: The experimental data presented in Table 2 of the main text indicate that fine-tuning enhances generative ID consis [PITH_FULL_IMAGE:figures/full_fig_p019_14.png]
Figure 15
Figure 15. Figure 15: The experimental data presented in Table 2 of the main text indicate that fine-tuning enhances generative ID consis [PITH_FULL_IMAGE:figures/full_fig_p020_15.png]
Figure 16
Figure 16. Figure 16: The construction process of LaionCele dataset. [PITH_FULL_IMAGE:figures/full_fig_p021_16.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

53 extracted references · 28 canonical work pages

  1. [1]

    , " * write output.state after.block = add.period write newline

    ENTRY address archivePrefix author booktitle chapter edition editor eid eprint howpublished institution isbn journal key month note number organization pages publisher school series title type volume year label extra.label sort.label short.list INTEGERS output.state before.all mid.sentence after.sentence after.block FUNCTION init.state.consts #0 'before.a...

  2. [2]

    write newline

    " write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 global.max substring 't := if while FUNCTION word.in bbl.in capitalize " " * FUNCT...

  3. [3]

    Alaluf, Y.; Richardson, E.; Metzer, G.; and Cohen - Or, D. 2023. A Neural Space-Time Representation for Text-to-Image Personalization. ACM Trans. Graph. , 42(6): 243:1--243:10

  4. [4]

    Arar, M.; Gal, R.; Atzmon, Y.; Chechik, G.; Cohen - Or, D.; Shamir, A.; and Bermano, A. H. 2023. Domain-Agnostic Tuning-Encoder for Fast Personalization of Text-To-Image Models. In SIGGRAPH Asia , 72:1--72:10. ACM

  5. [5]

    Avrahami, O.; Lischinski, D.; and Fried, O. 2022. Blended Diffusion for Text-driven Editing of Natural Images. In CVPR , 18187--18197. IEEE

  6. [6]

    Banerjee, S.; Mittal, G.; Joshi, A.; Hegde, C.; and Memon, N. D. 2023. Identity-Preserving Aging of Face Images via Latent Diffusion Models. In IJCB , 1--10. IEEE

  7. [7]

    S.; and Sun, L

    Cao, Y.; Li, S.; Liu, Y.; Yan, Z.; Dai, Y.; Yu, P. S.; and Sun, L. 2023. A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT. CoRR, abs/2303.04226

  8. [8]

    Chen, H.; Zhang, Y.; Wang, X.; Duan, X.; Zhou, Y.; and Zhu, W. 2023 a . DisenBooth: Identity-Preserving Disentangled Tuning for Subject-Driven Text-to-Image Generation. CoRR, abs/2305.03374

Show all 53 references
  1. [9]

    Chen, L.; Zhao, M.; Liu, Y.; Ding, M.; Song, Y.; Wang, S.; Wang, X.; Yang, H.; Liu, J.; Du, K.; and Zheng, M. 2023 b . PhotoVerse: Tuning-Free Image Customization with Text-to-Image Diffusion Models. CoRR, abs/2309.05793

  2. [10]

    Chen, M.; Chu, H.; and Wei, X. 2021. Flocking Control Algorithms Based on the Diffusion Model for Unmanned Aerial Vehicle Systems. IEEE Trans. Green Commun. Netw. , 5(3): 1271--1282

  3. [11]

    Elarabawy, A.; Kamath, H.; and Denton, S. 2022. Direct Inversion: Optimization-Free Text-Driven Real Image Editing with Diffusion Models. CoRR, abs/2211.07825

  4. [12]

    H.; Chechik, G.; and Cohen - Or, D

    Gal, R.; Alaluf, Y.; Atzmon, Y.; Patashnik, O.; Bermano, A. H.; Chechik, G.; and Cohen - Or, D. 2023 a . An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion. In ICLR . OpenReview.net

  5. [13]

    H.; Chechik, G.; and Cohen - Or, D

    Gal, R.; Alaluf, Y.; Atzmon, Y.; Patashnik, O.; Bermano, A. H.; Chechik, G.; and Cohen - Or, D. 2023 b . An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion. In ICLR . OpenReview.net

  6. [14]

    H.; Chechik, G.; and Cohen - Or, D

    Gal, R.; Arar, M.; Atzmon, Y.; Bermano, A. H.; Chechik, G.; and Cohen - Or, D. 2023 c . Designing an Encoder for Fast Personalization of Text-to-Image Models. CoRR, abs/2302.12228

  7. [15]

    Hertz, A.; Mokady, R.; Tenenbaum, J.; Aberman, K.; Pritch, Y.; and Cohen - Or, D. 2023. Prompt-to-Prompt Image Editing with Cross-Attention Control. In ICLR . OpenReview.net

  8. [16]

    Hinz, T.; Heinrich, S.; and Wermter, S. 2022. Semantic Object Accuracy for Generative Text-to-Image Synthesis. IEEE Trans. Pattern Anal. Mach. Intell. , 44(3): 1552--1565

  9. [17]

    Ho, J.; Jain, A.; and Abbeel, P. 2020. Denoising Diffusion Probabilistic Models. In Larochelle, H.; Ranzato, M.; Hadsell, R.; Balcan, M.; and Lin, H., eds., NeurIPS

  10. [18]

    Ho, J.; and Salimans, T. 2022. Classifier-Free Diffusion Guidance. CoRR, abs/2207.12598

  11. [19]

    Hua, M.; Liu, J.; Ding, F.; Liu, W.; Wu, J.; and He, Q. 2023. DreamTuner: Single Image is Enough for Subject-Driven Generation. CoRR, abs/2312.13691

  12. [20]

    Ku, M.; Li, T.; Zhang, K.; Lu, Y.; Fu, X.; Zhuang, W.; and Chen, W. 2023. ImagenHub: Standardizing the evaluation of conditional image generation models. CoRR, abs/2310.01596

  13. [21]

    Kumari, N.; Zhang, B.; Zhang, R.; Shechtman, E.; and Zhu, J. 2023. Multi-Concept Customization of Text-to-Image Diffusion. In CVPR , 1931--1941. IEEE

  14. [22]

    Li, C.; Zhang, C.; Waghwase, A.; Lee, L.; Rameau, F.; Yang, Y.; Bae, S.; and Hong, C. S. 2023 a . Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era. CoRR, abs/2305.06131

  15. [23]

    Li, W.; Wen, S.; Shi, K.; Yang, Y.; and Huang, T. 2022. Neural Architecture Search With a Lightweight Transformer for Text-to-Image Synthesis. IEEE Trans. Netw. Sci. Eng. , 9(3): 1567--1576

  16. [24]

    Li, Z.; Cao, M.; Wang, X.; Qi, Z.; Cheng, M.; and Shan, Y. 2023 b . PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding. CoRR, abs/2312.04461

  17. [25]

    Liu, N.; Li, S.; Du, Y.; Torralba, A.; and Tenenbaum, J. B. 2022. Compositional Visual Generation with Composable Diffusion Models. In ECCV (17) , volume 13677 of Lecture Notes in Computer Science, 423--439. Springer

  18. [26]

    Liu, V.; and Chilton, L. B. 2022. Design Guidelines for Prompt Engineering Text-to-Image Generative Models. In CHI , 384:1--384:23. ACM

  19. [27]

    Liu, X.; Zhang, X.; Ma, J.; Peng, J.; and Liu, Q. 2023 a . InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generation. CoRR, abs/2309.06380

  20. [28]

    Liu, Z.; Feng, R.; Zhu, K.; Zhang, Y.; Zheng, K.; Liu, Y.; Zhao, D.; Zhou, J.; and Cao, Y. 2023 b . Cones: Concept Neurons in Diffusion Models for Customized Generation. In ICML , volume 202 of Proceedings of Machine Learning Research, 21548--21566. PMLR

  21. [29]

    Ma, J.; Liang, J.; Chen, C.; and Lu, H. 2023. Subject-Diffusion: Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuning. CoRR, abs/2307.11410

  22. [30]

    Peng, X.; Zhu, J.; Jiang, B.; Tai, Y.; Luo, D.; Zhang, J.; Lin, W.; Jin, T.; Wang, C.; and Ji, R. 2023. PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalization. CoRR, abs/2312.06354

  23. [31]

    P.; and Maragos, P

    Pikoulis, I.; Filntisis, P. P.; and Maragos, P. 2023. Photorealistic and Identity-Preserving Image-Based Emotion Manipulation with Latent Diffusion Models. CoRR, abs/2308.03183

  24. [32]

    Prabhudesai, M.; Goyal, A.; Pathak, D.; and Fragkiadaki, K. 2023. Aligning Text-to-Image Diffusion Models with Reward Backpropagation. CoRR, abs/2310.03739

  25. [33]

    Ramesh, A.; Dhariwal, P.; Nichol, A.; Chu, C.; and Chen, M. 2022. Hierarchical Text-Conditional Image Generation with CLIP Latents. CoRR, abs/2204.06125

  26. [34]

    Rombach, R.; Blattmann, A.; Lorenz, D.; Esser, P.; and Ommer, B. 2022. High-Resolution Image Synthesis with Latent Diffusion Models. In CVPR , 10674--10685. IEEE

  27. [35]

    Ronneberger, O.; Fischer, P.; and Brox, T. 2015 a . U-Net: Convolutional Networks for Biomedical Image Segmentation. In MICCAI (3) , volume 9351 of Lecture Notes in Computer Science, 234--241. Springer

  28. [36]

    Ronneberger, O.; Fischer, P.; and Brox, T. 2015 b . U-Net: Convolutional Networks for Biomedical Image Segmentation. In Navab, N.; Hornegger, J.; III, W. M. W.; and Frangi, A. F., eds., Medical Image Computing and Computer-Assisted Intervention - MICCAI 2015 - 18th Internation...

  29. [37]

    Ruiz, N.; Li, Y.; Jampani, V.; Pritch, Y.; Rubinstein, M.; and Aberman, K. 2023. DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation. In CVPR , 22500--22510. IEEE

  30. [38]

    Schroff, F.; Kalenichenko, D.; and Philbin, J. 2015. FaceNet: A unified embedding for face recognition and clustering. In CVPR , 815--823. IEEE Computer Society

  31. [39]

    Shan, S.; Ding, W.; Passananti, J.; Zheng, H.; and Zhao, B. Y. 2023. Prompt-Specific Poisoning Attacks on Text-to-Image Generative Models. CoRR, abs/2310.13828

  32. [40]

    Song, J.; Meng, C.; and Ermon, S. 2021. Denoising Diffusion Implicit Models. In ICLR

  33. [41]

    Taigman, Y.; Yang, M.; Ranzato, M.; and Wolf, L. 2014. DeepFace: Closing the Gap to Human-Level Performance in Face Verification. In CVPR , 1701--1708. IEEE Computer Society

  34. [42]

    Tumanyan, N.; Geyer, M.; Bagon, S.; and Dekel, T. 2023. Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translation. In CVPR , 1921--1930. IEEE

  35. [43]

    Valevski, D.; Lumen, D.; Matias, Y.; and Leviathan, Y. 2023. Face0: Instantaneously Conditioning a Text-to-Image Model on a Face. In SIGGRAPH Asia , 94:1--94:10. ACM

  36. [44]

    von Platen, P.; Patil, S.; Lozhkov, A.; Cuenca, P.; Lambert, N.; Rasul, K.; Davaadorj, M.; and Wolf, T. 2022. Diffusers: State-of-the-art diffusion models. https://github.com/huggingface/diffusers

  37. [45]

    Wang, Q.; Bai, X.; Wang, H.; Qin, Z.; and Chen, A. 2024. InstantID: Zero-shot Identity-Preserving Generation in Seconds. CoRR, abs/2401.07519

  38. [46]

    Wei, Y.; Zhang, Y.; Ji, Z.; Bai, J.; Zhang, L.; and Zuo, W. 2023. ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generation. In ICCV , 15897--15907. IEEE

  39. [47]

    T.; Durand, F.; and Han, S

    Xiao, G.; Yin, T.; Freeman, W. T.; Durand, F.; and Han, S. 2023. FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention. CoRR, abs/2305.10431

  40. [48]

    Xie, J.; Li, Y.; Huang, Y.; Liu, H.; Zhang, W.; Zheng, Y.; and Shou, M. Z. 2023. BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusion. In ICCV , 7418--7427. IEEE

  41. [49]

    Yan, Y.; Zhang, C.; Wang, R.; Zhou, Y.; Zhang, G.; Cheng, P.; Yu, G.; and Fu, B. 2023. FaceStudio: Put Your Face Everywhere in Seconds. CoRR, abs/2312.02663

  42. [50]

    Ye, H.; Zhang, J.; Liu, S.; Han, X.; and Yang, W. 2023. IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models. CoRR, abs/2308.06721

  43. [51]

    Yuan, G.; Cun, X.; Zhang, Y.; Li, M.; Qi, C.; Wang, X.; Shan, Y.; and Zheng, H. 2023. Inserting Anybody in Diffusion Models via Celeb Basis. In Thirty-seventh Conference on Neural Information Processing Systems

  44. [52]

    Zhang, B.; Qi, C.; Zhang, P.; Zhang, B.; Wu, H.; Chen, D.; Chen, Q.; Wang, Y.; and Wen, F. 2023. MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptation. In CVPR , 22096--22105. IEEE

  45. [53]

    Zhang, Z.; Chen, H.; Yin, X.; and Deng, J. 2021. Joint Generative Image Deblurring Aided by Edge Attention Prior and Dynamic Kernel Selection. Wirel. Commun. Mob. Comput., 2021: 1391801:1--1391801:14

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.