Pith. sign in

REVIEW 9 cited by

ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preserving

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2404.16771 v2 pith:ZLI7HWCF submitted 2024-04-25 cs.CV cs.AI

Jiehui Huang , Xiao Dong , Wenhui Song , Zheng Chong , Zhenchao Tang , Jun Zhou , Yuhao Cheng , Long Chen
show 4 more authors
Hanhui Li Yiqiang Yan Shengcai Liao Xiaodan Liang
This is my paper
classification cs.CVcs.AI
keywords facialconsistentidfine-grainedmultimodalgenerationexistingportraitcomponents
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Diffusion-based technologies have made significant strides, particularly in personalized and customized facialgeneration. However, existing methods face challenges in achieving high-fidelity and detailed identity (ID)consistency, primarily due to insufficient fine-grained control over facial areas and the lack of a comprehensive strategy for ID preservation by fully considering intricate facial details and the overall face. To address these limitations, we introduce ConsistentID, an innovative method crafted for diverseidentity-preserving portrait generation under fine-grained multimodal facial prompts, utilizing only a single reference image. ConsistentID comprises two key components: a multimodal facial prompt generator that combines facial features, corresponding facial descriptions and the overall facial context to enhance precision in facial details, and an ID-preservation network optimized through the facial attention localization strategy, aimed at preserving ID consistency in facial regions. Together, these components significantly enhance the accuracy of ID preservation by introducing fine-grained multimodal ID information from facial regions. To facilitate training of ConsistentID, we present a fine-grained portrait dataset, FGID, with over 500,000 facial images, offering greater diversity and comprehensiveness than existing public facial datasets. % such as LAION-Face, CelebA, FFHQ, and SFHQ. Experimental results substantiate that our ConsistentID achieves exceptional precision and diversity in personalized facial generation, surpassing existing methods in the MyStyle dataset. Furthermore, while ConsistentID introduces more multimodal ID information, it maintains a fast inference speed during generation.

Discussion (0). Sign in to comment.

Forward citations

Cited by 9 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Face De-Identification: A Domain-Centric Survey from Capture to Processing

    cs.CV 2026-07 accept novelty 6.0 of 10

    A structured survey of 112 face de-identification methods, organized by physical, sensor, and digital domains, with an analysis of fragmented evaluation protocols.

  2. Mixed-Modality Dual Face-Hair Retrieval

    cs.CV 2026-06 unverdicted novelty 6.0 of 10

    Introduces DFHR task, DFHR-Bench with over 180K triplets, and MFHC framework for mixed-modality dual face-hair retrieval.

  3. Adversarial Concept Distillation for One-Step Diffusion Personalization

    cs.CV 2025-10 unverdicted novelty 6.0 of 10

    OPAD enables reliable high-quality personalization of one-step diffusion models via multi-step teacher distillation combined with adversarial alignment losses.

  4. LaVieID: Local Autoregressive Diffusion Transformers for Identity-Preserving Video Creation

    cs.CV 2025-08 conditional novelty 6.0 of 10

    LaVieID improves identity-preserving text-to-video by routing local facial parts into early DiT blocks and autoregressively refining denoised video tokens in temporal chunks.

  5. Show and Polish: Reference-Guided Identity Preservation in Face Video Restoration

    cs.CV 2025-07 conditional novelty 6.0 of 10

    IP-FVR restores degraded face videos with consistent identity by conditioning a video diffusion model on a reference photo of the same person.

  6. Analyzing and Improving Speaker Similarity Assessment for Speech Synthesis

    cs.SD 2025-07 conditional novelty 6.0 of 10

    ASV embeddings used to judge whether synthesized speech matches a target speaker mostly encode static spectral traits and miss rhythm, so the authors introduce U3D, a duration-distribution metric for speaker rhythm.

  7. InfinityHuman: Towards Long-Term Audio-Driven Human

    cs.CV 2025-08 conditional novelty 5.0 of 10

    A coarse-to-fine audio-driven animation framework that uses pose-guided refinement and hand-specific reward learning to generate long, identity-stable talking videos.

  8. StableAnimator++: Overcoming Pose Misalignment and Face Distortion for Human Image Animation

    cs.CV 2025-07 conditional novelty 5.0 of 10

    StableAnimator++ combines learnable SVD-guided pose alignment, a distribution-aware ID Adapter, and an HJB-based inference-time face optimizer to preserve identity in human image animation under severe pose misalignment.

  9. Intelligent Agents with Emotional Intelligence: Current Trends, Challenges, and Future Prospects

    cs.HC 2025-10 unverdicted novelty 2.0 of 10

    A holistic survey of affective computing for intelligent agents covering emotion understanding via multimodal data, affective cognition, emotional expression synthesis, key challenges, and future directions emphasizin...

Pith tools