IF-MDM generates talking-head videos by diffusing a compact implicit motion code conditioned on speech and on hand-set motion statistics, achieving real-time speed but with lip-sync metrics worse than an explicit 3DMM baseline.
Classifier-free diffusion guidance
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
method 1
citation-polarity summary
fields
cs.CV 1years
2024 1verdicts
CONDITIONAL 1roles
method 1polarities
use method 1representative citing papers
citing papers explorer
-
IF-MDM: Implicit Face Motion Diffusion Model for High-Fidelity Realtime Talking Head Generation
IF-MDM generates talking-head videos by diffusing a compact implicit motion code conditioned on speech and on hand-set motion statistics, achieving real-time speed but with lip-sync metrics worse than an explicit 3DMM baseline.