REVIEW 12 cited by
GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
We introduce GaussianAvatars, a new method to create photorealistic head avatars that are fully controllable in terms of expression, pose, and viewpoint. The core idea is a dynamic 3D representation based on 3D Gaussian splats that are rigged to a parametric morphable face model. This combination facilitates photorealistic rendering while allowing for precise animation control via the underlying parametric model, e.g., through expression transfer from a driving sequence or by manually changing the morphable model parameters. We parameterize each splat by a local coordinate frame of a triangle and optimize for explicit displacement offset to obtain a more accurate geometric representation. During avatar reconstruction, we jointly optimize for the morphable model parameters and Gaussian splat parameters in an end-to-end fashion. We demonstrate the animation capabilities of our photorealistic avatar in several challenging scenarios. For instance, we show reenactments from a driving video, where our method outperforms existing works by a significant margin.
Forward citations
Cited by 12 Pith papers
-
EmpaAva: An Open-source Agentic 3D-Avatar Empathetic Live Chatbot
EmpaAva is an open-source, LLM-orchestrated 3D avatar chatbot that perceives user affect from speech and video, plans empathetic replies, and delivers them with synchronized emotional speech and facial motion.
-
3D$^2$-Actor: Learning Pose-Conditioned 3D-Aware Denoiser for Realistic Gaussian Avatar Modeling
3D2-Actor interleaves pose-conditioned 2D denoising with 3D Gaussian rectification to generate realistic, temporally consistent human avatars from multi-view video.
-
GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusion
A normal-map-conditioned multi-view head diffusion model generates pseudo-ground-truth views that regularize Gaussian avatar optimization, improving reconstruction of unobserved head regions from monocular videos.
-
GASP: Gaussian Avatars with Synthetic Priors
GASP trains a Gaussian-avatar prior on synthetic humans, then fits and fine-tunes it to a single photo or monocular video to obtain real-time animatable 360-degree avatars.
-
QUEEN: QUantized Efficient ENcoding of Dynamic Gaussians for Streaming Free-viewpoint Videos
QUEEN compresses per-frame Gaussian residuals with learned quantization and gating, reaching about 0.7 MB per frame, under 5 seconds of training, and 350 FPS rendering on dynamic scenes.
-
GaussianSpeech: Audio-Driven Gaussian Avatars
A transformer-based sequence model drives a lightweight 3D Gaussian avatar from audio, producing synchronized, photorealistic talking-head animations with a new 16-camera dataset.
-
ConsistentAvatar: Learning to Diffuse Fully Consistent Talking Head Avatar with Temporal Guidance
ConsistentAvatar aligns a Fourier high-frequency detail map through a diffusion model and uses it, with normals and emotion text, to condition talking-head avatar generation, reducing temporal and expression inconsistency.
-
S-Avatar: Diffusion-Guided Gaussian Head Avatars from a Single Image
A three-stage pipeline generates animatable 3D Gaussian head avatars from one image by diffusion-based splat synthesis, FLAME fitting, and inverse-distance binding with scale adaptation.
-
HairGS: Hair Strand Reconstruction based on 3D Gaussian Splatting
HairGS reconstructs 3D hair strands from multi-view images in about one hour by fitting 3D Gaussians, merging them into strands with distance and direction rules, and refining them against the photos.
-
SignSplat: Rendering Sign Language via Gaussian Splatting
SignSplat renders photo-realistic sign language by anchoring Gaussian splats to an SMPL-X body mesh with regularized optimization and adaptive densification, claiming state-of-the-art results on NeuMan, X-Humans, and ...
-
Interactive Holographic Visualization for 3D Facial Avatar
A proof-of-concept pipeline that generates real-time 3D facial expressions using a Transformer-based predictor and renders them on a light-field display via 3D Gaussian Splatting, intended for pain-assessment training.
-
GaussianAvatar-Editor: Photorealistic Animatable Gaussian Head Avatar Editor
GaussianAvatar-Editor adds a visibility-weighted alpha blending term and a temporal adversarial loss to make text-driven edits of animatable Gaussian head avatars robust to motion occlusion and 4D inconsistency.
Discussion (0). Continue with ORCID to comment.