REVIEW 3 major objections 5 minor 5 cited by
CharacterShot: Controllable and Consistent 4D Character Animation
T0 review · 3 major / 5 minor · reviewed 2026-08-05 · deepseek-v4-flash
Pith's one-line read CharacterShot claims that a single reference character image and a 2D pose sequence, run through a pose-conditioned diffusion transformer and a neighbor-constrained 4D Gaussian-splat reconstruction, can yield a controllable, view-consistent
desk verdict Solid systems paper with a genuinely new task setting, but the headline consistency numbers are measured against the model's own outputs, so the SOTA claim is not yet earned. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The dual-attention module: it processes video tokens in two arrangements at once—frames grouped within each view and views grouped within each frame—using parallel full-attention blocks, so spatial-temporal and spatial-view coherence are learned jointly rather than through separate attention mechanisms. The other load-bearing piece is neighbor-constrained 4D Gaussian splatting (4DGS): a coarse-to-fine optimization of deformable 3D Gaussians over time, where a neighbor loss compares each point's displacement from its local group center between consecutive frames and is activated by a binary gate only when a point moves beyond a threshold. That gate stops noisy outlier points from dragging loc
What would settle it
Run CharacterShot on a character from Character4D whose true 3D mesh and motion are known, then render the optimized 4D Gaussians at a held-out camera viewpoint and time that were not used in the multi-view video set, and measure image distance against a rendering of the true mesh. If the held-out novel-view error is close to the reported training-view numbers, the consistency is real; if it degrades sharply, the consistency was an artifact of optimizing against self-generated videos.
Extended reading notes
Core claim
CharacterShot's central claim is that a dynamic 3D character can be generated directly from one reference image and a 2D pose sequence, bypassing the usual CGI chain of modeling, rigging, and motion capture. The paper builds this around a diffusion-transformer video model that is made pose-controllable in a pretraining stage, then extended to generate several synchronized viewpoints through a dual-attention module and a camera prior. The multi-view videos are lifted into a 4D representation by a coarse-to-fine Gaussian-splatting optimization with a neighbor constraint designed to suppress view-to-view outliers. With these pieces, the authors report that CharacterShot preserves the character'
Load-bearing premise
Everything in the final 4D result is only as trustworthy as the multi-view videos produced earlier, and the paper's own benchmark treats those generated videos as the ground truth for the 4D stage, so errors introduced by the generator can become permanent without being measured.
Editorial extensions
If this is right
- Pose-controlled 4D animation becomes accessible to non-specialists: the reported pipeline takes 20–40 minutes for multi-view video generation plus about 30 minutes for 4D optimization on one H800 GPU, and needs only a character image and a skeleton sequence as input.
- Any existing 2D pose data—from dance videos, motion libraries, or manual keyframing—can be retargeted onto arbitrary characters, since the motion signal is just a 2D pose sequence.
- Because the dual-attention module learns spatial-temporal and spatial-view consistency jointly, the same animated character can be rendered from arbitrary viewpoints without per-view training.
- The neighbor constraint specifically targets artifacts like disappearing hands and outlier 3D points, which earlier 4D-Gaussian methods exhibit when optimized on generated multi-view videos.
Reading between the lines
- The paper does not state this, but if the multi-view generator produces systematic artifacts, the 4D benchmark's pseudo-ground-truth comparison will hide them; an evaluation on independent 3D scans or held-out rendered views is the natural next check.
- The paper does not state this, but the pose-conditioned 2D animator is a standalone product: it can animate any character image with any pose sequence even if the 4D reconstruction stage is never run.
- The paper does not state this, but the same pipeline could be driven by real-time skeleton tracking to make an animatable avatar, provided the generation latency drops from tens of minutes to near-interactive speeds.
- The paper does not state this, but the out-of-distribution generalization claim is primarily perceptual rather than geometric, because the benchmark mixes in-house rendered characters with internet and model-generated images rated by 30 human volunteers.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes CharacterShot, a framework for 4D character animation from a single reference character image and a 2D pose sequence. The method consists of three stages: (i) fine-tuning the DiT-based image-to-video model CogVideoX with pose conditioning to obtain a 2D character animation model; (ii) extending it to multi-view video generation via a dual-attention module and camera priors, with a separately fine-tuned SV3D view generator; and (iii) optimizing a neighbor-constrained 4D Gaussian Splatting representation from the generated multi-view videos. The authors also introduce Character4D, a large dataset of 13,115 VRoidHub characters with rigged motions and multi-view renders, and CharacterBench, a benchmark built from this dataset plus out-of-distribution characters. Quantitative comparisons on CharacterBench claim consistent SOTA improvements over SV3D, SV4D, Diffusion2, STAG4D, SC4D, L4GM, and DG4D across SSIM, LPIPS, CLIP-S, FVD variants, and FV4D. The paper includes ablations of the dual-attention module, the neighbor-constrained 4DGS, and the dataset contribution, plus a 30-participant user study for out-of-Character4D characters.
Significance. If the claims hold, CharacterShot would be a practically valuable system: it turns a single character image and a pose sequence into a view-consistent, temporally coherent 4D representation in tens of minutes without hand modeling or motion capture. The proposed large-scale character dataset and benchmark could also be useful resources for the community. The dual-attention design is a reasonable and potentially effective way to couple spatial-temporal and spatial-view information, and the neighbor constraint for 4DGS is a sensible robustness measure. However, the current evidence for the central claim of 3D/4D consistency is weakened by a substantial evaluation-circularity issue: the 4D optimization stage is evaluated against the same generated multi-view videos that supervise it, and all quantitative comparisons lack error bars or significance tests. These are fixable through additional evaluation against independent 3D ground truth and proper statistical reporting, so the paper's core idea is not invalidated, but the strength of the empirical claims is currently disproportionate to the evidence.
major comments (3)
- [Table 4, Sec. 3.4/4.3] The only quantitative evaluation of the 4D optimization stage uses pseudo ground truth: Table 4's caption states 'Ground truths are generated multi-view videos.' Because these same generated videos are the supervision for the 4DGS optimization and the reference for SSIM/LPIPS/FVD-F/FV4D, the metrics largely measure how well the 4D representation reproduces the generator's own outputs, not true 3D consistency. Cross-view inconsistencies in the generator could be absorbed by the 4D representation as blur or floaters while still scoring high against the same pseudo-GT. Please evaluate the 4D stage against independent 3D ground truth from the Character4D test set (e.g., held-out characters with ground-truth multi-view renders, and optionally mesh/geometry metrics such as Chamfer distance or normal consistency), or at minimum report per-sample metrics that separate view-consistency from frame
- [Table 2 and Table 7, Sec. 4.2/B.2] The end-to-end comparison in Table 2 is confounded by the input presented to each baseline: SV4D, Diffusion2, STAG4D, SC4D, L4GM, and DG4D are driven by single-view videos generated by a separately fine-tuned MimicMotion, while CharacterShot receives the reference image and pose sequence. Table 7 confirms that L4GM's performance is sensitive to input video quality (SSIM 0.904 with original, 0.907 with fine-tuned, 0.916 with ground-truth single-view video). This shows that a non-trivial part of the observed margin may reflect the quality of the generated single-view input rather than the proposed 4D representation. Please provide an ablation that gives the baselines access to ground-truth single-view videos (or otherwise controls for input quality) and report the comparison in that condition, alongside the current setup.
- [Tables 1-8, Sec. 4] No error bars, confidence intervals, or significance tests are reported for any quantitative result. While the reported margins are large, the absence of any statistical characterization makes it impossible to assess stability across test samples, especially given that the benchmark is constructed by the authors from their own dataset. Please report standard deviations or confidence intervals over CharacterBench samples, and where feasible run a paired significance test (e.g., Wilcoxon signed-rank) for the primary comparisons. This is particularly important for the 4D optimization comparison in Table 4, where the pseudo-GT setup already narrows the gap between methods.
minor comments (5)
- [Eq. (4)-(6), Sec. 3.4] The neighbor loss uses the symbol u_t_i, but u is not defined before its use. Please define it (presumably the position of Gaussian i at time t) and clarify the dimension of L_t_i.
- [Sec. 3.5] There is a typo: 'Objverse' should be 'Objaverse' in Section 2.2 context; the reference [8] is Objaverse. Also, 'followed [84]' in Sec. 3.4 should be 'following [84]'.
- [Fig. 8] The caption says 'G-Mesh' but the text and references use 'DG-Mesh'. Please make the naming consistent.
- [Abstract & Sec. 1] Minor typo: 'sequnce' should be 'sequence' in the abstract. Also, the claim 'first DiT-based 4D character animation framework' should be checked against Human4DiT (cited as [57]), which is also DiT-based and handles 4D human generation; the distinction should be stated clearly (e.g., 'from a single reference image and 2D pose sequence') to avoid overclaiming.
- [Appendix B.3, Table 8] The user study uses 30 volunteers, which is small. Please report the exact question format, the standard deviation across participants, and whether the differences are statistically significant. Also, a breakdown by character type (anime vs. real vs. AI-generated) would strengthen the out-of-distribution generalization claim.
Circularity Check
The 4D consistency evaluation in Table 4 is a closed loop against the authors' own generated multi-view videos, but the main end-to-end comparison and OOC user study provide independent evidence, so circularity is partial.
-
fitted input called prediction
[Section 4.3, Table 4 (4DGS Optimization)]
"In the fine stage, we utilize a 4D progressive fitting [84] to gradually refine the deformable Gaussians at time t with the grid-based total variation loss LTV [84] and image-space reconstruction losses L1 and LLPIPS from the entire multi-view videos. ... For a fair comparison, we optimize the 4D representations of these methods using our generated multi-view videos (as pseudo ground truth). ... Table 4. Quantitative comparison of 4D optimization on CharacterBench. Ground truths are generated multi-view videos."
The 4DGS stage is optimized with L1 and LPIPS reconstruction losses against the multi-view videos produced by the authors' own generator (Sec. 3.4). Table 4 then reports SSIM, LPIPS, FVD-F, and FV4D between renders of the optimized 4D representation and those same generated videos, explicitly labeling them 'ground truths.' The evaluation reference is therefore the training target itself: the scores primarily measure how faithfully the 4D representation fits the generator's pseudo-GT views, not whether those views are geometrically consistent or whether the 4D result is correct in any independent 3D sense. Inconsistencies in the generator can be absorbed by the 4DGS as blur or floaters without being penalized, so this table cannot validate the paper's central spatial-view consistency claim.
full rationale
The paper's method is a learned pipeline built on external pretrained components (CogVideoX, SV3D, SV4D-style modules), so there is no derivation-level circularity in the architecture itself. The self-citations to prior work by overlapping authors (e.g., HumanVid [75] for dataset curation) are used as pipeline building blocks, not as the sole justification of a contested claim. The main end-to-end comparison in Table 2 and the out-of-Character4D user study (Table 8) provide independent evidence for the headline capability, and Table 7 actually examines input-quality effects rather than hiding them. The most significant circular element is Table 4, where the 4D optimization is both fitted to and evaluated against the authors' own generated multi-view videos, with those videos explicitly called 'ground truths.' This makes the 4D-consistency ablation partially self-referential: it validates reconstruction fidelity to a pseudo-GT that may itself contain view inconsistencies. Because the central end-to-end claim retains independent support, the circularity is partial rather than total, giving a score of 4.
Assumptions & free parameters
free parameters (3)
- Fine-stage loss weights lambda_1, lambda_2, lambda_3, lambda_4 =
1, 0.01, 1, 1
- Neighbor displacement threshold tau =
not reported
- Neighborhood size |N(i)| =
20
assumptions (5)
- domain assumption CogVideoX-I2V-5B provides a strong and adaptable video prior.
- domain assumption SV3D provides a controllable camera prior and multi-view synthesis base.
- domain assumption DWpose pose estimation is reliable for diverse characters.
- domain assumption VRoidHub characters plus Mixamo motions represent the target distribution of any character and motion.
- domain assumption Synthetic multi-view renderings are valid supervision for 4DGS optimization.
Cite this review
Pith. "Pith review of CharacterShot: Controllable and Consistent 4D Character Animation." pith.science (2026). https://pith.science/paper/LQ5FONPB
@misc{pith2026250807409,
author = {Pith},
title = {Pith review of: CharacterShot: Controllable and Consistent 4D Character Animation},
year = {2026},
howpublished = {\url{https://pith.science/paper/LQ5FONPB}},
note = {Machine review of arXiv:2508.07409}
}
read the original abstract
In this paper, we propose \textbf{CharacterShot}, a controllable and consistent 4D character animation framework that enables any individual designer to create dynamic 3D characters (i.e., 4D character animation) from a single reference character image and a 2D pose sequence. We begin by pretraining a powerful 2D character animation model based on a cutting-edge DiT-based image-to-video model, which allows for any 2D pose sequnce as controllable signal. We then lift the animation model from 2D to 3D through introducing dual-attention module together with camera prior to generate multi-view videos with spatial-temporal and spatial-view consistency. Finally, we employ a novel neighbor-constrained 4D gaussian splatting optimization on these multi-view videos, resulting in continuous and stable 4D character representations. Moreover, to improve character-centric performance, we construct a large-scale dataset Character4D, containing 13,115 unique characters with diverse appearances and motions, rendered from multiple viewpoints. Extensive experiments on our newly constructed benchmark, CharacterBench, demonstrate that our approach outperforms current state-of-the-art methods. Code, models, and datasets will be publicly available at https://github.com/Jeoyal/CharacterShot.
Figures
Figures from the paper (7 more)
Forward citations
Cited by 5 Pith papers
-
UMI3D: Robust 3D Generation on Unconstrained Multi-Image Inputs via Simultaneous Focus Cross-Attention Routing
Routing each 3D voxel to its most informative conditioning image via a model-intrinsic Voxel Reference Score unlocks robust unconstrained multi-image 3D generation without retraining.
-
Follow Your Track: Precise Skeleton Animation Controlled by 3D Trajectories
ACT is a trajectory-conditioned framework for topology-general skeletal animation that injects 3D point trajectories from monocular video into skeletons via a Routed Trajectory Injector for improved fidelity and tempo...
-
Controllable Dynamic 3D Shape Generation via 3D Trajectories and Text
T2Mo generates controllable dynamic 3D shapes by conditioning on both text semantics and 3D trajectories with a shape-grounded embedding for arbitrary inputs.
-
DistillAlign: Coordinating Mode Covering and Mode Seeking in Autoregressive Video Distillation
Matching init-to-DMD mode coverage and jointly training DMD with consistency distillation improves AR video distillation quality, coverage, and diversity enough that a 1.3B teacher can beat 14B baselines.
-
MegaStyle: Constructing Diverse and Scalable Style Dataset via Consistent Text-to-Image Style Mapping
A scalable pipeline generates an intra-consistent, inter-diverse 1.4M style image dataset from text-to-image models and uses it to train a style encoder and generalizable style transfer model.
Reference graph
Works this paper leans on
-
[1]
[n. d.]. Mixamo. https://www.mixamo.com
-
[2]
[n. d.]. rokoko. https://www.rokoko.com/
-
[3]
Sherwin Bahmani, Ivan Skorokhodov, Victor Rong, Gordon Wetzstein, Leonidas Guibas, Peter Wonka, Sergey Tulyakov, Jeong Joon Park, Andrea Tagliasacchi, and David B Lindell. 2024. 4d-fy: Text-to-4d generation using hybrid score distillation sampling. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 7996–8006
2024
-
[4]
Caroline Chan, Shiry Ginosar, Tinghui Zhou, and Alexei A Efros. 2019. Ev- erybody dance now. In Proceedings of the IEEE/CVF international conference on computer vision. 5933–5942
2019
-
[5]
Shuhong Chen, Kevin Zhang, Yichun Shi, Heng Wang, Yiheng Zhu, Guoxian Song, Sizhe An, Janus Kristjansson, Xiao Yang, and Matthias Zwicker. 2023. Panic-3d: Stylized single-view 3d reconstruction from portraits of anime charac- ters. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 21068–21077
2023
-
[6]
Zilong Chen, Feng Wang, Yikai Wang, and Huaping Liu. 2024. Text-to-3d using gaussian splatting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 21401–21412
2024
-
[7]
Wei Cheng, Ruixiang Chen, Siming Fan, Wanqi Yin, Keyu Chen, Zhongang Cai, Jingbo Wang, Yang Gao, Zhengming Yu, Zhengyu Lin, et al . 2023. Dna- rendering: A diverse neural actor repository for high-fidelity human-centric rendering. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 19982–19993
2023
-
[8]
Matt Deitke, Dustin Schwenk, Jordi Salvador, Luca Weihs, Oscar Michel, Eli Van- derBilt, Ludwig Schmidt, Kiana Ehsani, Aniruddha Kembhavi, and Ali Farhadi
Show all 114 references
-
[9]
Mengyang Feng, Jinlin Liu, Kai Yu, Yuan Yao, Zheng Hui, Xiefan Guo, Xianhui Lin, Haolan Xue, Chen Shi, Xiaowen Li, et al . 2023. Dreamoving: A human video generation framework based on diffusion models. arXiv e-prints (2023), arXiv–2312
2023
-
[10]
Qijun Gan, Yi Ren, Chen Zhang, Zhenhui Ye, Pan Xie, Xiang Yin, Zehuan Yuan, Bingyue Peng, and Jianke Zhu. 2025. HumanDiT: Pose-Guided Diffusion Transformer for Long-form Human Motion Video Generation. arXiv preprint arXiv:2502.04847 (2025)
2025 arXiv
-
[11]
Junyao Gao, Yanchen Liu, Yanan Sun, Yinhao Tang, Yanhong Zeng, Kai Chen, and Cairong Zhao. 2024. Styleshot: A snapshot on any style. arXiv preprint arXiv:2407.01414 (2024)
2024 arXiv
-
[12]
Junyao Gao, Yanan Sun, Fei Shen, Xin Jiang, Zhening Xing, Kai Chen, and Cairong Zhao. 2025. Faceshot: Bring any character into life. arXiv preprint arXiv:2503.00740 (2025)
2025 arXiv
-
[13]
Pengsheng Guo, Hans Hao, Adam Caccavale, Zhongzheng Ren, Edward Zhang, Qi Shan, Aditya Sankar, Alexander G Schwing, Alex Colburn, and Fangchang Ma
-
[14]
Hao He, Yinghao Xu, Yuwei Guo, Gordon Wetzstein, Bo Dai, Hongsheng Li, and Ceyuan Yang. [n. d.]. CameraCtrl: Enabling Camera Control for Video Diffusion Models. In The Thirteenth International Conference on Learning Representations
-
[15]
arXiv preprint arXiv:2312.02189 (2023)
StableDreamer: Taming Noisy Score Distillation Sampling for Text-to-3D. arXiv preprint arXiv:2312.02189 (2023)
2023 arXiv
-
[16]
Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020. Denoising diffusion probabilistic models. Advances in neural information processing systems 33 (2020), 6840–6851
2020
-
[17]
Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. 2017. Gans trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems 30 (2017)
2017
-
[18]
Li Hu. 2024. Animate anyone: Consistent and controllable image-to-video synthesis for character animation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 8153–8163
2024
-
[19]
Yicong Hong, Kai Zhang, Jiuxiang Gu, Sai Bi, Yang Zhou, Difan Liu, Feng Liu, Kalyan Sunkavalli, Trung Bui, and Hao Tan. 2023. Lrm: Large reconstruction model for single image to 3d. arXiv preprint arXiv:2311.04400 (2023)
2023 arXiv
-
[20]
Hanwen Jiang, Zhenyu Jiang, Yue Zhao, and Qixing Huang. 2023. Leap: Liberate sparse-view 3d modeling from camera poses. arXiv preprint arXiv:2310.01410 (2023)
2023 arXiv
-
[21]
Liangxiao Hu, Hongwen Zhang, Yuxiang Zhang, Boyao Zhou, Boning Liu, Sheng- ping Zhang, and Liqiang Nie. 2024. Gaussianavatar: Towards realistic human avatar modeling from a single video via animatable 3d gaussians. In Proceedings of the IEEE/CVF conference on computer vision a...
2024
-
[22]
Animesh Karnewar, Niloy J Mitra, Andrea Vedaldi, and David Novotny. 2023. Holofusion: Towards photo-realistic 3d generative modeling. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 22976–22985
2023
-
[23]
Yanqin Jiang, Li Zhang, Jin Gao, Weimin Hu, and Yao Yao. 2023. Consistent4d: Consistent 360{\deg} dynamic object generation from monocular video. arXiv preprint arXiv:2311.02848 (2023)
2023 arXiv
-
[24]
Black Forest Labs. 2024. FLUX: Official inference repository for FLUX.1 models. https://github.com/black-forest-labs/flux
2024
-
[25]
Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, and George Drettakis
-
[26]
ACM Trans
3d gaussian splatting for real-time radiance field rendering. ACM Trans. Graph. 42, 4 (2023), 139–1
2023
-
[27]
Weiyu Li, Rui Chen, Xuelin Chen, and Ping Tan. 2023. Sweetdreamer: Align- ing geometric priors in 2d diffusion for consistent text-to-3d. arXiv preprint arXiv:2310.02596 (2023)
2023 arXiv
-
[28]
Jiahao Li, Hao Tan, Kai Zhang, Zexiang Xu, Fujun Luan, Yinghao Xu, Yicong Hong, Kalyan Sunkavalli, Greg Shakhnarovich, and Sai Bi. 2023. Instant3d: Fast text-to-3d with sparse-view generation and large reconstruction model. arXiv preprint arXiv:2311.06214 (2023)
2023 arXiv
-
[29]
Jiaxing Li, Hongbo Zhao, Yijun Wang, and Jianxin Lin. 2024. Towards photo- realistic video colorization via gated color-guided image diffusion models. In Proceedings of the 32nd ACM International Conference on Multimedia . 10891– 10900
2024
-
[30]
Huan Ling, Seung Wook Kim, Antonio Torralba, Sanja Fidler, and Karsten Kreis
-
[31]
Yixun Liang, Xin Yang, Jiantao Lin, Haodong Li, Xiaogang Xu, and Yingcong Chen. 2024. Luciddreamer: Towards high-fidelity text-to-3d generation via interval score matching. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 6517–6526
2024
-
[32]
Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, and Kyoung Mu Lee
-
[33]
Minghua Liu, Chong Zeng, Xinyue Wei, Ruoxi Shi, Linghao Chen, Chao Xu, Mengqi Zhang, Zhaoning Wang, Xiaoshuai Zhang, Isabella Liu, et al. 2024. Mesh- former: High-quality mesh generation with 3d-guided reconstruction model. arXiv preprint arXiv:2408.10198 (2024)
2024 arXiv
-
[34]
Ruoshi Liu, Rundi Wu, Basile Van Hoorick, Pavel Tokmakov, Sergey Zakharov, and Carl Vondrick. 2023. Zero-1-to-3: Zero-shot one image to 3d object. In Proceedings of the IEEE/CVF international conference on computer vision . 9298– 9309
2023
-
[35]
Tianqi Liu, Zihao Huang, Zhaoxi Chen, Guangcong Wang, Shoukang Hu, Liao Shen, Huiqiang Sun, Zhiguo Cao, Wei Li, and Ziwei Liu. 2025. Free4D: Tuning- free 4D Scene Generation with Spatial-Temporal Consistency. arXiv preprint arXiv:2503.20785 (2025)
2025 arXiv
-
[36]
Isabella Liu, Hao Su, and Xiaolong Wang. 2024. Dynamic gaussians mesh: Consis- tent mesh reconstruction from monocular videos.arXiv preprint arXiv:2404.12379 (2024)
2024 arXiv
-
[37]
Minghua Liu, Ruoxi Shi, Linghao Chen, Zhuoyang Zhang, Chao Xu, Xinyue Wei, Hansheng Chen, Chong Zeng, Jiayuan Gu, and Hao Su. 2024. One-2-3-45++: Fast single image to 3d objects with consistent multi-view generation and 3d diffusion. In Proceedings of the IEEE/CVF Conference o...
2024
-
[38]
Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J Black. 2023. SMPL: A skinned multi-person linear model. In Seminal Graphics Papers: Pushing the Boundaries, Volume 2 . 851–866
2023
-
[39]
Yuxuan Luo, Zhengkun Rong, Lizhen Wang, Longhao Zhang, Tianshu Hu, and Yongming Zhu. 2025. DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidance. arXiv preprint arXiv:2504.01724 (2025)
2025 arXiv
-
[40]
Yue Ma, Yingqing He, Xiaodong Cun, Xintao Wang, Siran Chen, Xiu Li, and Qifeng Chen. 2024. Follow your pose: Pose-guided text-to-video generation using pose-free videos. In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 38. 4117–4125
2024
-
[41]
Yuan Liu, Cheng Lin, Zijiao Zeng, Xiaoxiao Long, Lingjie Liu, Taku Komura, and Wenping Wang. 2023. Syncdreamer: Generating multiview-consistent images from a single-view image. arXiv preprint arXiv:2309.03453 (2023)
2023 arXiv
-
[42]
Xiaoxiao Long, Yuan-Chen Guo, Cheng Lin, Yuan Liu, Zhiyang Dou, Lingjie Liu, Yuexin Ma, Song-Hai Zhang, Marc Habermann, Christian Theobalt, et al. 2024. Wonder3d: Single image to 3d using cross-domain diffusion. InProceedings of the IEEE/CVF Conference on Computer Vision and P...
2024
-
[43]
Zijie Pan, Jiachen Lu, Xiatian Zhu, and Li Zhang. 2023. Enhancing high- resolution 3d generation through pixel-wise gradient clipping. arXiv preprint arXiv:2310.12474 (2023)
2023 arXiv
-
[44]
Zijie Pan, Zeyu Yang, Xiatian Zhu, and Li Zhang. 2024. Fast dynamic 3d object generation from a single-view video. arXiv preprint arXiv:2401.08742 (2024). CharacterShot: Controllable and Consistent 4D Character Animation • 9
2024
-
[45]
Hui En Pang, Shuai Liu, Zhongang Cai, Lei Yang, Tianwei Zhang, and Ziwei Liu. 2024. Disco4D: Disentangled 4D Human Generation and Animation from a Single Image. arXiv preprint arXiv:2409.17280 (2024)
2024 arXiv
-
[46]
Alex Nichol, Prafulla Dhariwal, Aditya Ramesh, Pranav Shyam, Pamela Mishkin, Bob McGrew, Ilya Sutskever, and Mark Chen. 2021. Glide: Towards photorealistic image generation and editing with text-guided diffusion models. arXiv preprint arXiv:2112.10741 (2021)
2021 arXiv
-
[47]
Alexander Quinn Nichol and Prafulla Dhariwal. 2021. Improved denoising diffusion probabilistic models. In International Conference on Machine Learning . PMLR, 8162–8171
2021
-
[48]
Hao-Yang Peng, Jia-Peng Zhang, Meng-Hao Guo, Yan-Pei Cao, and Shi-Min Hu
-
[49]
Ben Poole, Ajay Jain, Jonathan T Barron, and Ben Mildenhall. 2022. Dreamfusion: Text-to-3d using 2d diffusion. arXiv preprint arXiv:2209.14988 (2022)
2022 arXiv
-
[50]
Zefan Qu, Ke Xu, Gerhard Petrus Hancke, and Rynson WH Lau. 2024. LuSh- NeRF: Lighting up and Sharpening NeRFs for Low-light Scenes. arXiv preprint arXiv:2411.06757 (2024)
2024 arXiv
-
[51]
Jangho Park, Taesung Kwon, and Jong Chul Ye. 2025. Zero4D: Training-Free 4D Video Generation From Single Video Using Off-the-Shelf Video Diffusion Model. arXiv preprint arXiv:2503.22622 (2025)
2025
-
[52]
William Peebles and Saining Xie. 2023. Scalable diffusion models with trans- formers. In Proceedings of the IEEE/CVF international conference on computer vision. 4195–4205
2023
-
[53]
Jiawei Ren, Cheng Xie, Ashkan Mirzaei, Karsten Kreis, Ziwei Liu, Antonio Torralba, Sanja Fidler, Seung Wook Kim, Huan Ling, et al. 2024. L4gm: Large 4d gaussian reconstruction model. Advances in Neural Information Processing Systems 37 (2024), 56828–56858
2024
-
[54]
ACM Transactions on Graphics (TOG) 43, 4 (2024)
CharacterGen: Efficient 3D Character Generation from Single Images with Multi-View Pose Canonicalization. ACM Transactions on Graphics (TOG) 43, 4 (2024). https://doi.org/10.1145/3658217
2024 doi
-
[55]
Darius Rückert, Linus Franke, and Marc Stamminger. 2022. Adop: Approximate differentiable one-pixel point rendering. ACM Transactions on Graphics (ToG) 41, 4 (2022), 1–14
2022
-
[56]
Kyle Sargent, Zizhang Li, Tanmay Shah, Charles Herrmann, Hong-Xing Yu, Yunzhi Zhang, Eric Ryan Chan, Dmitry Lagun, Li Fei-Fei, Deqing Sun, et al. 2023. Zeronvs: Zero-shot 360-degree view synthesis from a single real image. arXiv preprint arXiv:2310.17994 (2023)
2023 arXiv
-
[57]
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of machine learning research 21, 140 (2020), 1–67
2020
-
[58]
Jiawei Ren, Liang Pan, Jiaxiang Tang, Chi Zhang, Ang Cao, Gang Zeng, and Ziwei Liu. 2023. Dreamgaussian4d: Generative 4d gaussian splatting. arXiv preprint arXiv:2312.17142 (2023)
2023 arXiv
-
[59]
Yukai Shi, Jianan Wang, He Cao, Boshi Tang, Xianbiao Qi, Tianyu Yang, Yukun Huang, Shilong Liu, Lei Zhang, and Heung-Yeung Shum. 2023. Toss: High- quality text-guided novel view synthesis from a single image. arXiv preprint arXiv:2310.10644 (2023)
2023 arXiv
-
[60]
Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings,...
2015
-
[61]
Uriel Singer, Shelly Sheynin, Adam Polyak, Oron Ashual, Iurii Makarov, Filippos Kokkinos, Naman Goyal, Andrea Vedaldi, Devi Parikh, Justin Johnson, et al
-
[62]
Jingxiang Sun, Bo Zhang, Ruizhi Shao, Lizhen Wang, Wen Liu, Zhenda Xie, and Yebin Liu. 2023. Dreamcraft3d: Hierarchical 3d generation with bootstrapped diffusion prior. arXiv preprint arXiv:2310.16818 (2023)
2023 arXiv
-
[63]
Ruizhi Shao, Youxin Pang, Zerong Zheng, Jingxiang Sun, and Yebin Liu. 2024. Human4dit: 360-degree human video generation with 4d diffusion transformer. arXiv preprint arXiv:2405.17405 (2024)
2024 arXiv
-
[64]
Ruoxi Shi, Hansheng Chen, Zhuoyang Zhang, Minghua Liu, Chao Xu, Xinyue Wei, Linghao Chen, Chong Zeng, and Hao Su. 2023. Zero123++: a single image to consistent multi-view diffusion base model. arXiv preprint arXiv:2310.15110 (2023)
2023 arXiv
-
[65]
Matthew Tancik, Pratul Srinivasan, Ben Mildenhall, Sara Fridovich-Keil, Nithin Raghavan, Utkarsh Singhal, Ravi Ramamoorthi, Jonathan Barron, and Ren Ng
-
[66]
Yichun Shi, Peng Wang, Jianglong Ye, Mai Long, Kejie Li, and Xiao Yang. 2023. Mvdream: Multi-view diffusion for 3d generation.arXiv preprint arXiv:2308.16512 (2023)
2023 arXiv
-
[67]
Kexian Tang, Junyao Gao, Yanhong Zeng, Haodong Duan, Yanan Sun, Zhening Xing, Wenran Liu, Kaifeng Lyu, and Kai Chen. 2025. LEGO-Puzzles: How Good Are MLLMs at Multi-Step Spatial Reasoning? arXiv preprint arXiv:2503.19990 (2025)
2025 arXiv
-
[68]
arXiv preprint arXiv:2301.11280 (2023)
Text-to-4d dynamic scene generation. arXiv preprint arXiv:2301.11280 (2023)
2023 arXiv
-
[69]
Thomas Unterthiner, Sjoerd van Steenkiste, Karol Kurach, Raphaël Marinier, Marcin Michalski, and Sylvain Gelly. 2019. FVD: A new metric for video genera- tion. (2019)
2019
-
[70]
Wenqiang Sun, Shuo Chen, Fangfu Liu, Zilong Chen, Yueqi Duan, Jun Zhang, and Yikai Wang. 2024. Dimensionx: Create any 3d and 4d scenes from a single image with controllable video diffusion. arXiv preprint arXiv:2411.04928 (2024)
2024 arXiv
-
[71]
Shuai Tan, Biao Gong, Xiang Wang, Shiwei Zhang, Dandan Zheng, Ruobing Zheng, Kecheng Zheng, Jingdong Chen, and Ming Yang. 2024. Animate-x: Universal character image animation with enhanced motion representation. arXiv preprint arXiv:2410.10306 (2024)
2024 arXiv
-
[72]
Peng Wang and Yichun Shi. 2023. Imagedream: Image-prompt multi-view diffusion for 3d generation. arXiv preprint arXiv:2312.02201 (2023)
2023 arXiv
-
[73]
Xiang Wang, Shiwei Zhang, Longxiang Tang, Yingya Zhang, Changxin Gao, Yue- huan Wang, and Nong Sang. 2025. UniAnimate-DiT: Human Image Animation with Large-Scale Video Diffusion Transformer. arXiv preprint arXiv:2504.11289 (2025)
2025
-
[74]
Jiaxiang Tang, Jiawei Ren, Hang Zhou, Ziwei Liu, and Gang Zeng. 2023. Dream- gaussian: Generative gaussian splatting for efficient 3d content creation. arXiv preprint arXiv:2309.16653 (2023)
2023 arXiv
-
[75]
Zhenzhi Wang, Yixuan Li, Yanhong Zeng, Youqing Fang, Yuwei Guo, Wenran Liu, Jing Tan, Kai Chen, Tianfan Xue, Bo Dai, et al. 2024. HumanVid: Demystifying Training Data for Camera-controllable Human Image Animation. arXiv preprint arXiv:2407.17438 (2024)
2024 arXiv
-
[76]
Dmitry Tochilkin, David Pankratz, Zexiang Liu, Zixuan Huang, Adam Letts, Yangguang Li, Ding Liang, Christian Laforte, Varun Jampani, and Yan-Pei Cao
-
[77]
arXiv preprint arXiv:2403.02151 (2024)
Triposr: Fast 3d object reconstruction from a single image. arXiv preprint arXiv:2403.02151 (2024)
2024 arXiv
-
[78]
Haohan Weng, Tianyu Yang, Jianan Wang, Yu Li, Tong Zhang, CL Chen, and Lei Zhang. 2023. Consistent123: Improve consistency for one image to 3d object synthesis. arXiv preprint arXiv:2310.08092 (2023)
2023 arXiv
-
[79]
Vikram Voleti, Chun-Han Yao, Mark Boss, Adam Letts, David Pankratz, Dmitry Tochilkin, Christian Laforte, Robin Rombach, and Varun Jampani. 2025. Sv3d: Novel multi-view synthesis and 3d generation from a single image using latent video diffusion. In European Conference on Compu...
2025
-
[80]
VRoid. 2022. VRoid Hub. https://vroid.com/
2022
-
[81]
Yiming Xie, Chun-Han Yao, Vikram Voleti, Huaizu Jiang, and Varun Jampani
-
[82]
Jiale Xu, Weihao Cheng, Yiming Gao, Xintao Wang, Shenghua Gao, and Ying Shan. 2024. Instantmesh: Efficient 3d mesh generation from a single image with sparse-view large reconstruction models. arXiv preprint arXiv:2404.07191 (2024)
2024 arXiv
-
[83]
Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli. 2004. Image quality assessment: from error visibility to structural similarity.IEEE transactions on image processing 13, 4 (2004), 600–612
2004
-
[84]
Ling Yang, Kaixin Zhu, Juanxi Tian, Bohan Zeng, Mingbao Lin, Hongjuan Pei, Wentao Zhang, and Shuicheng Yan. 2025. WideRange4D: Enabling High-Quality 4D Reconstruction with Wide-Range Movements and Scenes. arXiv preprint arXiv:2503.13435 (2025)
2025 arXiv
-
[85]
Zhengyi Wang, Cheng Lu, Yikai Wang, Fan Bao, Chongxuan Li, Hang Su, and Jun Zhu. 2024. Prolificdreamer: High-fidelity and diverse text-to-3d generation with variational score distillation. Advances in Neural Information Processing Systems 36 (2024)
2024
-
[86]
Xinyue Wei, Kai Zhang, Sai Bi, Hao Tan, Fujun Luan, Valentin Deschaintre, Kalyan Sunkavalli, Hao Su, and Zexiang Xu. 2024. MeshLRM: Large Reconstruc- tion Model for High-Quality Meshes. arXiv preprint arXiv:2404.12385 (2024)
2024 arXiv
-
[87]
Zhuoyi Yang, Jiayan Teng, Wendi Zheng, Ming Ding, Shiyu Huang, Jiazheng Xu, Yuanming Yang, Wenyi Hong, Xiaohan Zhang, Guanyu Feng, et al. 2024. Cogvideox: Text-to-video diffusion models with an expert transformer. arXiv preprint arXiv:2408.06072 (2024)
2024 arXiv
-
[88]
Guanjun Wu, Taoran Yi, Jiemin Fang, Lingxi Xie, Xiaopeng Zhang, Wei Wei, Wenyu Liu, Qi Tian, and Xinggang Wang. 2024. 4D Gaussian Splatting for Real-Time Dynamic Scene Rendering. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . 20310–20320
2024
-
[89]
Zijie Wu, Chaohui Yu, Yanqin Jiang, Chenjie Cao, Fan Wang, and Xiang Bai
-
[90]
Taoran Yi, Jiemin Fang, Guanjun Wu, Lingxi Xie, Xiaopeng Zhang, Wenyu Liu, Qi Tian, and Xinggang Wang. 2023. Gaussiandreamer: Fast generation from text to 3d gaussian splatting with point cloud priors. arXiv preprint arXiv:2310.08529 (2023)
2023 arXiv
-
[91]
Yuyang Yin, Dejia Xu, Zhangyang Wang, Yao Zhao, and Yunchao Wei. 2023. 4dgen: Grounded 4d content generation with spatial-temporal consistency.arXiv preprint arXiv:2312.17225 (2023)
2023 arXiv
-
[92]
arXiv preprint arXiv:2407.17470 (2024)
Sv4d: Dynamic 3d content generation with multi-frame and multi-view consistency. arXiv preprint arXiv:2407.17470 (2024)
2024 arXiv
-
[93]
Tao Yu, Zerong Zheng, Kaiwen Guo, Pengpeng Liu, Qionghai Dai, and Yebin Liu. 2021. Function4d: Real-time human volumetric capture from very sparse consumer rgbd sensors. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition . 5746–5756
2021
-
[94]
Haibo Yang, Yang Chen, Yingwei Pan, Ting Yao, Zhineng Chen, Chong-Wah Ngo, and Tao Mei. 2024. Hi3D: Pursuing High-Resolution Image-to-3D Generation with Video Diffusion Models. In Proceedings of the 32nd ACM International Conference on Multimedia. 6870–6879
2024
-
[95]
Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang
-
[96]
Ziyi Yang, Xinyu Gao, Wen Zhou, Shaohui Jiao, Yuqing Zhang, and Xiaogang Jin. 2024. Deformable 3d gaussians for high-fidelity monocular dynamic scene reconstruction. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 20331–20341
2024
-
[97]
Zeyu Yang, Zijie Pan, Chun Gu, and Li Zhang. 2024. Diffusion 2: Dynamic 3D Content Generation via Score Composition of Orthogonal Diffusion Models. arXiv preprint arXiv:2404.02148 (2024)
2024 arXiv
-
[98]
Yuyang Zhao, Zhiwen Yan, Enze Xie, Lanqing Hong, Zhenguo Li, and Gim Hee Lee. 2023. Animate124: Animating one image to 4d dynamic scene. arXiv preprint arXiv:2311.14603 (2023)
2023 arXiv
-
[99]
Zhendong Yang, Ailing Zeng, Chun Yuan, and Yu Li. 2023. Effective whole-body pose estimation with two-stages distillation. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 4210–4220
2023
-
[100]
Jianglong Ye, Peng Wang, Kejie Li, Yichun Shi, and Heng Wang. 2024. Consistent- 1-to-3: Consistent image to 3d view synthesis via geometry-aware diffusion 10 • Junyao Gao1, *, Jiaxing Li3, *, Wenran Liu2, Yanhong Zeng2, Fei Shen4, Kai Chen2, Yanan Sun2,‡ , Cairong Zhao1,‡ mode...
2024
-
[103]
Lijun Yu, José Lezama, Nitesh B Gundavarapu, Luca Versari, Kihyuk Sohn, David Minnen, Yong Cheng, Vighnesh Birodkar, Agrim Gupta, Xiuye Gu, et al. 2023. Language Model Beats Diffusion–Tokenizer is Key to Visual Generation. arXiv preprint arXiv:2310.05737 (2023)
2023 arXiv
-
[105]
Yifei Zeng, Yanqin Jiang, Siyu Zhu, Yuanxun Lu, Youtian Lin, Hao Zhu, Weiming Hu, Xun Cao, and Yao Yao. 2025. Stag4d: Spatial-temporal anchored generative 4d gaussians. In European Conference on Computer Vision . Springer, 163–179
2025
-
[108]
Yuang Zhang, Jiaxi Gu, Li-Wen Wang, Han Wang, Junqi Cheng, Yuefeng Zhu, and Fangyuan Zou. 2024. Mimicmotion: High-quality human motion video generation with confidence-aware pose guidance.arXiv preprint arXiv:2406.19680 (2024)
2024 arXiv
-
[109]
Hongbo Zhao, Jiaxing Li, Peiyi Zhang, Peng Xiao, Jianxin Lin, and Yijun Wang
-
[110]
In Proceedings of the Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers
ColorSurge: Bringing Vibrancy and Efficiency to Automatic Video Col- orization via Dual-Branch Fusion. In Proceedings of the Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers . 1–11
-
[112]
Linqi Zhou, Andy Shih, Chenlin Meng, and Stefano Ermon. 2024. Dreampro- peller: Supercharge text-to-3d generation with parallel sampling. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 4610– 4619
2024
-
[113]
Shenhao Zhu, Junming Leo Chen, Zuozhuo Dai, Zilong Dong, Yinghui Xu, Xun Cao, Yao Yao, Hao Zhu, and Siyu Zhu. 2024. Champ: Controllable and consistent human image animation with 3d parametric guidance. In European Conference on Computer Vision. Springer, 145–162. CharacterShot...
2024
-
[114]
Original
over all images, which are traversed in a bidirectional raster pattern. In addition, we employ three specialized FVD variants to evaluate video coherence at a more granular level: FVD-F, which computes FVD across frames within each view; FVD-V, which com- putes FVD across view...
-
[2017]
In Proceedings of the IEEE conference on computer vision and pattern recognition workshops
Enhanced deep residual networks for single image super-resolution. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops. 136–144
-
[2018]
In Proceedings of the IEEE conference on computer vision and pattern recognition
The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE conference on computer vision and pattern recognition . 586–595
-
[2020]
Advances in neural information processing systems 33 (2020), 7537–7547
Fourier features let networks learn high frequency functions in low dimensional domains. Advances in neural information processing systems 33 (2020), 7537–7547
2020
-
[2023]
In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Objaverse: A universe of annotated 3d objects. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 13142–13153
-
[2024]
In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Align your gaussians: Text-to-4d with dynamic 3d gaussians and composed diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 8576–8588
-
[2025]
In European Conference on Computer Vision
Sc4d: Sparse-controlled video-to-4d generation and motion transfer. In European Conference on Computer Vision . Springer, 361–379
Reviewed August 5, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.