REVIEW 3 major objections 6 minor 2 cited by
3DV-TON: Textured 3D-Guided Consistent Video Try-on via Diffusion Models
T0 review · 3 major / 6 minor · reviewed 2026-08-16 · deepseek-v4-flash
Pith's one-line read Textured 3D meshes, not pixels, keep video try-on fabric consistent
desk verdict Real contribution in textured 3D guidance for video try-on, honestly reported, but the SOTA claim needs more baselines, error bars, and a direct check of whether the animated mesh actually carries garment texture. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the animatable textured 3D mesh of the person wearing the target garment. It is built by running image try-on on one keyframe, reconstructing the clothed body with single-image clothed-human reconstruction, and rigging that mesh to SMPL, a parametric body model used for posing and skinning, using poses estimated from the original video. This mesh is rendered as a per-frame texture reference that gives the diffusion model a consistent appearance-level motion cue, and a rectangular masking strategy prevents the original garment's pixels from leaking into the masked generation area.
What would settle it
Take a garment with a large printed logo, have the person rotate 360 degrees with the back initially hidden, and compare output frames before and after the back becomes visible; the animated mesh's hidden-surface texture is filled from normals rather than pixels, so if that infill misrepresents the garment, the final video should show the logo changing identity or blurring exactly at the frames where the back is revealed. A second check is to rerun the pipeline with the video-based body poses deliberately perturbed and watch VFID degrade if the animated 3D mesh is genuinely carrying the consistency.
Extended reading notes
Core claim
3DV-TON claims that explicit textured 3D guidance resolves the trade-off in video try-on between appearance fidelity and motion coherence. The pipeline selects a keyframe, performs image try-on on it, reconstructs an animatable textured 3D mesh of the clothed person, and animates that mesh with video-based poses from a parametric body model. The rendered mesh sequence is then presented to a denoising diffusion UNet as a frame-level reference, alongside the garment image and try-on image, so that the garment's texture moves consistently with the body rather than being smoothed or distorted by temporal averaging. The paper reports state-of-the-art VFID and user-preference results on existing benchmarks and on its new HR-VVT benchmark, and its ablations show that textured guidance outperforms geometric-only body guidance, especially in ambiguous poses such as leg crossing.
Load-bearing premise
The method assumes the textured 3D mesh built from one keyframe, once animated with video-estimated poses, still represents the garment accurately enough to guide every frame; if that mesh's texture distorts or its unseen regions are filled in wrongly, the diffusion model is guided by a false appearance.
Editorial extensions
If this is right
- Video try-on should preserve garment logos and patterns under lateral rotation and leg-crossing poses, where flow-warping and appearance-only diffusion baselines tend to fail.
- Temporal consistency metrics such as VFID should improve without sacrificing image-level quality, because the 3D guide supplies appearance instead of relying on temporal smoothing.
- The 3D guidance pipeline can be integrated into existing dual-UNet or diffusion-transformer try-on architectures without task-specific retraining, since the guidance is injected as an additional frame-level condition.
- The rectangular masking strategy reduces artifact propagation from original-clothing information leaking through dynamic human and garment motion.
- The new HR-VVT benchmark provides 130 high-resolution videos across upper-body, lower-body, and dress categories, offering a more demanding evaluation setting for future video try-on work.
Reading between the lines
- If the 3D guidance is truly what carries consistency, the same construction should work for any moving object whose appearance must persist, not only human clothing; logos on bags, vehicles, or animals would be a direct stress test.
- The paper's own supplementary note that animating with video-based poses can distort texture implies a testable ceiling: consistency gains should shrink when image-based and video-based pose estimates disagree, so measuring that disagreement could predict failures.
- Replacing the roughly 30-second reconstruction with a feed-forward animatable reconstruction, which the limitation section points to as future work, would turn the method from an offline pipeline into a near-real-time one; if that swap succeeds, 3D-guided try-on becomes practical for interactive applications.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes 3DV-TON, a diffusion-based video try-on framework that uses an animatable textured 3D mesh as explicit frame-level guidance. Given a source video and a target garment image, the method selects a keyframe, performs image-based try-on on that frame, reconstructs a clothed 3D human mesh (based on ECON with a modified SMPL-X refinement that freezes pose), and animates the mesh using video-based SMPL poses via KNN skinning. The animated textured mesh is fed, together with the clothing image and the try-on image, into a pseudo-3D UNet with temporal attention and classifier-free guidance. A rectangular masking strategy is introduced to prevent clothing leakage. The authors also introduce HR-VVT, a 130-video high-resolution benchmark, and report quantitative metrics (SSIM, LPIPS, VFID), user studies, and qualitative comparisons against ViViD and CatV2TON, claiming state-of-the-art performance.
Significance. If the central mechanism holds, the paper makes a useful contribution by introducing explicit textured 3D guidance into video try-on, a task where prior diffusion-based methods are criticized for prioritizing appearance fidelity over motion coherence. The idea of linking single-image 3D reconstruction with video-based SMPL animation to provide a consistent garment-texture reference is reasonable and could benefit the community. The introduction of the HR-VVT benchmark, targeting high-resolution and diverse scenarios, is a positive step for evaluation, provided the dataset is released with appropriate documentation. The paper also makes an honest disclosure of the mask-size confound in the main comparison, which is commendable. However, the strength of the empirical claim is currently limited by the lack of validation of the guidance fidelity and by the non-standard evaluation protocol in the key tables.
major comments (3)
- [§3.1, Eq. (2); Supplementary C] The central mechanism is the textured 3D guidance, yet its fidelity is never measured. The reconstruction optimizes Eq. (2) over β, t, and s only, freezing θ, and animation uses video-based SMPL poses through KNN skinning; Supplementary C concedes that direct animation causes "texture distortion and deformation" and requires a rigging workaround. No quantitative metric (e.g., garment-region texture similarity, silhouette IoU between the rendered guidance and the source video, or temporal consistency of the texture) is reported for the guidance itself. Table 4 shows that adding textured 3D guidance improves SSIM/LPIPS/VFID, but it does not distinguish a benefit from accurate texture motion from a benefit of simply adding an extra conditioning stream; without a guidance-fidelity measurement or a control using corrupted texture, the load-bearing claim that consistent texture motion drives the gain is not established. The robustness axiom stated in Supplementary C ("diffusion models do not require high precision for the pose accuracy") is asserted without evidence.
- [§4.4, Tables 1 and 2] The quantitative state-of-the-art claim depends on a non-default evaluation setup. In Table 1, with the default rectangular mask, 3DV-TON has SSIM 0.8681 and LPIPS 0.0707, both worse than CatV2TON (0.8727 and 0.0639, respectively); the better results (0.8992, 0.0521) are obtained only under 3DV-TON* with the baseline's mask. The text honestly discloses this, but the conclusion "state-of-the-art performance" is not supported by the default setting. Table 2 has no mask-matched condition at all: 3DV-TON uses its larger mask while ViViD and CatV2TON use their own masks, making the reported VFID/LPIPS advantages confounded by mask size. The authors should report mask-matched comparisons as the primary table or explicitly quantify the effect of mask size on all metrics.
- [§4.5, Table 4] The ablation in Table 4 is not comparable to the main tables: the VFID values (e.g., 5.236 and 2.381 for the no-3D and full model) are an order of magnitude lower than the VFID values in Tables 1 and 2 (which are in the 13–20 range), suggesting a different test subset, shorter clips, or a different protocol. The dataset and evaluation protocol for the ablation are not specified, so the reader cannot determine whether the improvements generalize to the benchmark conditions. Please specify the exact subset, number of clips, and metric computation used in the ablation.
minor comments (6)
- [Abstract] "at the expanse of motion coherence" should read "at the expense of motion coherence".
- [§3.2] There is a typo: "varialtional" should be "variational".
- [Figure 6] The caption contains typos: "inconrrect gaments" should be "incorrect garments".
- [§4.5] In the Textured 3D Guidance paragraph, "motion conherence" should be "motion coherence".
- [Eq. (5)] The loss in Eq. (5) is missing the subscript on the norm; it should be ∥·∥₂ for consistency with Eq. (4).
- [Supplementary B] The heading "Disccusion" is a typo for "Discussion".
Circularity Check
No significant circularity: the textured 3D guidance is an empirical conditioning stream, not a fitted quantity renamed as a prediction.
full rationale
The paper's load-bearing claim is that textured 3D guidance improves temporal consistency in video try-on. The guidance is generated from the keyframe try-on image by single-image 3D reconstruction and then animated with video-based SMPL poses (Section 3.1). Although the texture originates from the same keyframe image that is also an input reference, the animated mesh encodes pose-dependent spatial information not present in the static image, so the guidance is not a restatement of the input by construction. Quantitative comparison and ablations (Tables 1-4) are external evaluations against ViViD, CatV2TON, and the newly introduced HR-VVT benchmark; no success metric is fitted and then re-reported as a prediction. Equation (2) optimizes shape, translation, and camera scale only, and Equation (3) defines KNN skinning weights; neither definition makes the claimed consistency outcome equal to an optimized input. The only overlapping-author citation, RealisDance [71], is used merely to distinguish this method from geometric-only 3D guidance and is not load-bearing for the paper's core claims. Supplementary C's admission that direct animation with video-based poses can cause 'texture distortion and deformation' is a stated limitation and a robustness concern, not a circular step; the absence of a direct guidance-fidelity metric is an evaluation gap, not evidence that the derivation reduces to its inputs. No instance was found in which a predicted result is equivalent, by the paper's own equations or by a self-citation chain, to an input or fitted parameter.
Assumptions & free parameters
free parameters (6)
- lambda (regularization penalty weight) =
not specified
- d (camera scale threshold) =
dataset-defined threshold
- T (SMPL-X refinement iterations) =
10
- K (KNN neighbors for skinning weights) =
not specified
- p_1, p_2, p_3 (CFG drop probabilities) =
not specified
- Mask expansion scale =
not specified
assumptions (6)
- domain assumption SMPL/SMPL-X parametric body model accurately represents human body shape and pose for guidance.
- domain assumption Single-image clothed human reconstruction (ECON, d-BiNI) produces a mesh whose visible texture can be copied from image pixels, and normal-based texture suffices for invisible areas.
- domain assumption Video-based SMPL pose estimation aligned with the source video, after rigging to the video-based body, produces motion-aligned animation without texture distortion.
- ad hoc to paper Diffusion models are robust to inaccuracies in the 3D guidance, so freezing pose optimization is acceptable.
- domain assumption The pixel-reconstruction objective in video diffusion models biases models toward appearance fidelity at the cost of motion coherence, motivating the 3D guidance.
- domain assumption A rectangular mask enclosing the garment region is sufficient to prevent clothing leakage while preserving enough context for regeneration.
Cite this review
Pith. "Pith review of 3DV-TON: Textured 3D-Guided Consistent Video Try-on via Diffusion Models." pith.science (2026). https://pith.science/paper/F2SNLUUX
@misc{pith2026250417414,
author = {Pith},
title = {Pith review of: 3DV-TON: Textured 3D-Guided Consistent Video Try-on via Diffusion Models},
year = {2026},
howpublished = {\url{https://pith.science/paper/F2SNLUUX}},
note = {Machine review of arXiv:2504.17414}
}
read the original abstract
Video try-on replaces clothing in videos with target garments. Existing methods struggle to generate high-quality and temporally consistent results when handling complex clothing patterns and diverse body poses. We present 3DV-TON, a novel diffusion-based framework for generating high-fidelity and temporally consistent video try-on results. Our approach employs generated animatable textured 3D meshes as explicit frame-level guidance, alleviating the issue of models over-focusing on appearance fidelity at the expanse of motion coherence. This is achieved by enabling direct reference to consistent garment texture movements throughout video sequences. The proposed method features an adaptive pipeline for generating dynamic 3D guidance: (1) selecting a keyframe for initial 2D image try-on, followed by (2) reconstructing and animating a textured 3D mesh synchronized with original video poses. We further introduce a robust rectangular masking strategy that successfully mitigates artifact propagation caused by leaking clothing information during dynamic human and garment movements. To advance video try-on research, we introduce HR-VVT, a high-resolution benchmark dataset containing 130 videos with diverse clothing types and scenarios. Quantitative and qualitative results demonstrate our superior performance over existing methods. The project page is at this link https://2y7c3.github.io/3DV-TON/
Figures
Figures from the paper (13 more)
Forward citations
Cited by 2 Pith papers
-
FlowMo: Variance-Based Flow Guidance for Coherent Motion in Video Generation
FlowMo reduces temporal artifacts in video generation by guiding the denoising process to lower the maximum patch-wise variance of consecutive-frame differences in the latent space.
-
ChronoTailor: Harnessing Attention Guidance for Fine-Grained Video Virtual Try-On
ChronoTailor combines region-aware attention guidance, temporal feature fusion, and multi-scale garment-pose alignment to produce state-of-the-art video virtual try-on results, and contributes the StyleDress dataset.
Reference graph
Works this paper leans on
-
[1]
A thin-plate spline and the decomposition of deformations
Fred L Bookstein and WDK Green. A thin-plate spline and the decomposition of deformations. Mathematical Methods in Medical Imaging, 2(14-28):3, 1993. 3
work page 1993
-
[2]
Xu Cao, Hiroaki Santo, Boxin Shi, Fumio Okura, and Ya- suyuki Matsushita. Bilateral normal integration. InEuropean Conference on Computer Vision , pages 552–567. Springer,
-
[3]
Quo vadis, action recognition? a new model and the kinetics dataset
Joao Carreira and Andrew Zisserman. Quo vadis, action recognition? a new model and the kinetics dataset. In pro- ceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 6299–6308, 2017. 8
2017
-
[4]
9 Videojam: Joint appearance-motion representations for en- hanced motion generation in video models
Hila Chefer, Uriel Singer, Amit Zohar, Yuval Kirstain, Adam Polyak, Yaniv Taigman, Lior Wolf, and Shelly Sheynin. 9 Videojam: Joint appearance-motion representations for en- hanced motion generation in video models. arXiv preprint arXiv:2502.02492, 2025. 2, 9
arXiv 2025
-
[5]
Viton-hd: High-resolution virtual try-on via misalignment-aware normalization
Seunghwan Choi, Sunghyun Park, Minsoo Lee, and Jaegul Choo. Viton-hd: High-resolution virtual try-on via misalignment-aware normalization. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 14131–14140, 2021. 2, 3, 6
work page 2021
-
[6]
Improving diffusion models for vir- tual try-on
Yisol Choi, Sangkyung Kwak, Kyungmin Lee, Hyungwon Choi, and Jinwoo Shin. Improving diffusion models for vir- tual try-on. arXiv preprint arXiv:2403.05139 , 2024. 2, 3, 6
arXiv 2024
-
[7]
Catvton: Concatenation is all you need for virtual try- on with diffusion models
Zheng Chong, Xiao Dong, Haoxiang Li, Shiyue Zhang, Wenqing Zhang, Xujie Zhang, Hanqing Zhao, and Xiaodan Liang. Catvton: Concatenation is all you need for virtual try- on with diffusion models. arXiv preprint arXiv:2407.15886,
-
[8]
Catv2ton: Taming diffusion transformers for vision-based virtual try-on with temporal concatenation
Zheng Chong, Wenqing Zhang, Shiyue Zhang, Jun Zheng, Xiao Dong, Haoxiang Li, Yiling Wu, Dongmei Jiang, and Xiaodan Liang. Catv2ton: Taming diffusion transformers for vision-based virtual try-on with temporal concatenation. arXiv preprint arXiv:2501.11325, 2025. 2, 3, 6, 8
arXiv 2025
Show all 72 references
-
[9]
Dress code: High-resolution multi-category virtual try-on
Morelli Davide, Fincato Matteo, Cornia Marcella, Landi Federico, Cesari Fabio, and Cucchiara Rita. Dress code: High-resolution multi-category virtual try-on. In Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022. 6
2022
-
[10]
Drapenet: Garment generation and self- supervised draping
Luca De Luigi, Ren Li, Benoit Guillard, Mathieu Salzmann, and Pascal Fua. Drapenet: Garment generation and self- supervised draping. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 1451–1460, 2023. 3
2023
-
[11]
Fw-gan: Flow-navigated warping gan for video virtual try-on
Haoye Dong, Xiaodan Liang, Xiaohui Shen, Bowen Wu, Bing-Cheng Chen, and Jian Yin. Fw-gan: Flow-navigated warping gan for video virtual try-on. In Proceedings of the IEEE/CVF international conference on computer vision, pages 1161–1170, 2019. 1, 3, 6, 8
2019
-
[12]
Fash- ion editing with adversarial parsing learning
Haoye Dong, Xiaodan Liang, Yixuan Zhang, Xujie Zhang, Xiaohui Shen, Zhenyu Xie, Bowen Wu, and Jian Yin. Fash- ion editing with adversarial parsing learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 8120–8128, 2020. 2, 3
2020
-
[13]
Vivid: Video virtual try-on using diffusion models
Zixun Fang, Wei Zhai, Aimin Su, Hongliang Song, Kai Zhu, Mao Wang, Yu Chen, Zhiheng Liu, Yang Cao, and Zheng- Jun Zha. Vivid: Video virtual try-on using diffusion models. arXiv preprint arXiv:2405.11794, 2024. 2, 3, 5, 6, 7, 8
2024 arXiv
-
[14]
Collaborative regression of expressive bodies using moderation
Yao Feng, Vasileios Choutas, Timo Bolkart, Dimitrios Tzionas, and Michael J Black. Collaborative regression of expressive bodies using moderation. In 2021 International Conference on 3D Vision (3DV) , pages 792–804. IEEE,
2021
-
[15]
Cloth2tex: A customized cloth texture generation pipeline for 3d virtual try-on
Daiheng Gao, Xu Chen, Xindi Zhang, Qi Wang, Ke Sun, Bang Zhang, Liefeng Bo, and Qixing Huang. Cloth2tex: A customized cloth texture generation pipeline for 3d virtual try-on. arXiv preprint arXiv:2308.04288, 2023. 3
2023 arXiv
-
[16]
Parser-free virtual try-on via distilling appearance flows
Yuying Ge, Yibing Song, Ruimao Zhang, Chongjian Ge, Wei Liu, and Ping Luo. Parser-free virtual try-on via distilling appearance flows. In Proceedings of the IEEE/CVF con- ference on computer vision and pattern recognition , pages 8485–8493, 2021. 2, 3
2021
-
[17]
Generative adversarial networks
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative adversarial networks. Commu- nications of the ACM, 63(11):139–144, 2020. 3
2020
-
[18]
Taming the power of diffusion models for high-quality virtual try-on with appearance flow
Junhong Gou, Siyu Sun, Jianfu Zhang, Jianlou Si, Chen Qian, and Liqing Zhang. Taming the power of diffusion models for high-quality virtual try-on with appearance flow. In Proceedings of the 31st ACM International Conference on Multimedia, 2023. 3
2023
-
[19]
Densepose: Dense human pose estimation in the wild
Rıza Alp G ¨uler, Natalia Neverova, and Iasonas Kokkinos. Densepose: Dense human pose estimation in the wild. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 7297–7306, 2018. 5
2018
-
[20]
Animatediff: Animate your personalized text-to- image diffusion models without specific tuning
Yuwei Guo, Ceyuan Yang, Anyi Rao, Zhengyang Liang, Yaohui Wang, Yu Qiao, Maneesh Agrawala, Dahua Lin, and Bo Dai. Animatediff: Animate your personalized text-to- image diffusion models without specific tuning. Interna- tional Conference on Learning Representations, 2024. 2, 3,...
2024
-
[21]
Viton: An image-based virtual try-on network
Xintong Han, Zuxuan Wu, Zhe Wu, Ruichi Yu, and Larry S Davis. Viton: An image-based virtual try-on network. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 7543–7552, 2018. 3
2018
-
[22]
Clothflow: A flow-based model for clothed person generation
Xintong Han, Xiaojun Hu, Weilin Huang, and Matthew R Scott. Clothflow: A flow-based model for clothed person generation. In Proceedings of the IEEE/CVF international conference on computer vision , pages 10471–10480, 2019. 3
2019
-
[23]
Can spatiotemporal 3d cnns retrace the history of 2d cnns and im- agenet? In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, pages 6546–6555, 2018
Kensho Hara, Hirokatsu Kataoka, and Yutaka Satoh. Can spatiotemporal 3d cnns retrace the history of 2d cnns and im- agenet? In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, pages 6546–6555, 2018. 8
2018
-
[24]
Style-based global appearance flow for virtual try-on
Sen He, Yi-Zhe Song, and Tao Xiang. Style-based global appearance flow for virtual try-on. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3470–3479, 2022. 3
2022
-
[25]
Wildvidfit: Video virtual try- on in the wild via image-based controlled diffusion models
Zijian He, Peixin Chen, Guangrun Wang, Guanbin Li, Philip HS Torr, and Liang Lin. Wildvidfit: Video virtual try- on in the wild via image-based controlled diffusion models. In European Conference on Computer Vision , pages 123–
-
[26]
Classifier-free diffusion guidance
Jonathan Ho and Tim Salimans. Classifier-free diffusion guidance. In NeurIPS 2021 Workshop on Deep Generative Models and Downstream Applications, 2021. 5
2021
-
[27]
Denoising dif- fusion probabilistic models
Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising dif- fusion probabilistic models. Advances in neural information processing systems, 33:6840–6851, 2020. 2, 3, 5, 13
2020
-
[28]
Neural kernel surface re- construction
Jiahui Huang, Zan Gojcic, Matan Atzmon, Or Litany, Sanja Fidler, and Francis Williams. Neural kernel surface re- construction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 4369– 4379, 2023. 4
2023
-
[29]
Towards hard- pose virtual try-on via 3d-aware global correspondence 10 learning
Zaiyu Huang, Hanhui Li, Zhenyu Xie, Michael Kampffmeyer, Xiaodan Liang, et al. Towards hard- pose virtual try-on via 3d-aware global correspondence 10 learning. Advances in Neural Information Processing Systems, 35:32736–32748, 2022. 3
2022
-
[30]
Cloth- former: Taming video virtual try-on in all module
Jianbin Jiang, Tan Wang, He Yan, and Junhui Liu. Cloth- former: Taming video virtual try-on in all module. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10799–10808, 2022. 1, 3, 8
2022
-
[31]
Poisson surface reconstruction
Michael Kazhdan, Matthew Bolitho, and Hugues Hoppe. Poisson surface reconstruction. In Proceedings of the fourth Eurographics symposium on Geometry processing, 2006. 4
2006
-
[32]
Sapiens: Foundation for human vision mod- els
Rawal Khirodkar, Timur Bagautdinov, Julieta Martinez, Su Zhaoen, Austin James, Peter Selednik, Stuart Anderson, and Shunsuke Saito. Sapiens: Foundation for human vision mod- els. In European Conference on Computer Vision , pages 206–228. Springer, 2025. 3
2025
-
[33]
Stableviton: Learning semantic correspon- dence with latent diffusion model for virtual try-on
Jeongho Kim, Guojung Gu, Minho Park, Sunghyun Park, and Jaegul Choo. Stableviton: Learning semantic correspon- dence with latent diffusion model for virtual try-on. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8176–8185, 2024. 3, 6
2024
-
[34]
Auto-encoding variational bayes
Diederik P Kingma. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114, 2013. 5
2013 arXiv
-
[35]
Segment any- thing
Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer White- head, Alexander C Berg, Wan-Yen Lo, et al. Segment any- thing. In Proceedings of the IEEE/CVF international confer- ence on computer vision, pages 4015–4026, 2023. 5
2023
-
[36]
Hybrik: A hybrid analytical-neural inverse kinematics solution for 3d human pose and shape estimation
Jiefeng Li, Chao Xu, Zhicun Chen, Siyuan Bian, Lixin Yang, and Cewu Lu. Hybrik: A hybrid analytical-neural inverse kinematics solution for 3d human pose and shape estimation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3383–3393,...
2021
-
[37]
Hybrik-x: Hybrid analytical-neural inverse kinematics for whole-body mesh recovery
Jiefeng Li, Siyuan Bian, Chao Xu, Zhicun Chen, Lixin Yang, and Cewu Lu. Hybrik-x: Hybrid analytical-neural inverse kinematics for whole-body mesh recovery. arXiv preprint arXiv:2304.05690, 2023. 4, 5, 6, 13
2023 arXiv
-
[38]
Self- correction for human parsing
Peike Li, Yunqiu Xu, Yunchao Wei, and Yi Yang. Self- correction for human parsing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(6):3260–3271, 2020. 5
2020
-
[39]
Diffavatar: Simulation-ready garment optimization with differentiable simulation
Yifei Li, Hsiao-yu Chen, Egor Larionov, Nikolaos Sarafi- anos, Wojciech Matusik, and Tuur Stuyck. Diffavatar: Simulation-ready garment optimization with differentiable simulation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 4368...
2024
-
[40]
Common diffusion noise schedules and sample steps are flawed
Shanchuan Lin, Bingchen Liu, Jiashi Li, and Xiao Yang. Common diffusion noise schedules and sample steps are flawed. In Proceedings of the IEEE/CVF winter conference on applications of computer vision, pages 5404–5411, 2024. 5
2024
-
[41]
Smpl: A skinned multi- person linear model
Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J Black. Smpl: A skinned multi- person linear model. In Seminal Graphics Papers: Pushing the Boundaries, Volume 2, pages 851–866. 2023. 2, 3, 13
2023
-
[42]
Gans trained by a two time-scale update rule converge to a local nash equilib- rium
Heusel Martin, Ramsauer Hubert, Unterthiner Thomas, Nessler Bernhard, and Hochreiter Sepp. Gans trained by a two time-scale update rule converge to a local nash equilib- rium. Advances in neural information processing systems , 30:6626–6637, 2017. 8
2017
-
[43]
Cloth-vton: Cloth- ing three-dimensional reconstruction for hybrid image-based virtual try-on
Matiur Rahman Minar and Heejune Ahn. Cloth-vton: Cloth- ing three-dimensional reconstruction for hybrid image-based virtual try-on. In Proceedings of the Asian conference on computer vision, 2020. 3
2020
-
[44]
Ladi-vton: Latent diffusion textual-inversion enhanced virtual try-on
Davide Morelli, Alberto Baldrati, Giuseppe Cartella, Mar- cella Cornia, Marco Bertini, and Rita Cucchiara. Ladi-vton: Latent diffusion textual-inversion enhanced virtual try-on. In Proceedings of the 31st ACM International Conference on Multimedia, pages 8580–8589, 2023. 3
2023
-
[45]
Georgios Pavlakos, Vasileios Choutas, Nima Ghorbani, Timo Bolkart, Ahmed A. A. Osman, Dimitrios Tzionas, and Michael J. Black. Expressive body capture: 3d hands, face, and body from a single image. In Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 20...
2019
-
[46]
Scalable diffusion models with transformers
William Peebles and Saining Xie. Scalable diffusion models with transformers. In Proceedings of the IEEE/CVF inter- national conference on computer vision , pages 4195–4205,
-
[47]
Movie gen: A cast of media foundation models
Adam Polyak, Amit Zohar, Andrew Brown, Andros Tjandra, Animesh Sinha, Ann Lee, Apoorv Vyas, Bowen Shi, Chih- Yao Ma, Ching-Yao Chuang, et al. Movie gen: A cast of media foundation models. arXiv preprint arXiv:2410.13720,
-
[48]
Lhm: Large animatable human reconstruction model from a single image in seconds
Lingteng Qiu, Xiaodong Gu, Peihao Li, Qi Zuo, Weichao Shen, Junfei Zhang, Kejie Qiu, Weihao Yuan, Guanying Chen, Zilong Dong, et al. Lhm: Large animatable human reconstruction model from a single image in seconds. arXiv preprint arXiv:2503.10625, 2025. 2, 3, 13
2025 arXiv
-
[49]
High-resolution image synthesis with latent diffusion models
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj ¨orn Ommer. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10684–10695, 2022. 2, 3, 5, 6, 13
2022
-
[50]
U- net: Convolutional networks for biomedical image segmen- tation
Olaf Ronneberger, Philipp Fischer, and Thomas Brox. U- net: Convolutional networks for biomedical image segmen- tation. In Medical image computing and computer-assisted intervention–MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, proceedings, pa...
2015
-
[51]
World-grounded human motion recovery via gravity-view coordinates
Zehong Shen, Huaijin Pi, Yan Xia, Zhi Cen, Sida Peng, Zechen Hu, Hujun Bao, Ruizhen Hu, and Xiaowei Zhou. World-grounded human motion recovery via gravity-view coordinates. In SIGGRAPH Asia Conference Proceedings ,
-
[52]
Wham: Reconstructing world-grounded humans with accu- rate 3d motion
Soyong Shin, Juyong Kim, Eni Halilaj, and Michael J Black. Wham: Reconstructing world-grounded humans with accu- rate 3d motion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 2070– 2080, 2024. 4, 5, 6, 13
2024
-
[53]
Em- bedded deformation for shape manipulation
Robert W Sumner, Johannes Schmid, and Mark Pauly. Em- bedded deformation for shape manipulation. In ACM sig- graph 2007 papers, pages 80–es. 2007. 3
2007
-
[54]
Toward characteristic- 11 preserving image-based virtual try-on network
Bochao Wang, Huabin Zheng, Xiaodan Liang, Yimin Chen, Liang Lin, and Meng Yang. Toward characteristic- 11 preserving image-based virtual try-on network. In Proceed- ings of the European conference on computer vision (ECCV), pages 589–604, 2018. 2, 3
2018
-
[55]
Gpd-vvto: Preserving garment details in video virtual try-on
Yuanbin Wang, Weilun Dai, Long Chan, Huanyu Zhou, Aixi Zhang, and Si Liu. Gpd-vvto: Preserving garment details in video virtual try-on. In Proceedings of the 32nd ACM International Conference on Multimedia, pages 7133–7142,
-
[56]
Image quality assessment: from error visibility to structural similarity
Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Si- moncelli. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, 13(4):600–612, 2004. 8
2004
-
[57]
Template-free single-view 3d human digitalization with diffusion-guided lrm
Zhenzhen Weng, Jingyuan Liu, Hao Tan, Zhan Xu, Yang Zhou, Serena Yeung-Levy, and Jimei Yang. Template-free single-view 3d human digitalization with diffusion-guided lrm. arXiv preprint arXiv:2401.12175, 2024. 3
2024 arXiv
-
[58]
Gp- vton: Towards general purpose virtual try-on via collabora- tive local-flow global-parsing learning
Zhenyu Xie, Zaiyu Huang, Xin Dong, Fuwei Zhao, Haoye Dong, Xijin Zhang, Feida Zhu, and Xiaodan Liang. Gp- vton: Towards general purpose virtual try-on via collabora- tive local-flow global-parsing learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Patte...
2023
-
[59]
Yuliang Xiu, Jinlong Yang, Dimitrios Tzionas, and Michael J. Black. ICON: Implicit Clothed humans Obtained from Normals. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 13296–13306, 2022. 2, 3, 4, 13
2022
-
[60]
Yuliang Xiu, Jinlong Yang, Xu Cao, Dimitrios Tzionas, and Michael J. Black. ECON: Explicit Clothed humans Optimized via Normal integration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023. 2, 3, 4, 6
2023
-
[61]
Oot- diffusion: Outfitting fusion based latent diffusion for control- lable virtual try-on
Yuhao Xu, Tao Gu, Weifeng Chen, and Chengcai Chen. Oot- diffusion: Outfitting fusion based latent diffusion for control- lable virtual try-on. arXiv preprint arXiv:2403.01779, 2024. 2, 3, 6
2024 arXiv
-
[62]
Tunnel try-on: Excavating spatial-temporal tunnels for high-quality virtual try-on in videos
Zhengze Xu, Mengting Chen, Zhao Wang, Linyu Xing, Zhonghua Zhai, Nong Sang, Jinsong Lan, Shuai Xiao, and Changxin Gao. Tunnel try-on: Excavating spatial-temporal tunnels for high-quality virtual try-on in videos. In Proceed- ings of the 32nd ACM International Conference on Mul...
2024
-
[63]
Magicanimate: Temporally consistent human im- age animation using diffusion model
Zhongcong Xu, Jianfeng Zhang, Jun Hao Liew, Hanshu Yan, Jia-Wei Liu, Chenxu Zhang, Jiashi Feng, and Mike Zheng Shou. Magicanimate: Temporally consistent human im- age animation using diffusion model. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Reco...
2024
-
[64]
Pymaf-x: To- wards well-aligned full-body model regression from monoc- ular images
Hongwen Zhang, Yating Tian, Yuxiang Zhang, Mengcheng Li, Liang An, Zhenan Sun, and Yebin Liu. Pymaf-x: To- wards well-aligned full-body model regression from monoc- ular images. IEEE Transactions on Pattern Analysis and Ma- chine Intelligence, 45(10):12287–12303, 2023. 6
2023
-
[65]
Pise: Person image synthesis and editing with decoupled gan
Jinsong Zhang, Kun Li, Yu-Kun Lai, and Jingyu Yang. Pise: Person image synthesis and editing with decoupled gan. In Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition, pages 7982–7990, 2021. 3
2021
-
[66]
The unreasonable effectiveness of deep features as a perceptual metric
Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shecht- man, and Oliver Wang. The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE conference on computer vision and pattern recogni- tion, pages 586–595, 2018. 8
2018
-
[67]
Sifu: Side-view conditioned implicit function for real-world us- able clothed human reconstruction
Zechuan Zhang, Zongxin Yang, and Yi Yang. Sifu: Side-view conditioned implicit function for real-world us- able clothed human reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 9936–9947, 2024. 2, 3
2024
-
[68]
M3d-vton: A monocular-to-3d virtual try- on network
Fuwei Zhao, Zhenyu Xie, Michael Kampffmeyer, Haoye Dong, Songfang Han, Tianxiang Zheng, Tao Zhang, and Xiaodan Liang. M3d-vton: A monocular-to-3d virtual try- on network. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 13239–13249, 2021. 3
2021
-
[69]
Viton-dit: Learning in-the-wild video try-on from human dance videos via diffusion transformers
Jun Zheng, Fuwei Zhao, Youjiang Xu, Xin Dong, and Xi- aodan Liang. Viton-dit: Learning in-the-wild video try-on from human dance videos via diffusion transformers. arXiv preprint arXiv:2405.18326, 2024. 2, 3
2024 arXiv
-
[70]
Mv-ton: Memory-based video virtual try- on network
Xiaojing Zhong, Zhonghua Wu, Taizhe Tan, Guosheng Lin, and Qingyao Wu. Mv-ton: Memory-based video virtual try- on network. In Proceedings of the 29th ACM International Conference on Multimedia, pages 908–916, 2021. 1, 3
2021
-
[71]
Realisdance: Equip controllable character anima- tion with realistic hands
Jingkai Zhou, Benzhi Wang, Weihua Chen, Jingqi Bai, Dongyang Li, Aixi Zhang, Hao Xu, Mingyang Yang, and Fan Wang. Realisdance: Equip controllable character anima- tion with realistic hands. arXiv preprint arXiv:2409.06202,
-
[72]
Champ: Controllable and consistent human image an- imation with 3d parametric guidance
Shenhao Zhu, Junming Leo Chen, Zuozhuo Dai, Zilong Dong, Yinghui Xu, Xun Cao, Yao Yao, Hao Zhu, and Siyu Zhu. Champ: Controllable and consistent human image an- imation with 3d parametric guidance. In European Confer- ence on Computer Vision , pages 145–162. Springer, 2024. 2 ...
2024
Reviewed August 16, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.