REVIEW 3 major objections 2 minor 23 references
RAW: Robust Avatar Watermarking -- Benchmarking and Baseline
T0 review · 3 major / 2 minor · reviewed 2026-06-30 · grok-4.3
Pith's one-line read Embedding watermarks in the UV texture space of 3D face reconstructions makes them survive avatar post-processing attacks better than prior methods.
desk verdict RAW adds a benchmark and WALT texture-space method for avatar watermarking, but the reported numbers rest on unreported details and a narrow attack set. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
WALT (Watermarking Avatars with Learned Textures), the procedure that reconstructs a 3D face and embeds the watermark inside its UV texture map rather than in the final 2D rendered frames.
What would settle it
A controlled experiment in which WALT is applied to a fresh collection of avatar videos and post-processing attacks and yields lower average recovery rates than at least one of the seven baseline methods would falsify the claim of superior robustness.
Extended reading notes
Core claim
WALT embeds watermarks in the UV texture space of 3D face reconstructions and thereby records the highest recovery rates on the RAW benchmark: 92.4 percent under zoom attacks and 95.6 percent under background removal, exceeding the performance of seven previously published watermarking methods across fifty avatar videos and six real-world-style attacks.
Load-bearing premise
The six chosen attacks and fifty videos from five commercial providers adequately represent the distribution of real-world avatar post-processing pipelines that watermarks must survive.
Editorial extensions
If this is right
- Watermark recovery can be made more stable by moving the embedding step from 2D image space into the UV texture coordinates of a 3D model.
- Background removal and zoom operations are shown to be the attacks that most strongly degrade recovery for existing 2D watermarking methods.
- A public benchmark of fifty videos and six attacks now exists against which any new avatar watermarking algorithm can be measured.
- Reconstruction-based embedding opens the possibility of watermark survival even after format conversion and reframing that alter pixel values but preserve the underlying 3D texture.
Reading between the lines
- If 3D reconstruction quality varies across different avatar styles or lighting conditions, WALT's advantage may shrink on inputs that produce inaccurate meshes.
- The same UV-space placement could be tested on other 3D-rendered assets such as animated characters or virtual objects to check whether the robustness gain is specific to human faces.
- An adversary who can detect and alter the 3D reconstruction stage before watermark extraction might bypass the protection without touching the final video frames.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces the RAW benchmark consisting of 50 synthetic avatar videos from 5 commercial providers together with 6 attacks that simulate common post-processing steps (background replacement, reframing, format conversion). It evaluates seven existing watermarking methods on this benchmark, finds that avatar-specific attacks such as background removal substantially reduce recovery rates, and proposes WALT, which performs 3D face reconstruction and embeds the watermark in UV texture space. WALT is reported to achieve 92.4% robustness under zoom attacks and 95.6% under background removal, outperforming the baselines; the benchmark is released publicly.
Significance. If the empirical claims are substantiated with complete methodology, the work supplies a needed public benchmark and an avatar-specific embedding technique that targets a practically relevant threat model. The release of the benchmark itself constitutes a concrete contribution that can be used by subsequent research regardless of the performance numbers.
major comments (3)
- [Abstract and Experimental Results] Abstract and Experimental Results: the central performance figures (92.4% zoom robustness, 95.6% background-removal robustness) are stated without error bars, without the number of trials or videos per condition, and without any description of how the 3D face reconstruction step is implemented or which reconstruction library/parameters are used. These omissions make the quantitative comparison to the seven baselines impossible to reproduce or assess for statistical reliability.
- [Section 3] Benchmark construction (Section 3): the claim that the chosen 50 videos and 6 attacks adequately represent real-world avatar pipelines is not supported by any validation (e.g., comparison against actual platform outputs or coverage of additional steps such as platform-specific compression or temporal filtering). Because the benchmark is the primary artifact and the performance claims rest on it, this gap is load-bearing.
- [Section 4] WALT method (Section 4): the embedding procedure is described at a high level (UV texture space after 3D reconstruction) but supplies no concrete details on the texture resolution, the exact watermark encoding, or how the reconstructed mesh is aligned back to the original video frames. These parameters directly determine whether the reported robustness numbers can be attributed to the proposed technique.
minor comments (2)
- [Abstract] The abstract states that seven existing methods were evaluated but does not list which methods or cite their original papers; this should be added for completeness.
- [Figures and Tables] Figure captions and tables reporting recovery rates should explicitly state the number of videos/frames used for each percentage.
Simulated Author's Rebuttal
We thank the referee for the constructive comments, which highlight important gaps in reproducibility and validation. We address each major comment below and will incorporate revisions to strengthen the manuscript.
read point-by-point responses
-
Referee: [Abstract and Experimental Results] Abstract and Experimental Results: the central performance figures (92.4% zoom robustness, 95.6% background-removal robustness) are stated without error bars, without the number of trials or videos per condition, and without any description of how the 3D face reconstruction step is implemented or which reconstruction library/parameters are used. These omissions make the quantitative comparison to the seven baselines impossible to reproduce or assess for statistical reliability.
Authors: We agree that these details are essential for reproducibility. The revised manuscript will add error bars (standard deviations across videos), explicitly state that all results are averaged over the full set of 50 videos, and describe the 3D reconstruction implementation including the specific library and parameters employed. revision: yes
-
Referee: [Section 3] Benchmark construction (Section 3): the claim that the chosen 50 videos and 6 attacks adequately represent real-world avatar pipelines is not supported by any validation (e.g., comparison against actual platform outputs or coverage of additional steps such as platform-specific compression or temporal filtering). Because the benchmark is the primary artifact and the performance claims rest on it, this gap is load-bearing.
Authors: We acknowledge the need for stronger justification. We will expand Section 3 with a rationale for the selection of providers, videos, and attacks based on documented common post-processing workflows, and will add explicit discussion of limitations regarding proprietary platform steps such as compression. revision: partial
-
Referee: [Section 4] WALT method (Section 4): the embedding procedure is described at a high level (UV texture space after 3D reconstruction) but supplies no concrete details on the texture resolution, the exact watermark encoding, or how the reconstructed mesh is aligned back to the original video frames. These parameters directly determine whether the reported robustness numbers can be attributed to the proposed technique.
Authors: We will revise Section 4 to include the required implementation specifics: UV texture resolution, the precise watermark encoding procedure, and the mesh-to-frame alignment method using landmark-based registration. revision: yes
Circularity Check
No circularity: empirical benchmark evaluation with no derivations
full rationale
The paper introduces a benchmark of 50 videos and 6 attacks, evaluates 7 existing methods, and proposes WALT which embeds watermarks via 3D face reconstruction in UV space. All central claims are empirical recovery percentages (e.g., 92.4% on zoom, 95.6% on background removal) measured on the released dataset. No equations, fitted parameters renamed as predictions, self-citations used as uniqueness theorems, or ansatzes appear in the abstract or described content. The derivation chain is absent; results are direct experimental outputs, making the work self-contained against external benchmarks.
Assumptions & free parameters
Cite this review
Pith. "Pith review of RAW: Robust Avatar Watermarking -- Benchmarking and Baseline." pith.science (2026). https://pith.science/paper/EAKD5K2P
@misc{pith2026260523994,
author = {Pith},
title = {Pith review of: RAW: Robust Avatar Watermarking -- Benchmarking and Baseline},
year = {2026},
howpublished = {\url{https://pith.science/paper/EAKD5K2P}},
note = {Machine review of arXiv:2605.23994}
}
read the original abstract
Digital avatar watermarking presents unique challenges: avatars are routinely post-processed with background replacement, reframing, and format conversion before deployment. We introduce \textbf{RAW} (Robust Avatar Watermarking), a benchmark comprising 50 synthetic avatar videos from 5 commercial providers and 6 attacks simulating real-world avatar workflows. Evaluating 7 existing methods reveals that avatar-specific attacks such as background removal significantly degrade watermark recovery. We propose \textbf{WALT} (Watermarking Avatars with Learned Textures), which embeds watermarks in UV texture space via 3D face reconstruction. WALT achieves the highest robustness to zoom attacks (92.4\%) while maintaining strong performance on background removal (95.6\%). We release our benchmark to facilitate research into avatar-specific watermarking.
Figures
Reference graph
Works this paper leans on
-
[1]
" write newline "" before.all 'output.state := FUNCTION fin.entry.original add.period write newline FUNCTION new.block output.state before.all = 'skip after.block 'output.state := if FUNCTION new.sentence output.state after.block = 'skip output.state before.all = 'skip after.sentence 'output.state := if if FUNCTION not #0 #1 if FUNCTION and 'skip pop #0 i...
-
[2]
: Trustmark: Robust watermarking and watermark removal for arbitrary resolution images
Bui T., Agarwal S., Collomosse J. : Trustmark: Robust watermarking and watermark removal for arbitrary resolution images. In Proceedings of the IEEE/CVF International Conference on Computer Vision (2025), pp. 18629--18639
work page 2025
-
[3]
: Rosteals: Robust steganography using autoencoder latent space
Bui T., Agarwal S., Yu N., Collomosse J. : Rosteals: Robust steganography using autoencoder latent space. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (2023), pp. 933--942
work page 2023
-
[4]
https://www.d-id.com/blog/d-id-closes-25-million-funding-round/
D-id closes \ 25 million funding round. https://www.d-id.com/blog/d-id-closes-25-million-funding-round/. Accessed: 2025-01-07
work page 2025
-
[5]
Dan e c ek R., Black M. J., Bolkart T. : Emoca: Emotion driven monocular face capture and animation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2022), pp. 20311--20322
work page 2022
-
[6]
https://artificialintelligenceact.eu/, 2024
European Union : The eu artificial intelligence act. https://artificialintelligenceact.eu/, 2024
work page 2024
-
[7]
Video Seal: Open and Efficient Video Watermarking
Fernandez P., Elsahar H., Yalniz I. Z., Mourachko A. : Video seal: Open and efficient video watermarking. arXiv preprint arXiv:2412.09492 (2024)
work page Pith review arXiv 2024
-
[8]
Feng Y., Feng H., Black M. J., Bolkart T. : Learning an animatable detailed 3d face model from in-the-wild images. ACM Transactions on Graphics (ToG) 40, 4 (2021), 1--13
work page 2021
Show all 23 references
-
[9]
: Rembg: Remove image background
Gatis D. : Rembg: Remove image background. https://github.com/danielgatis/rembg, 2020
2020
-
[10]
https://www.heygen.com/article/announcing-our-series-a
Heygen raises \ 60m series a to scale visual storytelling for businesses. https://www.heygen.com/article/announcing-our-series-a. Accessed: 2025-01-07
2025
-
[11]
J., Lew M
Huiskes M. J., Lew M. S. : The mir flickr retrieval evaluation. In Proceedings of the 1st ACM International Conference on Multimedia Information Retrieval (2008), ACM, pp. 39--43
2008
-
[12]
: Deep residual learning for image recognition
He K., Zhang X., Ren S., Sun J. : Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (2016), pp. 770--778
2016
-
[13]
: Mbrs: Enhancing robustness of dnn-based watermarking by mini-batch of real and simulated jpeg compression
Jia Z., Fang H., Zhang W. : Mbrs: Enhancing robustness of dnn-based watermarking by mini-batch of real and simulated jpeg compression. In Proceedings of the 29th ACM international conference on multimedia (2021), pp. 41--49
2021
-
[14]
J., Li H., Romero J
Li T., Bolkart T., Black M. J., Li H., Romero J. : Learning a model of facial shape and expression from 4d scans. ACM Trans. Graph. 36, 6 (2017), 194--1
2017
-
[15]
: Mediapipe: A framework for perceiving and processing reality
Lugaresi C., Tang J., Nash H., McClanahan C., Uboweja E., Hays M., Zhang F., Chang C.-L., Yong M., Lee J., et al. : Mediapipe: A framework for perceiving and processing reality. In Third workshop on computer vision for AR/VR at IEEE computer vision and pattern recognition (CVP...
2019
-
[16]
Lu S., Zhou Z., Lu J., Zhu Y., Kong A. W.-K. : Robust watermarking using generative priors against image editing: From benchmarking to advances. In The Thirteenth International Conference on Learning Representations (ICLR) (2025)
2025
-
[17]
: Towards blind watermarking: Combining invertible and non-invertible mechanisms
Ma R., Guo M., Hou Y., Yang F., Li Y., Jia H., Xie X. : Towards blind watermarking: Combining invertible and non-invertible mechanisms. In Proceedings of the 30th ACM International Conference on Multimedia (2022), pp. 1532--1542
2022
-
[18]
O., Furon T., Douze M
Sander T., Fernandez P., Durmus A. O., Furon T., Douze M. : Watermark anything with localized messages. In The Thirteenth International Conference on Learning Representations (2025)
2025
-
[19]
https://www.synthesia.io/post/series-c
Where synthesia is going next: Announcing our series c. https://www.synthesia.io/post/series-c. Accessed: 2025-01-07
2025
-
[20]
https://techcrunch.com/2024/03/12/generative-ai-video-startup-tavus-raises-18m/
Generative ai video startup tavus raises \ 18m. https://techcrunch.com/2024/03/12/generative-ai-video-startup-tavus-raises-18m/. Accessed: 2025-01-07
2024
-
[21]
https://sg.finance.yahoo.com/news/vidnoz-ai-unveils-product-avatar-140100232.html
Vidnoz ai unveils product avatar. https://sg.finance.yahoo.com/news/vidnoz-ai-unveils-product-avatar-140100232.html. Accessed: 2026-01-15
2026
-
[22]
A., Shechtman E., Wang O
Zhang R., Isola P., Efros A. A., Shechtman E., Wang O. : The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2018), pp. 586--595
2018
-
[23]
: Hidden: Hiding data with deep networks
Zhu J., Kaplan R., Johnson J., Fei-Fei L. : Hidden: Hiding data with deep networks. In Proceedings of the European conference on computer vision (ECCV) (2018), pp. 657--672
2018
Reviewed June 30, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.