REVIEW 4 major objections 4 minor 19 references
A tiny grayscale perturbation flips AI colorizers into producing implausible colors, a proactive defense against unauthorized reuse.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
A tiny, invisible perturbation added to a published grayscale image can force AI colorizers to produce content-wrong colors (blue apples), an effect this paper measures and optimizes with a new semantic color-plausibility score.
T0 review reviewed 2026-08-01 challenge →
load-bearing objection SCNB is a real extension of the UE line — semantic color break instead of chroma suppression — but the headline numbers are entirely in units of the attack's own objective, so it needs human validation before I'd trust the effectiveness claim. the 4 major comments →
Semantic Color Naturalness Breaker: Preventing Illegitimate Colorization via Content-Aware Color Priors
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
Core claim
The central claim is that SCNB, unlike prior chroma-suppression defenses that fall into a 'gray-but-natural' failure mode, can deliberately drive colorization outputs toward colors that contradict the semantic content of the scene (e.g., blue apples, reddish vegetation), while keeping the released grayscale image visually unchanged. The key is CaCDD, which scores color plausibility by fitting per-label Gaussian Mixture Models over CIELAB chroma samples collected from automatically segmented semantic regions, then penalizing both out-of-distribution chroma (Mahalanobis distance) and hue-direction inconsistency relative to the nearest GMM mean. Optimizing this score via a perception-aware mask
What carries the argument
CaCDD, the Content-aware Color Distributional Distance, is a differentiable, ground-truth-free score built from label-conditioned GMM color priors in CIELAB a,b space. For each pixel it combines (i) a responsibility-weighted squared Mahalanobis distance to the semantic GMM, and (ii) a hue-direction inconsistency term that penalizes chroma directions far from the nearest GMM mean. It does the double duty of serving as the optimization objective for SCNB and as the evaluation metric for color plausibility.
Load-bearing premise
The load-bearing premise is that CaCDD's GMM-based color priors, built from ImageNet segmentations, actually capture what humans perceive as natural or unnatural color; if this metric diverges from human judgment, the reported defense effectiveness is inflated.
What would settle it
Run a human perceptual study where participants rate the plausibility of colorized images with high CaCDD scores (e.g., >3.0) against images with low scores; if participants find the high-CaCDD images acceptable or natural, the metric fails. Alternatively, train an adaptive colorizer that explicitly minimizes CaCDD while matching semantic priors and show it produces plausible outputs despite the perturbation.
If this is right
- If SCNB works as claimed, grayscale content providers can apply a one-time perturbation at publication, and any unauthorized AI colorization will look visibly wrong, reducing the resale value of pirated derivatives.
- CaCDD offers a new evaluation axis for colorization systems: semantic plausibility rather than just fidelity or colorfulness, which could become a standard metric for colorization quality and adversarial defense.
- The method is robust to common post-processing like JPEG compression and random resized cropping, meaning it can survive typical online sharing pipelines.
- Ensemble crafting improves transferability to unseen colorizers, suggesting that the defense can be made practical against a moving set of AI tools.
- Because the protection is in the released grayscale image itself, it requires no cooperation from the attacker or the colorization service.
Where Pith is reading between the lines
- The paper's effectiveness claim hinges entirely on CaCDD's fidelity to human perception of 'content-inconsistent' colors; a human perceptual study or an adaptive attacker that optimizes for both plausibility and low CaCDD could expose a gap.
- The semantic priors are built from ImageNet-style natural images, so applying SCNB to domains with different color statistics (e.g., anime, historical film stocks, medical imaging) may shift or weaken the defense; a domain-specific prior construction is a natural extension.
- CaCDD as a metric could be repurposed as a content-aware 'color plausibility detector' for forensics, flagging colorized images whose color distribution deviates from learned semantic priors, independent of the defense use case.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes SCNB, a proactive content-side defense that adds imperceptible perturbations to grayscale images so that downstream colorization models produce colors inconsistent with the scene content, rather than merely desaturated images. The method is an adversarial-example optimization that maximizes a newly introduced Content-aware Color Distributional Distance (CaCDD), defined from semantic color priors built with RAM tagging and Grounded-SAM segmentation over ImageNet. Experiments on three colorizers (DeOldify, BigColor, DDColor) report large CaCDD increases in white-box settings, some robustness to JPEG and random resized crop, and moderate black-box transferability when crafted with an ensemble. The authors position SCNB as an improvement over the chroma-suppression baseline PAChroma.
Significance. If the CaCDD metric truly tracks human judgments of semantic color unnaturalness, SCNB would be a meaningful step toward practical UE defenses and CaCDD itself would be a useful evaluation tool. The paper provides a transparent, reproducible recipe for constructing semantic color priors and a clear adversarial framework. However, the central evidence currently rests on a metric that is both the optimization objective and the evaluation criterion, so the claimed effectiveness is not independently established. The deferral of human studies and adaptive-attacker evaluation is a substantive gap that must be addressed before the practical claims can be accepted.
major comments (4)
- [§IV-B, Eq. (1); §IV-C, Eq. (7); Table I] The central effectiveness evidence is circular. SCNB maximizes CaCDD (Eq. 1) and CaCDD is defined in Eq. (7); Table I then reports CaCDD increases, e.g., BigColor 1.26→3.05 (+142%). In the white-box setting this increase is a direct consequence of the optimization objective. The paper defers human studies to Section VI, and Fig. 12 only shows weak correlation with CF/PSNR/SSIM, which does not validate CaCDD against human perception. Without an independent measure of semantic unnaturalness, the white-box results do not support the claim that colors are 'visibly implausible' rather than merely unusual under a GMM prior.
- [App. VII-A, Table III] The semantic priors are built from RAM/Grounded-SAM segmentations on ImageNet with multiple hand-set acceptance thresholds (area_min, score_min, text_min, bbox_IoU_min, etc.). None of these parameters is validated against human color plausibility. Maximizing CaCDD may exploit artifacts of the mask-selection process or the GMM fit (e.g., labels with poorly estimated priors) rather than producing colors that are genuinely inconsistent with the depicted object. A concrete test would be to run a human study on a sample of protected outputs, or to compare CaCDD-maximized outputs against an independent semantic-color-plausibility benchmark, and show that high CaCDD correlates with human-rated unnaturalness.
- [Table I, Table II] Transferability is one of the four UE requirements and a stated practical requirement, but the reported black-box gains are modest. In Table I, SCNB crafted on BigColor raises CaCDD by only +16% on DeOldify and +20% on DDColor. In Table II, ensemble crafting still leaves some unseen-target cells at +13%, +17%, and +26%. These numbers are consistent with the paper's admission of modest black-box gain, but they weaken the 'practical deployment in real-world content-sharing pipelines' claim. The paper should state a success threshold for transferability and discuss whether these gains are sufficient to deter unauthorized colorization, especially when the adversary can choose a colorizer that does not align with the surrogate set.
- [§V vs. App. X-A] The runtime is reported inconsistently: Section V states approximately 6 hours total and 10 minutes per image, while App. X-A states approximately 13 hours total and 20 minutes per image. Since the computational cost is used to justify practical deployment, this discrepancy must be resolved—there is likely an error in one of the two statements or a difference in experimental conditions that should be explained.
minor comments (4)
- [Abstract and §II] Typographical issue: 'Building onUncolorable Examples' appears in the abstract (missing space). Also 'oftenreactive' in the introduction should be 'often reactive'.
- [Fig. 4] The caption says 'Detectable/Undetectable' without defining what is being detected. It would help to clarify whether this refers to perturbation detection or color plausibility detection.
- [§IV-C, Eq. (5)] The hue-direction term uses a hard cap at angle π/2. The choice is not motivated; a brief explanation of why angles beyond 90 degrees are saturating would improve interpretability.
- [App. X-B] Table V reports 'mean over 80 runs: 40 images×2 seeds', but the main text says '40 ImageNet validation images with two random seeds' without clarifying whether the seeds affect the image selection or the perturbation optimization. Please state what the two seeds randomize.
Circularity Check
White-box CaCDD gains are the objective being optimized, so the headline effectiveness evidence is partly circular without external validation of the metric.
specific steps
-
fitted input called prediction
[Abstract; Section IV-B Eq. (1); Section V-A (Table I)]
"We further introduce Content-aware Color Distributional Distance (CaCDD), a ground-truth-free, content-aware measure of color plausibility derived from semantic color priors, used both as the optimization objective of SCNB and as an evaluation metric. ... δ⋆ = arg max ∥δ∥∞≤ϵ CaCDD( G(xl +δ) ). ... SCNB, however, substantially increases CaCDD in the white-box setting across all three colorizers, e.g., BigColor 1.26→3.05 (+142%), showing that the outputs deviate from content-conditioned color priors."
Eq. (1) explicitly defines the perturbation as maximizing CaCDD, and CaCDD is simultaneously the paper's effectiveness metric. The white-box Table I increases are therefore increases in the exact function being optimized: they are expected by construction whenever the optimizer succeeds, and they cannot independently establish that the colors are semantically implausible. The accompanying conclusion, 'showing that the outputs deviate from content-conditioned color priors,' restates the definition of the optimization target rather than providing external evidence. Because CaCDD is a newly introduced, ground-truth-free metric with no human validation (Sec. VI defers human studies), the headline quantitative claim reduces to the optimized loss. CF increases and black-box cells provide partial
full rationale
The main circularity is structural: the paper optimizes CaCDD and then reports CaCDD increases as evidence of effectiveness. This is not a case of author self-citation or renamed prior results; the self-citation to PAChroma [6] is used mainly as a baseline and optimization-backbone reference, not to establish the central claim. However, the paper's own abstract states that CaCDD is 'used both as the optimization objective of SCNB and as an evaluation metric,' and Eq. (1) confirms the optimization target is CaCDD. The strongest quantitative results (e.g., BigColor CaCDD 1.26→3.05, +142%) are therefore forced in the white-box setting by construction, and the robustness numbers are also CaCDD-based. The paper does include independent signals: CF rises sharply, black-box transfer is reported, and post-processed outputs are measured; these prevent the whole contribution from being definitionally empty. But because CaCDD is the only operational definition of 'content-inconsistent' and is not validated against human judgment or any external plausibility benchmark, the central claim that SCNB produces 'visibly content-inconsistent colors' remains partially circular. Score 6 reflects partial circularity: one or more headline predictions reduce by construction, while independent content still exists.
Axiom & Free-Parameter Ledger
free parameters (8)
- GMM components per semantic label (K) =
3
- hue weight (lambda_hue) =
1.0
- chroma threshold tau for hue weighting (w_p) =
not stated
- numerical stability constant epsilon_d =
not stated
- GMM covariance regularization lambda_reg =
1e-4
- mask-acceptance thresholds (area_min/area_max/score_min/box_min/text_min/bbox_IoU_min, top-m tags, N_min/N_max) =
0.01/0.95/0.35/0.30/0.30/0.30, 25, 500/2000
- optimization hyperparameters (T, alpha, mu, N, block splits) =
T=100, alpha=epsilon/10, mu=1.0, N=20, split=3
- perturbation budget epsilon =
4/255 to 32/255
axioms (5)
- domain assumption Deviations from class-conditional GMM color priors in CIELAB correspond to human-perceived color unnaturalness.
- domain assumption RAM + Grounded-SAM segmentation of ImageNet, filtered by Table III thresholds, yields reliable semantic regions whose ab-samples represent the label's natural colors.
- domain assumption ImageNet color statistics represent 'natural' color for the deployment targets (manga panels, archival photographs).
- domain assumption A defender can craft against surrogate colorizers whose vulnerabilities transfer to the attacker's unknown model.
- standard math Momentum iterative adversarial optimization (MI-FGSM) with input transformations finds a useful local maximum of CaCDD.
invented entities (1)
-
CaCDD (Content-aware Color Distributional Distance)
independent evidence
Cite this review
Pith. "Pith review of Semantic Color Naturalness Breaker: Preventing Illegitimate Colorization via Content-Aware Color Priors." pith.science (2026). https://pith.science/paper/FUCEHHAU
@misc{pith2026260717610,
author = {Pith},
title = {Pith review of: Semantic Color Naturalness Breaker: Preventing Illegitimate Colorization via Content-Aware Color Priors},
year = {2026},
howpublished = {\url{https://pith.science/paper/FUCEHHAU}},
note = {Machine review of arXiv:2607.17610}
}
read the original abstract
Automatic image colorization enables large-scale and low-cost reuse of grayscale media (e.g., manga panels and archival photographs), facilitating unauthorized reuse and redistribution. Once released online, grayscale content can be readily turned into unauthorized colorized derivatives using off-the-shelf models, creating a practical need for proactive, content-side protection at publication time. Building on Uncolorable Examples (UE), which add imperceptible perturbations to released grayscale images to degrade unauthorized colorization, we propose Semantic Color Naturalness Breaker (SCNB) -- a semantic-level UE framework that drives colorization outputs toward content-inconsistent colors while preserving the visual fidelity of the released grayscale media. We further introduce Content-aware Color Distributional Distance (CaCDD), a ground-truth-free, content-aware measure of color plausibility derived from semantic color priors, used both as the optimization objective of SCNB and as an evaluation metric. Experiments on ImageNet show that our method remains effective under small perturbation budgets and common post-processing, supporting practical deployment in real-world content-sharing pipelines.
Figures
Reference graph
Works this paper leans on
-
[1]
Towards vivid and diverse image colorization with generative color prior,
Yanze Wu, Xintao Wang, Yu Li, Honglun Zhang, Xun Zhao, and Ying Shan, “Towards vivid and diverse image colorization with generative color prior,” 2022
2022
-
[2]
Ddcolor: Towards photo-realistic image coloriza- tion via dual decoders,
Xiaoyang Kang, Tao Yang, Wenqi Ouyang, Peiran Ren, Lingzhi Li, and Xuansong Xie, “Ddcolor: Towards photo-realistic image coloriza- tion via dual decoders,” 2023, https://arxiv.org/abs/2212.11613
Pith/arXiv arXiv 2023
-
[3]
Palette: Image-to-image diffusion models,
Chitwan Saharia, William Chan, Huiwen Chang, Chris A. Lee, Jonathan Ho, Tim Salimans, David J. Fleet, and Mohammad Norouzi, “Palette: Image-to-image diffusion models,”arXiv preprint arXiv:2111.05826, 2022
Pith/arXiv arXiv 2022
-
[4]
I will color and repaint manga and comic pages using ai,
Fiverr, “I will color and repaint manga and comic pages using ai,” https://www.fiverr.com/striderxyz/color-and-r epaint-manga-and-comic-pages-using-ai, Accessed: 2026-01-21
2026
-
[5]
Selling of pirated dvds of classic black-and-white films found guilty,
Content Overseas Distribution Association (CODA), “Selling of pirated dvds of classic black-and-white films found guilty,”https: //coda-cj.jp/en/news/832/, Jan. 2026, Accessed: 2026-02- 04
2026
-
[6]
Yuki Nii, Futa Waseda, Ching-Chun Chang, and Isao Echizen, “Uncolorable examples: Preventing unauthorized ai colorization via perception-aware chroma-restrictive perturbation,”arXiv preprint arXiv:2510.08979, 2025
arXiv 2025
-
[7]
DeOldify: Deep learning for image colorization and restoration,
Jason Antic, “DeOldify: Deep learning for image colorization and restoration,” 2021, GitHub,https://github.com/jantic/De Oldify
2021
-
[8]
Bigcolor: Colorization using a generative color prior for natural images,
Geonung Kim, Kyoungkook Kang, Seongtae Kim, Hwayoon Lee, Sehoon Kim, Jonghyun Kim, Seung-Hwan Baek, and Sunghyun Cho, “Bigcolor: Colorization using a generative color prior for natural images,” 2022
2022
-
[9]
Intriguing properties of neural networks,
Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Du- mitru Erhan, Ian Goodfellow, and Rob Fergus, “Intriguing properties of neural networks,”arXiv preprint arXiv:1312.6199, 2013
Pith/arXiv arXiv 2013
-
[10]
Ex- plaining and harnessing adversarial examples,
Ian J Goodfellow, Jonathon Shlens, and Christian Szegedy, “Ex- plaining and harnessing adversarial examples,”arXiv preprint arXiv:1412.6572, 2014
Pith/arXiv arXiv 2014
-
[11]
Towards deep learning models resistant to adversarial attacks,
Aleksander Madry, Aleksandar Makelov, Ludwig Schmidt, Dimitris Tsipras, and Adrian Vladu, “Towards deep learning models resistant to adversarial attacks,” inInternational Conference on Learning Representations (ICLR), 2018
2018
-
[12]
Structure- preserving transformation for adversarial example generation,
Chen Shen, Yinpeng Dong, Hang Su, and Jun Zhu, “Structure- preserving transformation for adversarial example generation,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 6890–6900
2021
-
[13]
Glaze: Protecting artists from style mimicry by text-to-image models,
Shawn Shan, Jenna Cryan, Emily Wenger, Haitao Zheng, Rana Hanocka, and Ben Y . Zhao, “Glaze: Protecting artists from style mimicry by text-to-image models,” inUSENIX Security Symposium, 2023
2023
-
[14]
Nightshade: Prompt-specific poisoning attacks on text-to-image generative models,
Shawn Shan, Wenxin Ding, Josephine Passananti, Stanley Wu, Haitao Zheng, and Ben Y . Zhao, “Nightshade: Prompt-specific poisoning attacks on text-to-image generative models,” inIEEE Symposium on Security and Privacy (SP), 2024
2024
-
[15]
Raising the cost of malicious AI-powered image editing,
Hadi Salman, Alaa Khaddaj, Guillaume Leclerc, Andrew Ilyas, and Aleksander Madry, “Raising the cost of malicious AI-powered image editing,” inProceedings of the 40th International Conference on Machine Learning, Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett, Eds. 2023, vol. 202 ofProceedings of Mach...
2023
-
[16]
Measuring colourfulness in natural images,
David Hasler and Sabine Suesstrunk, “Measuring colourfulness in natural images,”Proceedings of SPIE - The International Society for Optical Engineering, vol. 5007, pp. 87–95, 06 2003
2003
-
[17]
Recognize anything: A strong image tagging model,
Youcai Zhang, Xinyu Huang, Jinyu Ma, Zhaoyang Li, Zhaochuan Luo, Yanchun Xie, Yuzhuo Qin, Tong Luo, Yaqian Li, Shilong Liu, Yandong Guo, and Lei Zhang, “Recognize anything: A strong image tagging model,” 2023
2023
-
[18]
Grounded sam: Assembling open-world models for diverse visual tasks,
Tianhe Ren, Shilong Liu, Ailing Zeng, Jing Lin, Kunchang Li, He Cao, Jiayu Chen, Xinyu Huang, Yukang Chen, Feng Yan, Zhaoyang Zeng, Hao Zhang, Feng Li, Jie Yang, Hongyang Li, Qing Jiang, and Lei Zhang, “Grounded sam: Assembling open-world models for diverse visual tasks,”arXiv preprint arXiv:2401.14159, 2024
Pith/arXiv arXiv 2024
-
[19]
Imagenet: A large-scale hierarchical image database,
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei- Fei, “Imagenet: A large-scale hierarchical image database,” inIEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009, pp. 248–255. Appendix for ”Semantic Color Naturalness Breaker: Preventing Illegitimate Colorization via Content-Aware Color Priors” Yuki Nii⋆ Futa Waseda⋆ ...
arXiv 2009
This paper was first reviewed by deepseek-v4-flash on August 1, 2026.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.