REVIEW 3 major objections 4 minor 1 cited by
Malicious editing instructions can be conveyed entirely through visual cues — arrows, circles, handwriting — with no text prompt, and current image editing models obey them up to 80.9% of the time on Nano Banana Pro and over 70% on GPT-Imag
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · deepseek-v4-flash
2026-08-03 01:13 UTC pith:2XK55FDC
load-bearing objection Vision-side attack surface is real and IESBench is worth having, but the headline ASR overstates because non-edits and safe substitutes count as successes. the 3 major comments →
When the Prompt Becomes Visual: Vision-Centric Jailbreak Attacks for Large Image Editing Models
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central claim is that safety in modern image editing models is misaligned along modality: the models are trained to obey visual instructions — marks, arrows, handwritten directives — while their guardrails are built to police language. A jailbreak can therefore run with no text at all: a malicious instruction drawn onto the input image is executed as an edit, producing policy-violating output. This Vision-Centric Jailbreak Attack succeeds in up to 80.9% of trials against Nano Banana Pro and more than 70% against GPT-Image-1.5, models that reject the same requests when phrased as text. The authors further claim that attack power scales with visual capability, and that a short text safety
What carries the argument
The mechanism is 'vision-centric safety misalignment': editing models must parse intent from pixels, while guardrails police language, so a visual-only instruction lands outside what the safety layers were built to detect. The attack itself, VJA (Vision-Centric Jailbreak Attack), is black-box and prompt-level: the malicious instruction is drawn or annotated onto a benign image, and the text channel is left empty. Claims are measured on IESBench, a benchmark of 1,054 annotated images in 15 risk categories, scored by a multimodal large language model (MLLM) judge on attack success and harmfulness. The countermeasure is a training-free introspection trigger — a sentence appended to the prompt a
Load-bearing premise
The load-bearing premise is the measurement protocol of Section 3.2: an attack counts as successful whenever the model does anything but refuse — including producing an unrelated safe image or no meaningful edit (Appendix B.5) — and the judge is handed each sample's risk category before scoring (Appendix B.4), so the headline success rates could overstate how often genuinely harmful edits are produced.
What would settle it
Re-run the attacks on a random subset of the 1,054 benchmark images and score the outputs with an MLLM judge that is blind to risk category and that counts as failures both 'unrelated safe content' responses (score 2) and edits the authors themselves label 'successful but invalid' (validity 0); have a small human panel label the same outputs as harmful or not. If the recalculated success rates on Nano Banana Pro and GPT-Image-1.5 fall well below the reported 80.9% and 70%, the claim that text-centric safeguards are systematically bypassed would need to be weakened from 'compromised' to 'occasi
If this is right
- Text-centric guard models and prompt moderation give little protection against vision-only instructions, because the malicious request never appears as text; safety must be enforced on the visual input or on the output image instead.
- The most capable commercial editors are also the most exploitable: models that reject the same requests in text follow them faithfully as drawings, so visual capability and vulnerability grow together.
- Evidence tampering and aversive manipulation — fabricating documents, faking scenes, inducing discomfort — are the most consistently successful categories, making forged visual evidence the chief danger of this attack surface.
- A weakly aligned open-weight model can be brought to roughly commercial safety levels with a training-free text trigger: attack success falls by about a third and average harmfulness by 1.2 points, at a few percent extra runtime.
- Editing-task safety needs editing-specific metrics: refusal rates alone miss 'successful but invalid' attacks, so the benchmark adds editing validity and high-risk ratio to separate real harmful edits from failed or irrelevant outputs.
Where Pith is reading between the lines
- The same attack pattern transfers beyond offensive content: any application that lets users annotate edits onto documents, receipts, contracts, or product images inherits a visual jailbreak path, where the harm is fraud or legal tampering rather than graphic content — a consequence the paper's categories hint at but do not develop.
- The introspection defense assumes the attacker cannot touch the prompt channel; an adversary aware of the trigger could plausibly paint a visual cue ordering the model to ignore the appended safety review, a failure mode the paper does not test.
- The finding that strong vision models obey drawings faithfully sets up a capability race: as editors improve at visual instruction-following, both the attack and the introspection defense strengthen together, so net safety depends on which side receives more alignment investment.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces Vision-Centric Jailbreak Attack (VJA), an attack for large image editing models in which a malicious editing instruction is encoded entirely in visual cues (marks, arrows, visual-text prompts) and the model is queried with an image-only input. The authors also construct IESBench, a benchmark of 1054 visually prompted images spanning 15 risk categories, and evaluate VJA on seven commercial and open-source editing models. The headline results are ASRs up to 80.9% on Nano Banana Pro and 70.3% on GPT Image 1.5. A training-free defense is proposed that appends a short 'safety trigger' text to the multimodal prompt, activating internal safety reasoning through KV-cache reuse with negligible overhead; on a local Qwen model this reduces ASR from 100% to 66.9%.
Significance. The paper targets a genuinely important and underexplored safety surface: as image editing models shift to vision-prompt interaction, malicious intent can be conveyed without text, potentially bypassing text-centric safeguards. The IESBench resource—1054 images, 15 categories, hierarchical risk levels, text annotations for transferability—is a valuable contribution if released, and the comparison across commercial and open-source models is systematic. The training-free trigger defense is a practical, low-overhead idea that deserves attention. The paper also includes sensitivity analyses and a human-judge comparison. However, as written, the headline quantitative claims are not supported by the metrics as defined: ASR counts non-refusals even when the output is a safe substitution or a non-edit, and the judge prompt primes higher harm scores. Thus the central 'compromises state-of-the-art models' claim needs reanalysis and re-reporting.
major comments (3)
- [Abstract; Table 1; §3.2; Appendix C.1] The headline attack-success claim is not supported by the primary metric as defined. Appendix C.1 defines ASR as 'the ratio of malicious requests that are not recognized and rejected by the safeguard model.' Appendix B.4 assigns Score 2 to outputs that replace the malicious request with unrelated safe content (e.g., a flower), and Appendix B.5 explicitly labels non-edits and miscomprehended edits as 'successful but invalid attacks' with HS=2 and EV=0. Both are counted as ASR successes. Consequently, the Abstract's '80.9% on Nano Banana Pro and 70.3% on GPT Image 1.5' overstate how often VJA actually produces a harmful edit; the more honest High Risk Ratio (70.6% and 52.0% in Table 1) is still biased upward by the judge priming described below. Please re-report using a metric that requires EV=1 and HS≥τ as the primary success measure, and present the current ASR only as a 'non-refusal' se
- [Appendix B.4] The judge rubric is not neutral. The judge is given the sample's risk category ('Risk Category: {risk category}') and instructed by Special Notices 1 and 2 to 'increase your harmfulness score accordingly' for levels 2/3 and that 'the harmfulness score should be greater than 2.' This directly inflates HS and therefore any threshold-derived statistic such as HRR (Eq. 5). The human validation in Table 3 does not resolve this: it asks human evaluators to vote on which MLLM rating/reasoning is best on a 5% sample, not to provide independent absolute scores, and the same primed rubric is used. Please ablate the judge prompt by removing the risk-category header and the two special notices, and report per-model agreement with unprimed human scoring.
- [Table 1; §4; Table 2] All headline results appear to be single-run evaluations with no variance estimates. Commercial API models can be nondeterministic and are updated over time. Since the central claim is quantitative (specific ASR/HRR values), the paper should report at least three independent runs with mean ± std or bootstrap confidence intervals, or justify deterministic inference. Without this, the reader cannot assess whether, e.g., the reported 80.9% vs 70.1% gap is stable or whether defense improvements are within noise. This is especially important because the defense comparison (Qwen-Image-Edit-Safe vs. Qwen-Image-Edit*) relies on exact ASR reductions of 33%.
minor comments (4)
- [Figure 3 / body text] Several stray tokens such as 'None', 'TStop', and 'Qwen2.5VL' appear in the main text near Eq. (2) and Figure 3. These appear to be leftover fragments from figure/log formatting and should be removed.
- [§4.4, Table 3] The text says 'Gemini 3 Pro and GPT 5.2 are the two most preferred models,' but Table 3 shows GPT 5.2 at 29.3% and Gemini 3 Pro at 25.4%; the wording should state that GPT 5.2 is the most preferred, followed by Gemini 3 Pro. Also, the table header has 'V otes' with a spacing artifact.
- [Appendix A.1] The sensitivity analysis is conducted on a 7-image sample. If this is intended to support claims about benchmark robustness ('the strong ASR and HS maintained by IESBench'), please state the small-sample limitation clearly or expand the sample.
- [§3.1] The text says IESBench 'merely selects 15 suitable images from the prior benchmark,' which reads as a typo for 'also selects' or a similar expression. Please clarify that the prior-benchmark subset is a small cross-benchmark comparison set, not the full IESBench.
Circularity Check
No load-bearing circularity: the central vulnerability claim is an empirical measurement against external commercial/open-source models, with external MLLM and human judging; the co-developed benchmark/attack/defense setup is a mild self-referential evaluation loop, not a circular derivation.
full rationale
The paper's central claims are empirical measurements, not derivations. VJA is tested against seven external victim models via public APIs, compared against a text-centric baseline (TJA), and judged by five MLLMs plus independent human annotators (Table 3). No parameter is fitted to a subset and then predicted on a related quantity; no load-bearing self-citation appears; no uniqueness result from the authors' prior work is invoked; and the defense's safety trigger is training-free and evaluated zero-shot on a mixed benign/malicious set. The benchmark/attack/defense are co-developed, which is a mild self-referential evaluation setup, but that is not circularity: IESBench's taxonomy is grounded in external content policies, and the reported metrics (ASR, HS, EV, HRR) are defined transparently. The ASR definition counts non-refusals, including some outputs the appendix itself labels 'successful but invalid' (B.5) or safe replacements (B.4), so headline ASR overstates how often harmful edits are produced; this is a metric-validity caveat, not a reduction by construction, and HRR plus human evaluation (75.1%) independently support the direction of the vulnerability finding. The paper also self-reports its limitation that VJA is less effective on models with limited visual perception, further indicating honest scope rather than circular argument.
Axiom & Free-Parameter Ledger
free parameters (3)
- HRR threshold tau =
4
- IESBench taxonomy and dataset scale =
15 categories / 116 attributes / 9 actions / 1054 images
- Safety trigger wording =
hand-crafted sentence ("You are an image editing safety evaluator...")
axioms (4)
- domain assumption MLLM judge provides valid harmfulness labels
- domain assumption The 15-category taxonomy covers the safety-relevant risks for image editing
- domain assumption Commercial API outputs reflect model-level safety alignment
- ad hoc to paper Appending the trigger activates pre-existing safety awareness via attention
invented entities (3)
-
IESBench
no independent evidence
-
Vision-Centric Jailbreak Attack (VJA)
no independent evidence
-
Introspective safety trigger
no independent evidence
read the original abstract
Recent advances in large image editing models have shifted the paradigm from text-driven instructions to vision-prompt editing, where user intent is inferred directly from visual inputs such as marks, arrows, and visual-text prompts. While this paradigm greatly expands usability, it also introduces a critical and underexplored safety risk: the attack surface itself becomes visual. In this work, we propose Vision-Centric Jailbreak Attack (VJA), the first visual-to-visual jailbreak attack that conveys malicious instructions purely through visual inputs. To systematically study this emerging threat, we introduce IESBench, a safety-oriented benchmark for image editing models. Extensive experiments on IESBench demonstrate that VJA effectively compromises state-of-the-art commercial models, achieving attack success rates of up to 80.9% on Nano Banana Pro and 70.1% on GPT-Image-1.5. To mitigate this vulnerability, we propose a training-free defense based on introspective multimodal reasoning, which substantially improves the safety of poorly aligned models to a level comparable with commercial systems, without auxiliary guard models and with negligible computational overhead. Our findings expose new vulnerabilities, provide both a benchmark and practical defense to advance safe and trustworthy modern image editing systems. Warning: This paper contains offensive images created by large image editing models.
Figures
Forward citations
Cited by 1 Pith paper
-
Generate "Normal", Edit Poisoned: Branding Injection via Hint Embedding in Image Editing
Invisible hints such as logos embedded in images are re-rendered by diffusion models during text-guided editing, enabling phishing and model-poisoning attacks with average success rates of 44.4% and 32.2%.
Reference graph
Works this paper leans on
-
[20]
Jailbreak in pieces: Compositional adversarial attacks on multi-modal language models, 2023
18, 26 Shayegani, E., Dong, Y ., and Abu-Ghazaleh, N. Jailbreak in pieces: Compositional adversarial attacks on multi-modal language models, 2023. URL https://arxiv.org/ abs/2307.14539. 8 Song, J., Meng, C., and Ermon, S. Denoising diffusion implicit models. InInternational Conference on Learning Representations (ICLR), 2021. 8 Team, M. L., Ma, H., Tan, H...
Pith/arXiv arXiv 2023
-
[2017]
Odysseus: Jailbreaking commercial multimodal llm-integrated sys- tems via dual steganography, 2025a
8 Li, S., Cheng, J., Li, Y ., Jia, X., and Tao, D. Odysseus: Jailbreaking commercial multimodal llm-integrated sys- tems via dual steganography, 2025a. URL https: //arxiv.org/abs/2512.20168. 8 Li, X., Wu, J., Yu, T., Wang, R., Wang, Y ., Chen, X., Gu, J., Yao, L., McAuley, J., and Shang, J. Commit: Coordinated multimodal instruction tuning. InProceedings ...
arXiv 2025
-
[2023]
1 Fu, X., Hu, Y ., Li, B., Feng, Y ., Wang, H., Lin, X., Roth, D., Smith, N. A., Ma, W.-C., and Krishna, R. Blink: Multi- modal large language models can see but not perceive. In European Conference on Computer Vision, pp. 148–166. Springer, 2024. 8 Gong, Y ., Ran, D., Liu, J., Wang, C., Cong, T., Wang, A., Duan, S., and Wang, X. Figstep: Jailbreaking lar...
Pith/arXiv arXiv 2024
-
[2024]
8 Meng, C., He, Y ., Song, Y ., Song, J., Wu, J., Zhu, J.-Y ., and Ermon, S
URL https://proceedings.mlr.press/ v235/mazeika24a.html. 8 Meng, C., He, Y ., Song, Y ., Song, J., Wu, J., Zhu, J.-Y ., and Ermon, S. SDEdit: Guided image synthesis and editing with stochastic differential equations. InInternational Conference on Learning Representations (ICLR), 2022. 8 OpenAI. Gpt image 1.5. https:// openai.com/zh-Hans-CN/index/ new-chat...
Pith/arXiv arXiv 2022
-
[2025]
5 Zhao, H., Yuan, C., Huang, F., Hu, X., Zhang, Y ., Yang, A., Yu, B., Liu, D., Zhou, J., Lin, J., et al. Qwen3guard technical report.arXiv preprint arXiv:2510.14276, 2025a. 3 Zhao, X., Yang, X., Pang, T., Du, C., Li, L., Wang, Y .-X., and Wang, W. Y . Weak-to-strong jailbreaking on large language models.ICML, 2025b. 5 Zheng, L., Chiang, W.-L., Sheng, Y ....
Pith/arXiv arXiv 2023
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.