Pith. sign in

REVIEW 3 major objections 5 minor 9 references

ChartAttack: Testing the Vulnerability of LLMs to Malicious Prompting in Chart Generation

T0 review · 3 major / 5 minor · reviewed 2026-08-03 · deepseek-v4-flash

Pith's one-line read This paper shows that code-based multimodal LLMs can be prompted to generate misleading charts, and that these charts reduce chart question-answering accuracy for both automated and human readers.

desk verdict A solid first systematic attack benchmark for LLM chart generation, but the headline drops are measured on a pre-filtered set of successful attacks and the human pilot is too weak to carry the generalization claim. read the letter →

arxiv 2601.12983 v3 pith:CX2652DJ submitted 2026-01-19 cs.CL

classification cs.CL
keywords chartgenerationmisleadingchartsmultimodalLLMsjailbreakattackquestionansweringvisualizationmisleadersadversarialpromptingrobustnessfine-tuning
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tries to establish that multimodal large language models (MLLMs) can be reliably misused to generate misleading charts at scale: given a JSON chart specification, a question, and a few retrieved demonstrations, an instruction-tuned code model will edit the chart's design—inverting an axis, switching to a log scale, adding 3D perspective—while leaving the underlying data unchanged, and will also supply a plausible but wrong answer. The authors build AttackViz, a dataset in which each chart-question pair is labeled with the misleader applied and the incorrect answer it induces. On that dataset, charts produced this way reduce question-answering accuracy by 17.2 percentage points in-domain and 11.9 points cross-domain, and a small human pilot shows a 20.2-point drop. The paper also shows that fine-tuning on AttackViz improves robustness to these charts, at a small cost on correct charts. This matters because chart generation is being automated, creating an attack surface where accurate data can be rendered into systematically misleading visuals.

What carries the argument

The central object is the chart JSON annotation—a structured description of the data values, axes, scales, colors, stacked/3D flags, and categories—because a misleader is a minimal edit to that annotation that changes how the chart is drawn without changing the data it encodes. Around this, ChartAttack has two modules: a demonstration-selection module that retrieves example question–annotation pairs whose misleader sets match the current instance, and a misleader-generator module, an instruction-tuned code-based MLLM prompted few-shot to output a JSON snippet plus a matching misleading answer. The same annotation representation lets the charts be re-rendered with a plotting library and lets

What would settle it

Re-run the evaluation on the full, unfiltered set of chart-question pairs—including charts where the three construction models did not already agree on the correct answer or converge on the same wrong answer—and compare the average accuracy drop; if the drop largely disappears, the reported effect is an artifact of the filtering criterion rather than a general property of the generated charts.

Watch

Extended reading notes

Core claim

The central claim is that jailbreak-style prompting can automate the production of misleading charts at scale, and that the resulting charts are effective against both automated chart readers and human readers. ChartAttack works at the level of chart annotations: the attacker prompts a code-based multimodal LLM to output a minimal Python-dictionary snippet that applies one of eleven known misleaders—perceptual changes like inverted axes, 3D, stacked bars, misrepresentation through scaling factors, or truncated axes—without touching the data table. The misleading answer is a plausible but incorrect answer computed under the misleader, and the framework uses retrieval of similar demonstrations

Load-bearing premise

The headline accuracy drops are computed on instances that were selected by a majority-of-three-model filter that keeps only charts where the models answer correctly before the misleader and converge on a single wrong answer after it, with the assumption that those consistent wrong answers are caused by the misleader; if that filter selects for model-specific or atypical charts, the 17.2/11.9/20.2-point drops overstate the attack on ordinary charts.

Editorial extensions

If this is right

  • Anyone who can send a prompt can turn a legitimate chart-generation model into a source of misleading charts; the attack requires only JSON annotations and publicly available models.
  • Prompt-level defenses are not enough: adding a system guard that tells the model to avoid distortions leaves the attack success rate essentially unchanged.
  • Training on AttackViz can harden models: fine-tuning raises accuracy on misleading charts by 8.4 points, with a small drop on correct charts, so robustness can be bought but not for free.
  • Defenders should focus on perceptual misleaders—3D, stacking, log scales, misrepresentation—which cause the largest drops, while color-only changes are nearly harmless.
  • If chart generation is embedded in automated analysis or reporting pipelines, misleading charts can silently bias downstream decisions, since both models and humans are affected.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The reported effectiveness is measured on instances that survived a model-in-the-loop filter, so an unfiltered deployment may show smaller drops; a direct comparison on randomly selected charts would tell whether the attack generalizes or mainly exploits the selection criterion.
  • As chart-reading models improve, absolute vulnerability may increase rather than shrink: the paper's strongest models show the largest accuracy drops, which undercuts the intuition that better comprehension will automatically neutralize design-level manipulation.
  • Because the attack edits a library-agnostic JSON annotation, the same framework should transfer to other chart renderers and chart types beyond bar and line charts; extending it to pie, map, or custom visual encodings is a natural test.
  • A robust defense might not be model-level at all: comparing the rendered chart against data-derived invariants (e.g., axis range, scale, and value-label consistency) could catch most misleaders independently of the reader model.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper introduces ChartAttack, a framework that prompts code-based MLLMs to modify chart JSON annotations using eleven misleader techniques, and AttackViz, a chart QA dataset built from PlotQA, ChartQA, and ChartX. It reports that misleading charts reduce relaxed QA accuracy by 17.2 pp in-domain and 11.9 pp cross-domain across 16 open-weight and 3 closed models, and reports a 20.2 pp accuracy drop in a 12-participant human pilot. The paper also tests a prompt-based guard, finds it ineffective, and shows that QLoRA fine-tuning on AttackViz improves accuracy on the AttackViz test set by 8.44 pp. The central claim is that code-based MLLMs can be misused to generate misleading charts at scale that deceive both machines and humans.

Significance. The problem is timely and the paper is among the first to systematically study the dual-use risk of MLLM-based chart generation. If the reported effect sizes hold on an unfiltered sample of generated charts, the contribution is substantial: it demonstrates a concrete vulnerability, provides a reusable dataset, and gives initial evidence that fine-tuning can mitigate the attack. The detailed prompt and ablation appendices, public code/data, and evaluation across diverse model families are strengths. The main weakness is that the headline numbers are computed on AttackViz, whose construction uses a model-in-the-loop filter that pre-selects misleaders already known to fool the construction models; the current results should therefore be interpreted as conditional on that selection process, not as unconditional attack success rates.

major comments (3)
  1. [Section 4 (Evaluation and filtering process); Appendix D] The headline accuracy drops are measured on a corpus from which instances are retained only if the majority of the three construction models (QwenVL 2.5-32B, InternVL 3.0-38B, KimiVL-A3B) answer correctly on the original chart and incorrectly on the misleading chart, and the 'misleading answer' is itself the average or majority vote of those same models' incorrect responses. Appendix D states the working assumption that consistent incorrect responses are 'induced by the applied misleader.' This is a model-in-the-loop selection step, so the benchmark does not sample the typical effect of a misleader; it samples misleaders that were already effective against the construction models. Evaluating held-out models on these pre-screened instances does not remove the selection bias. The 17.2/11.9 pp figures, and the human 20.2 pp figure, may therefore overstate the effect on unfiltered charts. Pl
  2. [Section 5.3; Appendix F; Table 11] The human experiment uses 12 participants total (6 per arm), with no inferential test or confidence interval. Individual accuracies vary widely (e.g., 48% and 96% in the control group; 28.1% and 80.2% in the experimental group), so the 20.2 pp between-group gap is not established as attributable to the charts. In addition, the Introduction reports a 13.3 pp drop while the Abstract and Section 5.3 report 20.2 pp; this internal inconsistency must be reconciled. The human study should be presented as exploratory, with appropriate uncertainty, or the claim should be softened.
  3. [Section 5.1 (Deception rate) and Section 5.2] The paper distinguishes between accuracy degradation and the intended misleading answer. The deception-rate metrics require exact match to the constructed misleading answer, which is produced by averaging or majority-voting the construction models' incorrect responses. Because the construction models define the target, the measured rates (e.g., 11.2% conditional deception on originally-correct answers) may understate or confound the effect for models that do not share the construction models' error patterns. More importantly, the accuracy drop on the filtered set could reflect generic difficulty (e.g., charts becoming harder to read) rather than the specific misleading interpretation. Please report, for each model, the proportion of originally-correct answers that shift to (i) the constructed misleading answer, (ii) another incorrect answer, and (iii) no answer; this would support the cl
minor comments (5)
  1. [Abstract and Introduction] The human accuracy drop is reported as 20.2 pp in the Abstract and Section 5.3, but 13.3 pp in the Introduction. Please reconcile the numbers.
  2. [Figure 4] The caption says 'the 11 evaluated models,' but the figure and Section 5.1 list 16 open-weight plus 3 closed models. Please correct the count.
  3. [Table 1] The row for '3D' does not have a misleader name in the left column, unlike the other rows. Add a label such as '3D effect.'
  4. [Section 5.1] Relaxed accuracy is cited to prior work but not formally defined in the main text. Give a one-sentence definition.
  5. [Table 3] The 'None' row represents correct charts, not a misleader. Consider separating it from the misleader rows or labeling it as 'Correct chart' to avoid confusion.

Circularity Check

2 steps flagged · score 6.0 of 10

Deception-rate targets are defined by the construction models' own consensus, and headline drops are measured on a filter pre-screened for attack success — partial, not total, circularity.

  1. fitted input called prediction [Section 4 (Evaluation and filtering process); Section 5.1 (Evaluation metrics); Appendix D]
    "The final misleading answer is obtained by averaging incorrect numeric responses or taking the majority vote for textual responses. ... Deception rate (originally correct) measures the percentage of instances where a model answers correctly on the correct chart but outputs the misleading answer on the misleading chart."

    The exact-match target of the deception-rate metric is the consensus answer defined by the three construction models (QwenVL 2.5-32B, InternVL 3.0-38B, KimiVL-A3B) — the same models whose majority-correct/incorrect votes determine which instances enter AttackViz. A held-out model counts as 'deceived' only if it reproduces that averaged/majority-voted answer; a model that is equally misled but outputs any other wrong answer scores as not deceived. Appendix D supplies the missing premise: 'we assume that consistent incorrect responses across models are induced by the applied misleader.' That assumption is what converts agreement-with-construction-consensus into 'deception,' so the reported deception rates (11.2%/11.7%/14.9%) are partially forced by the construction target rather than measuri

  2. fitted input called prediction [Section 4 (Evaluation and filtering process) vs. Abstract; Limitations]
    "We retain instances where the majority of models answer correctly on the original chart but incorrectly on the misleading chart."

    The benchmark is built by retaining only charts that already fool the three construction models, and the same filtered pool feeds every headline estimate: the 17.2 pp in-domain drop, the 11.9 pp cross-domain drops (ChartQA/ChartX go 'through the same pipeline'), and the 20.2 pp human drop (Appendix F samples 'misleading instances generated by ChartAttack' from this pool). The drops are conditional on pre-screened attack success, not estimates for unfiltered charts. The Limitations passage acknowledges the filter ('the dataset may emphasize patterns effective against the models used during construction'), but the defense — testing 'a separate set of more recent models' — addresses model generalization, not instance selection, since every test instance was filtered against the construction f

full rationale

ChartAttack's core measurements are not fully reducible to their inputs, but two evaluation choices import the construction machinery directly into the reported numbers. (1) Definitional target: AttackViz's 'induced incorrect answers' are the average/majority vote of the three construction models, and the deception-rate metrics require exact match to this constructed answer; Appendix D's attribution assumption is the only link between consensus-agreement and causation. (2) Pre-screened benchmark: the retention filter guarantees every test instance is one where the misleading chart already flips the construction models from correct to incorrect, so the 17.2/11.9/20.2 pp drops are conditional on known attack success. The accuracy-drop measurements themselves are genuine — relaxed accuracy versus ground-truth answers on held-out models, plus a real (small) human pilot — so the central claim has independent content. Self-citations (Tonglet et al. 2025a/b) are not load-bearing; no uniqueness theorem is invoked; the misleader taxonomy is externally sourced (Lo et al. 2022). The circularity is partial: part of one metric (deception rate) reduces to agreement with the construction consensus, and the headline effect sizes are inflated by a filter that pre-selects attackable instances.

Assumptions & free parameters 6 free parameters · 6 assumptions · 1 invented entities

The paper's quantitative claims rest on several hand-chosen thresholds (consistency filters, misleader selection criteria, few-shot count) and, most importantly, on the assumption that output-consensus among three construction models constitutes evidence that a misleader caused the error. The AttackViz corpus is the paper's main constructed artifact; no free-floating physical entities are introduced.

free parameters (6)
  • Number of few-shot demonstrations k = 5
    Selected by oracle experiments (Appendix B, Table 5) on the AttackViz validation split; five-shot gives highest Macro F1.
  • Consistency filter thresholds = numeric std < 0.5; textual majority identical
    Used in Section 4 to define final misleading answers; these thresholds determine what counts as a successful attack and shape every reported drop.
  • Subsampling size per chart type = 400 images per partition
    Random subsample of PlotQA for corpus construction; affects the composition and difficulty of AttackViz.
  • Misleader inclusion thresholds = >=5 occurrences; 13 criteria-satisfying misleaders merged to 11
    Section 4 and Appendix C.1: selection of 11 misleaders from Lo et al.; all per-misleader attack numbers depend on this hand-chosen subset.
  • Misleading answer aggregation = average of numeric incorrect responses; majority vote for textual
    Section 4: the 'ground truth' wrong answer is derived from the construction models' outputs; evaluation models are scored against this aggregation.
  • LoRA fine-tuning hyperparameters = r=32, alpha=64, dropout=0.05, lr=5e-5, 3 epochs
    Appendix G.2: the robustness gain (+8.44 pp) is specific to these settings and to one base model (Qwen2.5-VL-3B).
assumptions (6)
  • ad hoc to paper Consistent incorrect responses across construction models are induced by the applied misleader, not by noise or ambiguity
    Explicitly stated in Appendix D and implicit in Section 4 filtering; this attribution assumption underlies all dataset labels and deception-rate scores.
  • domain assumption The Lo et al. (2022) taxonomy of misleaders is a valid and complete enumeration of design-level deception techniques for bar/line charts
    Section 3 and Table 1: the framework and corpus are built entirely on this taxonomy; other misleader types (reasoning misleaders) are excluded.
  • domain assumption Charts rendered from simplified JSON annotations faithfully reproduce the original PlotQA/ChartQA/ChartX charts' data and format
    Section 4 preprocessing verifies CSV consistency but relies on Phi-3.5-vision format extraction being accurate for grids, stacking, and bands.
  • ad hoc to paper Majority-vote accuracy of the three construction MLLMs is a reliable measure of whether a chart is answerable and whether a misleader is effective
    Section 4 'Evaluation and filtering process': this operationalization defines the dataset and therefore the reported 17.2/11.9 pp drops.
  • domain assumption Relaxed accuracy is an appropriate metric for chart QA and for attack effectiveness
    Standard metric from Masry et al. (2022) and Methani et al. (2020), used in Section 5; other metrics (exact match) would change the magnitude of reported drops.
  • ad hoc to paper With 12 participants, the observed human accuracy difference is attributable to the misleading charts rather than individual differences
    Section 5.3 and Table 11: the paper itself flags this as preliminary; control SD is 13.4 and experimental SD 21.4 with no significance test.
invented entities (1)
  • AttackViz dataset independent evidence
    purpose: Chart QA benchmark pairing correct and misleading chart annotations with misleaders and induced wrong answers; used to test attack effectiveness and to fine-tune defenses
    A publicly released artifact (GPLv3) that others can use to reproduce or extend experiments; it is a constructed resource, not a physical entity.

how reviews work

0 comments
Cite this review

Pith. "Pith review of ChartAttack: Testing the Vulnerability of LLMs to Malicious Prompting in Chart Generation." pith.science (2026). https://pith.science/paper/CX2652DJ

@misc{pith2026260112983,
  author       = {Pith},
  title        = {Pith review of: ChartAttack: Testing the Vulnerability of LLMs to Malicious Prompting in Chart Generation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/CX2652DJ}},
  note         = {Machine review of arXiv:2601.12983}
}
read the original abstract

Multimodal large language models (MLLMs) are increasingly used to automate chart generation from data tables, improving analysis and reporting efficiency while introducing new misuse risks. We present ChartAttack, a framework for evaluating how MLLMs can generate misleading charts at scale by injecting misleaders into chart designs to induce incorrect interpretations. We also introduce AttackViz, a chart question-answering (QA) dataset where each (chart specification, QA) pair is labeled with effective misleaders and their induced incorrect answers. ChartAttack significantly degrades QA performance, reducing MLLM accuracy by 17.2 points in-domain and 11.9 cross-domain. A controlled human study shows that misleading charts generated by ChartAttack reduce human chart QA performance. Finally, we demonstrate that AttackViz can be used to fine-tune MLLMs to improve robustness against misleading charts. Our findings highlight an urgent need for robustness and security considerations in the design, evaluation, and deployment of MLLM-based chart generation systems. We make our code and data publicly available.

Figures

Figures reproduced from arXiv: 2601.12983 by the authors.

Figure 1
Figure 1. Illustration of the dual use risks of MLLM [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Overview of our ChartAttack framework. The top part shows the generation of misleading charts by the [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗
Figure 3
Figure 3. Pipeline to create the AttackViz corpus. [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (11 more)
Figure 4
Figure 4. Figure 4: Average accuracy on AttackViz. Top: Results by model. Bottom: Results by misleader. Colors denote dataset and evaluation setting: PlotQA (Accuracy on correct charts, Accuracy on misleading charts), ChartQA (Accuracy on correct charts, Accuracy on misleading charts), an…
Figure 5
Figure 5. Figure 5: Average deception rate (DR) on AttackViz. [PITH_FULL_IMAGE:figures/full_fig_p007_5.png]
Figure 6
Figure 6. Figure 6: Average Macro F1-score of the eight code [PITH_FULL_IMAGE:figures/full_fig_p014_6.png]
Figure 7
Figure 7. Figure 7: Examples of vertical bar charts from AttackViz. Each example includes a correct and a misleading chart, [PITH_FULL_IMAGE:figures/full_fig_p019_7.png]
Figure 8
Figure 8. Figure 8: Examples of horizontal bar charts from AttackViz. Each example includes a correct and a misleading chart, [PITH_FULL_IMAGE:figures/full_fig_p020_8.png]
Figure 9
Figure 9. Figure 9: Examples of line charts from AttackViz. Each example includes a correct and a misleading chart, a [PITH_FULL_IMAGE:figures/full_fig_p021_9.png]
Figure 10
Figure 10. Figure 10: Task prompt for the Misleader-generator module of ChartAttack [PITH_FULL_IMAGE:figures/full_fig_p024_10.png]
Figure 11
Figure 11. Figure 11: shows performance drops across model families for horizontal bar, vertical bar, and line charts. Across all models, horizontal bar charts con￾sistently lead to the largest degradation, reaching 27.1 pp for Ovis-2.5 and 24.6 pp for InternVL-3.5. In contrast, vertical b…
Figure 12
Figure 12. Figure 12: Performance drops across model families and misleaders [PITH_FULL_IMAGE:figures/full_fig_p026_12.png]
Figure 13
Figure 13. Figure 13: Participant instructions for the human evalua [PITH_FULL_IMAGE:figures/full_fig_p026_13.png]
Figure 14
Figure 14. Figure 14: System-guard prompt for the Misleader￾generator module of ChartAttack. provide preliminary insights into the effectiveness of ChartAttack in deceiving human readers. G Mitigation strategies G.1 Prompt-based guard G.2 Fine-tuned MLLM on AttackViz We fine-tune Qwen2.5-V…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

9 extracted references · 5 linked inside Pith

  1. [5]

    Curran Asso- ciates, Inc

    Jailbroken: How does llm safety training fail? InAdvances in Neural Information Processing Sys- tems, volume 36, pages 80079–80110. Curran Asso- ciates, Inc. Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pier- ric Cistac, Tim Rault, Rémi Louf, Morgan Funtow- icz, and 1 others. 2019. Huggingface’s transformers: S...

  2. [6]

    Renqiu Xia, Hancheng Ye, Xiangchao Yan, Qi Liu, Hongbin Zhou, Zijun Chen, Botian Shi, Junchi Yan, and Bo Zhang

    Communicating health information with visual displays.Nature Medicine, 29(5):1085–1091. Renqiu Xia, Hancheng Ye, Xiangchao Yan, Qi Liu, Hongbin Zhou, Zijun Chen, Botian Shi, Junchi Yan, and Bo Zhang. 2025. Chartx and chartvlm: A ver- satile benchmark and foundation model for compli- cated chart reasoning.IEEE Transactions on Image Processing, 34:7436–7447...

  3. [7]

    Brenda W

    Qwen3 technical report.arXiv preprint arXiv:2505.09388. Brenda W. Yang, Camila Vargas Restrepo, Matthew L. Stanley, and Elizabeth J. Marsh. 2021. Truncat- ing bar graphs persistently misleads viewers.Jour- nal of Applied Research in Memory and Cognition, 10(2):298–311. Youliang Yuan, Wenxiang Jiao, Wenxuan Wang, Jen tse Huang, Pinjia He, Shuming Shi, and ...

  4. [8]

    InThe Twelfth International Conference on Learning Representations

    GPT-4 is too smart to be safe: Stealthy chat with LLMs via cipher. InThe Twelfth International Conference on Learning Representations. 12 Xingchen Zeng, Haichuan Lin, Yilin Ye, and Wei Zeng. 2025. Advancing multimodal large lan- guage models in chart question answering with visualization-referenced instruction tuning.IEEE Transactions on Visualization and...

  5. [1994]

    InText Retrieval Conference

    Okapi at trec-3. InText Retrieval Conference. Dorsaf Sallami, Yuan-Chen Chang, and Esma Aïmeur

  6. [2022]

    3D effect

    (see Table 1), and the prompt is therefore chart-type-specific, including only misleaders ap- plicable to the given chart type; the context is fur- ther defined by the dataset and retrieved examples, avoiding incompatible or ill-defined manipulations. The prompt also enforces minimal modifications, referring to changes only in the annotation fields strict...

  7. [2023]

    Leo Yu-Ho Lo, Ayush Gupta, Kento Shigyo, Aoyu Wu, Enrico Bertini, and Huamin Qu

    Why change my design: Explaining poorly constructed visualization designs with explorable ex- planations.IEEE Transactions on Visualization and Computer Graphics, 30(1):955–964. Leo Yu-Ho Lo, Ayush Gupta, Kento Shigyo, Aoyu Wu, Enrico Bertini, and Huamin Qu. 2022. Misinformed by visualization: What do we learn from misinfor- mative visualizations?Computer...

  8. [2024]

    Shuyu Shen, Sirong Lu, Leixian Shen, Zhonghua Sheng, Nan Tang, and Yuyu Luo

    From deception to detection: The dual roles of large language models in fake news.Preprint, arXiv:2409.17416. Shuyu Shen, Sirong Lu, Leixian Shen, Zhonghua Sheng, Nan Tang, and Yuyu Luo. 2024. Ask humans or ai? exploring their roles in visualization troubleshooting. Preprint, arXiv:2412.07673. Aivin V Solatorio. 2024. Gistembed: Guided in-sample selection...

Show all 9 references
  1. [2025]

    i came across a junk

    Automated pipeline for detecting and analyz- ing misleading visual elements. In2025 IEEE 18th Pacific Visualization Conference (PacificVis), pages 346–351. Xingyu Lan and Yu Liu. 2025. “i came across a junk”: Understanding design flaws of data visualization from the public’s p...

Pith tools

Reviewed August 3, 2026 · model on record in the stance chip above.