Pith. sign in

REVIEW 2 major objections 6 minor 242 references

VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?

T0 review · 2 major / 6 minor · reviewed 2026-08-15 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read The paper establishes visualization code editing from multimodal feedback as a distinct, measurable, mostly unsolved capability, with the best of 20 models at a 74.46% pass rate and a render-grounded agent adding 12.2 points over its base…

desk verdict A genuinely useful first benchmark for visualization code editing from multimodal feedback, but the headline numbers rest on an uncalibrated automatic judge; human checks confirm the direction of the agent gain, not its magnitude. read the letter →

arxiv 2608.10408 v1 pith:6EDVY5SV submitted 2026-08-11 cs.CL

Mizanur Rahman , Arshia Azimlu , Shadikur Rahman , Md Tahmid Rahman Laskar , Amran Bhuiyan , Shafiq Joty , Enamul Hoque Prince This is my paper · ORCID
classification cs.CL
keywords visualizationcodeeditingvision-languagemodelsmultimodalfeedbackbenchmarkchartrepairstyleadaptationrender-groundediterativerefinement
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Real-world visualization work is iterative—users fix broken charts and restyle them, not generate from scratch once—yet benchmarks have measured one-shot generation. The paper argues that editing existing visualization code from a rendered chart plus a natural-language instruction is a separate capability, and that current vision-language models are weak at it. To support the argument it contributes VisEditBench, 1,395 human-annotated repair and restyling tasks, plus zero-shot results for 20 models: Claude-4.6-Sonnet passes 74.46%, most open models fall below 50%, and visually grounded style adaptation is the hardest intent at 55.71%. It then shows VisEditAgent, a generate-render-validate-refine loop, raising GPT-4o from 55.75% to 67.99%, concluding that render-grounded feedback, not larger models alone, is the lever for faithful chart editing.

What carries the argument

The load-bearing object is VisEditBench's task tuple—input visualization code, a rendered chart that is either buggy/marked or a style reference, and a natural-language instruction—with an eight-intent taxonomy and a strict pass criterion requiring executability, task accuracy at least 4.5/5, readability and visual quality at least 4.0/5, and visual similarity at least 90/100. The mechanism that carries the argument is VisEditAgent's render-grounded loop: plan the edit, generate multiple candidate revisions, execute and render each candidate, visually validate candidates against the instruction and reference chart, select the best, then refine it using the validation feedback. That loop is what converts the idea that a model should see its own output into a measured gain.

What would settle it

Take a stratified sample of outputs the automatic judge marks pass and fail (including all style-adaptation cases), have human raters judge them by blind pairwise preference instead of the rubric, and recompute the 20-model ranking and the GPT-4o zero-shot versus VisEditAgent gap from the human labels alone. If the human gap is less than half of the reported 12.2 points, or if the human preference ordering differs on any model family, the central claim collapses. A cheaper version: rerun the full evaluation with the visual-similarity threshold raised from 90 to 95 and check whether any headline ranking changes.

Watch

Extended reading notes

Core claim

On the paper's own terms, the central discovery is that executing code is not the bottleneck in visualization editing—visual fidelity is. Top models render successfully on around 96% of VisEditBench tasks yet miss the strict fidelity bar on most of them, and the discrepancy is largest for style adaptation, where editing means matching a reference image's colors, layout, fonts, and encodings without changing the data's meaning. A second discovery is that a loop which renders candidate edits and validates them against the target image converts that visual gap into a usable training signal: VisEditAgent lifts GPT-4o's overall pass rate from 55.75% to 67.99%, with style adaptation jumping from 10.00% to 62.85%. The authors read this as evidence that visualization authoring should be treated as an iterative multimodal editing problem rather than a one-shot code-generation problem.

Load-bearing premise

The entire ranking and the reported agent gain rest on the automatic VLM judge's scores and hand-set thresholds matching what a human would accept as a faithful edited chart, and the paper's own human check shows only partial agreement (81% pass/fail agreement; Pearson correlations of 83.38–87.00).

Editorial extensions

If this is right

  • Executability alone cannot serve as a proxy for visualization skill; any benchmark or agent that stops at 'the code runs' will overstate capability.
  • Style adaptation and reference-guided restyling are the hardest intents, so progress claims should report them separately rather than as part of an aggregate pass rate.
  • Render-grounded iterative refinement improves editing across closed- and open-source base models, and ablations show both multi-candidate generation and refinement contribute, with the largest effect on style adaptation.
  • Because the benchmark's pass threshold is strict, scores near 50–70% mean the task is far from solved even for frontier models; claims of human-level chart editing would need to clear the same bar.
  • The eight-intent taxonomy gives future systems a target map: correctness repair and quality improvement are comparatively tractable, while style-aware repair and transformation remain open.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Extension beyond the paper: since human–automatic pass/fail agreement is 81%, an independent blind pairwise human-preference study could reveal whether the rubric over-rewards clean-but-generic charts, which would affect the reported 12.2-point agent gain.
  • Extension: VisEditBench covers Matplotlib and Vega-Lite only; porting a stratified subset to Plotly or D3 would show whether render-grounded validation transfers across imperative and declarative ecosystems.
  • Extension: manipulating rendering resolution inside VisEditAgent would isolate the active ingredient—if coarse rendering shrinks the gain, visual detail, not candidate count or planning, is what matters.
  • Extension: the taxonomy invites a targeted test—retrieving a visually similar solved edit should help style adaptation and transformation more than correctness repair, since the latter already names the fix in text.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 6 minor

Summary. The paper introduces VisEditBench, a benchmark of 1,395 human-annotated visualization code-editing tasks designed to test whether vision-language models can revise existing visualization code from multimodal feedback. It covers two settings (feedback-guided repair and reference-guided restyling), defines an eight-intent taxonomy, evaluates 20 VLMs in a zero-shot setting, and proposes VisEditAgent, a render-validate-refine framework. The headline results are that Claude-4.6-Sonnet achieves the best overall pass rate of 74.46%, most open-source models remain below 50%, and VisEditAgent improves GPT-4o's pass rate from 55.75% to 67.99%. Human validation on 2,790 outputs shows moderate-to-strong agreement with the automatic judge but reveals a systematic leniency bias in the automatic pass rates.

Significance. VisEditBench addresses a genuine gap: iterative visualization editing from multimodal feedback is underexplored relative to one-shot chart generation and chart-to-code reconstruction. The paper has notable strengths, including a careful annotation pipeline with dual annotation and cross-review (84.65% agreement), a substantial human-validation effort, a structured evaluation rubric, and a plan to release the benchmark. If the evaluation calibration issues are resolved, the benchmark would be a valuable resource for studying grounded multimodal code editing. VisEditAgent is a sensible and clearly described baseline that demonstrates the potential of render-grounded refinement, although its quantitative gains currently depend on an uncalibrated automatic judge.

major comments (2)
  1. [Section 5.1, Tables 7–8] The automatic judge is systematically more lenient than human raters, and the leniency is condition-dependent: for GPT-4o zero-shot the automatic pass rate is 55.75% versus 51.70% human, while for GPT-4o+VisEditAgent it is 67.99% versus 59.10% human. As a result, the reported agent gain (+12.24 points) exceeds the human-measured gain (+7.40 points), so the abstract's headline improvement from 55.75% to 67.99% is not robust to judge calibration. The paper should report human-calibrated pass rates (or apply a calibration transform) for the main comparisons, include confidence intervals, and perform a threshold-sensitivity analysis over the final pass thresholds (task accuracy ≥ 4.5, readability/clarity ≥ 4.0, visual quality ≥ 4.0, visual similarity ≥ 90) to verify that the ranking and the agent gain are stable.
  2. [Section 5.2.2, Table 8] Human validation covers only two of the twenty evaluated models: GPT-4o on all 1,395 tasks and Qwen3-VL-4B on a 500-example subset. The claim that Claude-4.6-Sonnet is the best model at 74.46% pass rate, and the comparisons among the other seventeen models, rest entirely on the automatic judge, whose calibration for those models is unknown. At minimum, human spot-checks on the top-scoring model and on a few open-source models should be reported, or the paper should explicitly qualify the ranking as automatic-judge-based until calibration evidence is provided.
minor comments (6)
  1. [Table 1] The editing-intent counts sum to 1,384, not the stated 1,395; either an 'Other' intent is missing or the counts/percentages need correction.
  2. [Table 8] Pearson correlations are reported as 83.38, 87.00, etc., which reads as percentages; standard notation would be r = 0.8338 and r = 0.8700 to avoid ambiguity.
  3. [Section 3.1] Since 1,275 of the 1,395 tasks derive from model-generated failures on Text2Vis rather than naturally occurring user edit requests, the paper should briefly discuss how this source distribution affects the realism and difficulty representativeness of the benchmark.
  4. [Section 3.3] The difficulty labels are assigned by GPT-5, which sits uneasily with the statement in the Ethical Considerations that LLM assistance was used only for language editing and polishing; the role of the LLM in difficulty labeling should be stated more prominently.
  5. [Abstract] The phrase 'most open-source models remain below 50%' is accurate, but since Qwen3-VL-32B achieves 51.72%, naming the exception would improve precision.
  6. [Section 5.2.2] The sentence reporting Pearson correlations should present them as decimal coefficients (0.8338–0.8700) and should separate the 81% pass/fail agreement from the correlation figures.

Circularity Check

0 steps flagged · score 0.0 of 10

No circular derivation: benchmark measurements and agent gains are empirical, not fitted outcomes.

full rationale

VisEditBench is an empirical benchmark, not a derivation. The headline numbers (pass rates of 20 VLMs; VisEditAgent 55.75→67.99) are measurements produced by a rubric-based VLM judge that is explicitly cross-checked against human annotations (Tables 7–8), and no model parameter is fitted to the test set and then renamed as a prediction. The agent improvement is not tautological: even though VisEditAgent uses render-and-validate feedback, the final pass criterion requires executable, instruction-faithful, readable, high-quality, and visually similar output, and the GPT-4o-based agent is evaluated with Gemini 2.5 Pro for GPT-4o outputs; for other base models, the gain is an empirical comparison. The only notable self-reference is the use of the same group's Text2Vis benchmark as a seed source for model-failure cases; this is a data-collection choice, and the resulting tasks were manually annotated, cross-reviewed, and independently human-evaluated, so the benchmark's difficulty does not reduce to the source benchmark. The reported gap between automatic and human pass rates (Tables 4 vs 7) is a calibration/validity limitation, not a circular step: it concerns measurement accuracy, not an argument whose conclusion is identical to its premise. No equation or definition in the paper makes the evaluated quantity equivalent to an input by construction.

Assumptions & free parameters 1 free parameters · 4 assumptions · 0 invented entities

The paper introduces no physical entities, no fitted constants, and no derivation. Its load-bearing choices are methodological: (1) hand-set final pass thresholds that define every headline pass rate with no sensitivity analysis; (2) a VLM judge assumed to measure visual fidelity faithfully, despite partial human agreement; (3) an annotation screen assumed to guarantee every retained task has a feasible code-level solution; and (4) a data source that is mostly model-generated failures from the authors' own Text2Vis benchmark, with realism asserted rather than user-verified.

free parameters (1)
  • Final pass thresholds = task accuracy >= 4.5; readability and clarity >= 4.0; visual quality >= 4.0; visual similarity >= 90
    Hand-chosen cutoffs in Section 5.1 that define a 'pass'. Every headline pass rate in Tables 2-5 and the claimed VisEditAgent improvement depend directly on these thresholds; no sensitivity analysis is reported, so a small change in the visual similarity cutoff (>= 90) changes many headline numbers.
assumptions (4)
  • domain assumption A VLM judge with a fixed rubric measures visualization editing quality faithfully across models.
    Section 5.1: all non-executability metrics come from GPT-4o (or Gemini 2.5 Pro for GPT-4o outputs). Human agreement is partial: Pearson 83.38 to 87.00 and 81% pass/fail agreement (Table 8), and automatic pass rates exceed human pass rates by 4.0 to 8.9 points on the same GPT-4o samples (Tables 4 vs 7).
  • domain assumption Each retained task has an observable visual target and a feasible code-level solution, as judged by annotator cross-review.
    Section 3.2: candidates were removed when reviewers judged them ambiguous, underspecified, or not clearly solvable; no check of solution uniqueness or of whether the annotators' reference solution is optimal is reported.
  • domain assumption Model-generated failures from Text2Vis reruns represent realistic user editing needs.
    Section 3.1: most tasks derive from charts that frontier and open models generated on Text2Vis queries and that annotators deemed flawed; realism is asserted from failed generation rather than demonstrated from user editing behavior.
  • domain assumption Difficulty labels (Easy/Medium/Hard) assigned by GPT-5 under a rubric and human-reviewed are valid.
    Section 3.3 and Figure 7: GPT-5 assigned difficulty labels under a rubric with human review; the labels feed diversity statistics but not the scoring, so their impact on headline results is indirect.

how reviews work

0 comments
Cite this review

Pith. "Pith review of VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?." pith.science (2026). https://pith.science/paper/6EDVY5SV

@misc{pith2026260810408,
  author       = {Pith},
  title        = {Pith review of: VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/6EDVY5SV}},
  note         = {Machine review of arXiv:2608.10408}
}
read the original abstract

Vision-language models (VLMs) have shown strong capabilities in generating visualization code from textual or visual specifications. However, real-world visualization authoring is inherently iterative: users frequently revise existing visualizations to repair flawed charts or adapt them to desired styles. Existing benchmarks primarily evaluate generation from scratch, leaving visualization code editing from multimodal feedback largely unexplored. We introduce VisEditBench, a benchmark of 1,395 human-annotated visualization code-editing tasks grounded in realistic visualization workflows and failure cases. VisEditBench covers two practical settings: feedback-guided repair, where models revise visualization code using buggy or marked charts together with textual feedback, and reference-guided restyling, where models modify code to match a target chart image. Evaluating 20 state-of-the-art VLMs reveals that visualization code editing remains challenging: Claude-4.6-Sonnet achieves the best overall pass rate of 74.46%, while most open-source models remain below 50%. Performance is particularly weak on visually grounded style adaptation, where Claude-4.6-Sonnet achieves only 55.71%. To establish a strong baseline, we further propose VisEditAgent, a render-grounded editing framework that iteratively generates, executes, validates, and refines candidate edits. Built on GPT-4o, VisEditAgent improves overall pass rate from 55.75% to 67.99%, demonstrating the importance of render-grounded feedback for faithful visualization editing. We will release VisEditBench at https://github.com/vis-nlp/VisEditBench.

Figures

Figures reproduced from arXiv: 2608.10408 by the authors.

Figure 1
Figure 1. Overview of a VisEditBench task. Given visu [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Overview of the VisEditBench construction pipeline. We collect real visualization issues and real-world [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 3
Figure 3. Examples from VisEditBench across eight editing intents. Each task pairs input visualization code with a [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (4 more)
Figure 4
Figure 4. Figure 4: VisEditAgent framework. Given visualization code, a buggy, human-marked, or reference chart image, an instruction, and an edit intent, VisEditAgent plans the edit, generates candidate revisions, executes and renders them, validates the outputs, selects the best candida…
Figure 5
Figure 5. Figure 5: Qualitative example comparing GPT-4o zero-shot with GPT-4o + VisEditAgent. The original chart [PITH_FULL_IMAGE:figures/full_fig_p013_5.png]
Figure 6
Figure 6. Figure 6: Error analysis examples showing that models often produce executable and visually plausible charts [PITH_FULL_IMAGE:figures/full_fig_p014_6.png]
Figure 7
Figure 7. Figure 7: Prompt used for difficulty classification. GPT-5 was used to classify each VisEditBench example as Easy, [PITH_FULL_IMAGE:figures/full_fig_p016_7.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

242 extracted references · 12 canonical work pages

  1. [1]

    Attention is All you Need , url =

    Vaswani, Ashish and Shazeer, Noam and Parmar, Niki and Uszkoreit, Jakob and Jones, Llion and Gomez, Aidan N and Kaiser, ukasz and Polosukhin, Illia , booktitle =. Attention is All you Need , url =

  2. [2]

    2014 , edition =

    Visualization Analysis and Design , author =. 2014 , edition =. doi:10.1201/b17511 , url =

    doi:10.1201/b17511 2014

  3. [3]

    IEEE transactions on visualization and computer graphics , volume=

    Converting basic D3 charts into reusable style templates , author=. IEEE transactions on visualization and computer graphics , volume=. 2017 , publisher=

    2017

  4. [4]

    DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence , journal =

    DeepSeek. DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence , journal =. 2024 , url =. doi:10.48550/ARXIV.2406.11931 , eprinttype =. 2406.11931 , timestamp =

    arXiv doi:10.48550/arxiv.2406.11931 2024

  5. [5]

    arXiv preprint arXiv:2302.06476 , year=

    Is ChatGPT a general-purpose natural language processing task solver? , author=. arXiv preprint arXiv:2302.06476 , year=

    arXiv

  6. [6]

    Language Models are Few-Shot Learners , url =

    Brown, Tom and Mann, Benjamin and Ryder, Nick and Subbiah, Melanie and Kaplan, Jared D and Dhariwal, Prafulla and Neelakantan, Arvind and Shyam, Pranav and Sastry, Girish and Askell, Amanda and Agarwal, Sandhini and Herbert-Voss, Ariel and Krueger, Gretchen and Henighan, Tom and Child, Rewon and Ramesh, Aditya and Ziegler, Daniel and Wu, Jeffrey and Winte...

  7. [7]

    Transactions of the Association for Computational Linguistics , volume =

    Lewis, Patrick and Wu, Yuxiang and Liu, Linqing and Minervini, Pasquale and Küttler, Heinrich and Piktus, Aleksandra and Stenetorp, Pontus and Riedel, Sebastian , title = ". Transactions of the Association for Computational Linguistics , volume =. 2021 , month =. doi:10.1162/tacl_a_00415 , url =

    doi:10.1162/tacl_a_00415 2021

  8. [8]

    EDA : Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks

    Wei, Jason and Zou, Kai. EDA : Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019. doi:10.18653/v1/D19-1670

    doi:10.18653/v1/d19-1670 2019

Show all 242 references
  1. [9]

    International Conference on Learning Representations , year=

    Analysing Mathematical Reasoning Abilities of Neural Models , author=. International Conference on Learning Representations , year=

  2. [10]

    Injecting Numerical Reasoning Skills into Language Models

    Geva, Mor and Gupta, Ankit and Berant, Jonathan. Injecting Numerical Reasoning Skills into Language Models. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 2020. doi:10.18653/v1/2020.acl-main.89

    2020 doi

  3. [11]

    L ogic2 T ext: High-Fidelity Natural Language Generation from Logical Forms

    Chen, Zhiyu and Chen, Wenhu and Zha, Hanwen and Zhou, Xiyou and Zhang, Yunkai and Sundaresan, Sairam and Wang, William Yang. L ogic2 T ext: High-Fidelity Natural Language Generation from Logical Forms. Findings of the Association for Computational Linguistics: EMNLP 2020. 2020...

    2020 doi

  4. [12]

    BART : Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension

    Lewis, Mike and Liu, Yinhan and Goyal, Naman and Ghazvininejad, Marjan and Mohamed, Abdelrahman and Levy, Omer and Stoyanov, Veselin and Zettlemoyer, Luke. BART : Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. Proce...

    2020 doi

  5. [13]

    A Call for Clarity in Reporting BLEU Scores

    Post, Matt. A Call for Clarity in Reporting BLEU Scores. Proceedings of the Third Conference on Machine Translation: Research Papers. 2018

    2018

  6. [14]

    Aho and Jeffrey D

    Alfred V. Aho and Jeffrey D. Ullman , title =. 1972

    1972

  7. [15]

    Liu , title =

    Colin Raffel and Noam Shazeer and Adam Roberts and Katherine Lee and Sharan Narang and Michael Matena and Yanqi Zhou and Wei Li and Peter J. Liu , title =. Journal of Machine Learning Research , year =

  8. [16]

    Journal of Statistics Education , volume =

    Whitaker, Douglas and Jacobbe, Tim , title =. Journal of Statistics Education , volume =. 2017 , type =

    2017

  9. [17]

    Irish Educational Studies , volume =

    Pérez-Echeverría, Mª del Puy and Postigo, Yolanda and Marín, Cristina , title =. Irish Educational Studies , volume =. 2018 , type =

    2018

  10. [18]

    2019 , journal=

    Language Models are Unsupervised Multitask Learners , author=. 2019 , journal=

    2019

  11. [19]

    Proceedings of the 13th International Conference on Natural Language Generation , publisher =

    Obeid, Jason and Hoque, Enamul , title =. Proceedings of the 13th International Conference on Natural Language Generation , publisher =. 2020 , url =

    2020

  12. [20]

    2021 , type =

    Towards Understanding How Readers Integrate Charts and Captions: A Case Study with Line Charts , booktitle =. 2021 , type =

    2021

  13. [21]

    and Choudhury, Sagnik Ray and Giles, C

    Al-Zaidy, Rabah A. and Choudhury, Sagnik Ray and Giles, C. Lee , title =. AAAI Workshop: Scholarly Big Data , url =. 2016 , type =

    2016

  14. [22]

    Publications Manual , year = "1983", publisher =

    1983

  15. [23]

    Chandra and Dexter C

    Ashok K. Chandra and Dexter C. Kozen and Larry J. Stockmeyer , year = "1981", title =. doi:10.1145/322234.322243

    1981

  16. [24]

    Scalable training of

    Andrew, Galen and Gao, Jianfeng , booktitle=. Scalable training of

  17. [25]

    Dan Gusfield , title =. 1997

    1997

  18. [26]

    Tetreault , title =

    Mohammad Sadegh Rasooli and Joel R. Tetreault , title =. Computing Research Repository , volume =. 2015 , url =

    2015

  19. [27]

    A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data , Volume =

    Ando, Rie Kubota and Zhang, Tong , Issn =. A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data , Volume =. Journal of Machine Learning Research , Month = dec, Numpages =

  20. [28]

    Proceedings of the IEEE International Conference on Computer Vision , pages=

    nocaps: novel object captioning at scale , author=. Proceedings of the IEEE International Conference on Computer Vision , pages=

  21. [29]

    2015 , eprint=

    Microsoft COCO Captions: Data Collection and Evaluation Server , author=. 2015 , eprint=

    2015

  22. [30]

    ECCV 2020 , year=

    Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks , author=. ECCV 2020 , year=

    2020

  23. [31]

    2019 , eprint=

    VisualBERT: A Simple and Performant Baseline for Vision and Language , author=. 2019 , eprint=

    2019

  24. [32]

    Lawrence Zitnick and Devi Parikh , title =

    Stanislaw Antol and Aishwarya Agrawal and Jiasen Lu and Margaret Mitchell and Dhruv Batra and C. Lawrence Zitnick and Devi Parikh , title =. International Conference on Computer Vision (ICCV) , year =

  25. [33]

    The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , month =

    Zellers, Rowan and Bisk, Yonatan and Farhadi, Ali and Choi, Yejin , title =. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , month =

  26. [34]

    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages=

    Towards VQA Models That Can Read , author=. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages=

  27. [35]

    2020 , eprint=

    TextCaps: a Dataset for Image Captioning with Reading Comprehension , author=. 2020 , eprint=

    2020

  28. [36]

    arXiv preprint arXiv:2004.04696 , year=

    BLEURT: Learning robust metrics for text generation , author=. arXiv preprint arXiv:2004.04696 , year=

    2004 arXiv

  29. [37]

    Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

    Cider: Consensus-based image description evaluation , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

  30. [38]

    arXiv preprint arXiv:1910.12840 , year=

    Evaluating the factual consistency of abstractive text summarization , author=. arXiv preprint arXiv:1910.12840 , year=

    1910 arXiv

  31. [39]

    , volume=

    Measuring nominal scale agreement among many raters. , volume=. Psychological Bulletin , author=. 1971 , pages=. doi:10.1037/h0031619 , number=

    1971 doi

  32. [40]

    Enhanced Transformer Model for Data-to-Text Generation

    Gong, Li and Crego, Josep and Senellart, Jean. Enhanced Transformer Model for Data-to-Text Generation. Proceedings of the 3rd Workshop on Neural Generation and Translation. 2019. doi:10.18653/v1/D19-5615

    2019 doi

  33. [41]

    Logic2Text: High-Fidelity Natural Language Generation from Logical Forms , author=

  34. [42]

    Logical Natural Language Generation from Open-Domain Tables

    Chen, Wenhu and Chen, Jianshu and Su, Yu and Chen, Zhiyu and Wang, William Yang. Logical Natural Language Generation from Open-Domain Tables. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 2020. doi:10.18653/v1/2020.acl-main.708

    2020 doi

  35. [43]

    arXiv preprint arXiv:1603.07771 , year=

    Neural text generation from structured data with application to the biography domain , author=. arXiv preprint arXiv:1603.07771 , year=

    arXiv

  36. [44]

    Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

    Deep residual learning for image recognition , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

  37. [45]

    arXiv preprint arXiv:1502.03044 , year=

    Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , author=. arXiv preprint arXiv:1502.03044 , year=

    arXiv

  38. [46]

    Long Short-Term Memory , year =

    Hochreiter, Sepp and Schmidhuber, J\". Long Short-Term Memory , year =. Neural Comput. , month = nov, pages =. doi:10.1162/neco.1997.9.8.1735 , abstract =

    1997 doi

  39. [47]

    arXiv preprint arXiv:2103.03230 , year=

    Barlow Twins: Self-Supervised Learning via Redundancy Reduction , author=. arXiv preprint arXiv:2103.03230 , year=

    arXiv

  40. [48]

    International Conference on Computer Vision (ICCV) , year=

    What Is Wrong With Scene Text Recognition Model Comparisons? Dataset and Model Analysis , author=. International Conference on Computer Vision (ICCV) , year=

  41. [49]

    Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing , year=

    LXMERT: Learning Cross-Modality Encoder Representations from Transformers , author=. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing , year=

    2019

  42. [50]

    ImageNet: A large-scale hierarchical image database , year=

    Deng, Jia and Dong, Wei and Socher, Richard and Li, Li-Jia and Kai Li and Li Fei-Fei , booktitle=. ImageNet: A large-scale hierarchical image database , year=

  43. [51]

    Computer Graphics Forum , year=

    Visualizing for the Non‐Visual: Enabling the Visually Impaired to Use Visualization , author=. Computer Graphics Forum , year=

  44. [52]

    Proceedings of the 3rd Workshop on Neural Generation and Translation , pages=

    Enhanced Transformer Model for Data-to-Text Generation , author=. Proceedings of the 3rd Workshop on Neural Generation and Translation , pages=

  45. [53]

    Advances in neural information processing systems , pages=

    Attention is all you need , author=. Advances in neural information processing systems , pages=

  46. [54]

    Proceedings of the AAAI Conference on Artificial Intelligence , volume=

    Data-to-text generation with content selection and planning , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=

  47. [55]

    arXiv preprint arXiv:1906.03221 , year=

    Data-to-text generation with entity modeling , author=. arXiv preprint arXiv:1906.03221 , year=

    1906 arXiv

  48. [56]

    arXiv preprint arXiv:1509.00838 , year=

    What to talk about and how? selective generation using lstms with coarse-to-fine alignment , author=. arXiv preprint arXiv:1509.00838 , year=

    arXiv

  49. [57]

    CoRR , volume =

    Zichao Yang and Phil Blunsom and Chris Dyer and Wang Ling , title =. CoRR , volume =. 2016 , url =

    2016

  50. [58]

    Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems , pages=

    Answering Questions about Charts and Generating Visual Explanations , author=. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems , pages=

    2020

  51. [59]

    Narrative science , author =

  52. [60]

    arXiv preprint arXiv:1710.07300 , year=

    Figureqa: An annotated figure dataset for visual reasoning , author=. arXiv preprint arXiv:1710.07300 , year=

    arXiv

  53. [61]

    Information Visualization , volume=

    Datasite: Proactive visual data exploration with computation of insight-based recommendations , author=. Information Visualization , volume=. 2019 , publisher=

    2019

  54. [62]

    and Moore, Johanna D

    Mittal, Vibhu O. and Moore, Johanna D. and Carenini, Giuseppe and Roth, Steven. Describing Complex Charts in Natural Language: A Caption Generation System. Computational Linguistics. 1998

    1998

  55. [63]

    Knowledge and Information Systems , year=

    Intentions in the Coordinated Generation of Graphics and Text from Tabular Data , author=. Knowledge and Information Systems , year=

  56. [64]

    Summarizing Information Graphics Textually

    Demir, Seniz and Carberry, Sandra and McCoy, Kathleen F. Summarizing Information Graphics Textually. Computational Linguistics. 2012. doi:10.1162/COLI_a_00091

    2012 doi

  57. [65]

    Rossi and Razvan C

    Charles Chen and Ruiyi Zhang and Eunyee Koh and Sungchul Kim and Scott Cohen and Tong Yu and Ryan A. Rossi and Razvan C. Bunescu , title =. CoRR , volume =. 2019 , url =

    2019

  58. [66]

    Neural Text Generation from Structured Data with Application to the Biography Domain

    Lebret, R \'e mi and Grangier, David and Auli, Michael. Neural Text Generation from Structured Data with Application to the Biography Domain. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. 2016. doi:10.18653/v1/D16-1128

    2016 doi

  59. [67]

    Walter , title =

    Hongyuan Mei and Mohit Bansal and Matthew R. Walter , title =. CoRR , volume =. 2015 , url =

    2015

  60. [68]

    Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP , pages=

    Learning semantic correspondences with less supervision , author=. Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP , pages=

  61. [69]

    Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing , pages=

    Reference-Aware Language Models , author=. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing , pages=

    2017

  62. [70]

    Artificial Intelligence , volume=

    Choosing words in computer-generated weather forecasts , author=. Artificial Intelligence , volume=. 2005 , publisher=

    2005

  63. [71]

    Collective Content Selection for Concept-to-Text Generation

    Barzilay, Regina and Lapata, Mirella. Collective Content Selection for Concept-to-Text Generation. Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing. 2005

    2005

  64. [72]

    IEEE transactions on visualization and computer graphics , volume=

    Augmenting visualizations with interactive data facts to facilitate interpretation and communication , author=. IEEE transactions on visualization and computer graphics , volume=. 2018 , publisher=

    2018

  65. [73]

    IEEE transactions on visualization and computer graphics , volume=

    Text-to-viz: Automatic generation of infographics from proportion-related natural language statements , author=. IEEE transactions on visualization and computer graphics , volume=. 2019 , publisher=

    2019

  66. [74]

    IEEE transactions on visualization and computer graphics , volume=

    Towards Automated Infographic Design: Deep Learning-based Auto-Extraction of Extensible Timeline , author=. IEEE transactions on visualization and computer graphics , volume=. 2019 , publisher=

    2019

  67. [75]

    IEEE transactions on visualization and computer graphics , volume=

    DataShot: Automatic Generation of Fact Sheets from Tabular Data , author=. IEEE transactions on visualization and computer graphics , volume=. 2019 , publisher=

    2019

  68. [76]

    Use BERT to Fill in the Blanks , author =

  69. [77]

    Applying Pragmatics Principles for Interaction with Visual Analytics , year =

    Enamul Hoque and Vidya Setlur and Melanie Tory and Isaac Dykeman , journal =. Applying Pragmatics Principles for Interaction with Visual Analytics , year =

  70. [79]

    2013 , issue_date =

    Ferres, Leo and Lindgaard, Gitte and Sumegi, Livia and Tsuji, Bruce , title =. 2013 , issue_date =. doi:10.1145/2533682.2533683 , journal =

    2013

  71. [80]

    Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval , pages=

    Information graphics: an untapped resource for digital libraries , author=. Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval , pages=

  72. [81]

    , author=

    User Task Adaptation in Multimedia Presentations. , author=. Proceedings of the 1st International Workshop on User-Adaptive Information Visualization in conjunction with the 21st conference on User Modeling, Adaptation and Personalization (UMAP) , year=

  73. [82]

    Proceedings of the Eleventh European Workshop on Natural Language Generation , pages=

    An architecture for data-to-text systems , author=. Proceedings of the Eleventh European Workshop on Natural Language Generation , pages=. 2007 , organization=

    2007

  74. [83]

    International Journal of Human-Computer Studies , volume=

    Autobrief: an experimental system for the automatic generation of briefings in integrated text and information graphics , author=. International Journal of Human-Computer Studies , volume=. 2004 , publisher=

    2004

  75. [84]

    Eighth International Natural Language Generation Workshop , year=

    Postgraphe: a system for the generation of statistical graphics and text , author=. Eighth International Natural Language Generation Workshop , year=

  76. [85]

    ACM Transactions on Computer-Human Interaction (TOCHI) , volume=

    Evaluating a tool for improving accessibility to charts and graphs , author=. ACM Transactions on Computer-Human Interaction (TOCHI) , volume=. 2013 , publisher=

    2013

  77. [86]

    Proceedings of NAACL-HLT , pages=

    What to talk about and how? Selective Generation using LSTMs with Coarse-to-Fine Alignment , author=. Proceedings of NAACL-HLT , pages=

  78. [87]

    Proceedings of the 40th annual meeting of the Association for Computational Linguistics , pages=

    BLEU: a method for automatic evaluation of machine translation , author=. Proceedings of the 40th annual meeting of the Association for Computational Linguistics , pages=

  79. [88]

    CoRR , volume =

    Dan Hendrycks and Kevin Gimpel , title =. CoRR , volume =. 2016 , url =

    2016

  80. [89]

    and Surdeanu, Mihai and Bauer, John and Finkel, Jenny and Bethard, Steven J

    Manning, Christopher D. and Surdeanu, Mihai and Bauer, John and Finkel, Jenny and Bethard, Steven J. and McClosky, David , title =. Association for Computational Linguistics (ACL) System Demonstrations , year =

  81. [90]

    Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval , pages=

    Towards retrieving relevant information graphics , author=. Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval , pages=

  82. [91]

    Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , pages=

    ToTTo: A Controlled Table-To-Text Generation Dataset , author=. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , pages=

    2020

  83. [92]

    2020 , isbn =

    Spreafico, Andrea and Carenini, Giuseppe , title =. 2020 , isbn =. doi:10.1145/3399715.3399829 , booktitle =

    2020

  84. [93]

    2021 , booktitle =

    Anonymous , title =. 2021 , booktitle =

    2021

  85. [94]

    arXiv preprint arXiv:1707.08052 , year=

    Challenges in data-to-document generation , author=. arXiv preprint arXiv:1707.08052 , year=

    arXiv

  86. [95]

    2021 IEEE Winter Conference on Applications of Computer Vision (WACV) , year=

    ChartOCR: Data Extraction from Charts Images via a Deep Hybrid Framework , author=. 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) , year=

    2021

  87. [96]

    Proceedings of the 24th annual ACM symposium on User interface software and technology , year=

    ReVision: automated classification, analysis and redesign of chart images , author=. Proceedings of the 24th annual ACM symposium on User interface software and technology , year=

  88. [97]

    Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems , year=

    ChartSense: Interactive Data Extraction from Chart Images , author=. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems , year=

    2017

  89. [98]

    CVPR 2021 , year=

    VinVL: Making Visual Representations Matter in Vision-Language Models , author=. CVPR 2021 , year=

    2021

  90. [99]

    T a P as: Weakly Supervised Table Parsing via Pre-training

    Herzig, Jonathan and Nowak, Pawel Krzysztof and M. T a P as: Weakly Supervised Table Parsing via Pre-training. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 2020. doi:10.18653/v1/2020.acl-main.398

    2020 doi

  91. [100]

    STL-CQA : Structure-based Transformers with Localization and Encoding for Chart Question Answering

    Singh, Hrituraj and Shekhar, Sumit. STL-CQA : Structure-based Transformers with Localization and Encoding for Chart Question Answering. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2020. doi:10.18653/v1/2020.emnlp-main.264

    2020 doi

  92. [101]

    Price and Scott Cohen and Christopher Kanan , title =

    Kushal Kafle and Robik Shrestha and Brian L. Price and Scott Cohen and Christopher Kanan , title =. CoRR , volume =. 2019 , url =

    2019

  93. [102]

    FigureQA: An Annotated Figure Dataset for Visual Reasoning , journal =

    Samira Ebrahimi Kahou and Adam Atkinson and Vincent Michalski and. FigureQA: An Annotated Figure Dataset for Visual Reasoning , journal =. 2017 , url =

    2017

  94. [103]

    2020 IEEE Winter Conference on Applications of Computer Vision (WACV) , title=

    R. 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) , title=. 2020 , volume=

    2020

  95. [104]

    Price and Christopher Kanan , title =

    Kushal Kafle and Scott Cohen and Brian L. Price and Christopher Kanan , title =. CoRR , volume =. 2018 , url =

    2018

  96. [105]

    and Kumar, Pratyush , title =

    Methani, Nitesh and Ganguly, Pritha and Khapra, Mitesh M. and Kumar, Pratyush , title =. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) , month =

  97. [106]

    Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems , pages =

    Kim, Dae Hyun and Hoque, Enamul and Agrawala, Maneesh , title =. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems , pages =. 2020 , isbn =. doi:10.1145/3313831.3376467 , abstract =

    2020

  98. [107]

    Proceedings of the CHI Conference on Human Factors in Computing Systems , pages=

    Towards Understanding How Readers Integrate Charts and Captions: A Case Study with Line Charts , author=. Proceedings of the CHI Conference on Human Factors in Computing Systems , pages=

  99. [108]

    IEEE Transactions on Visualization and Computer Graphics , title=

    Enamul. IEEE Transactions on Visualization and Computer Graphics , title=. 2018 , volume=

    2018

  100. [109]

    Compositional Semantic Parsing on Semi-Structured Tables , author =. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) , month = jul, year =....

    doi

  101. [110]

    Adam Santoro and David Raposo and David G. T. Barrett and Mateusz Malinowski and Razvan Pascanu and Peter W. Battaglia and Timothy P. Lillicrap , title =. CoRR , volume =. 2017 , url =

    2017

  102. [111]

    Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , url =

    Ren, Shaoqing and He, Kaiming and Girshick, Ross and Sun, Jian , booktitle =. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , url =

  103. [112]

    Ninth International Conference on Document Analysis and Recognition (ICDAR 2007) , title=

    R. Ninth International Conference on Document Analysis and Recognition (ICDAR 2007) , title=. 2007 , volume=

    2007

  104. [113]

    BERT : Pre-training of Deep Bidirectional Transformers for Language Understanding

    Devlin, Jacob and Chang, Ming-Wei and Lee, Kenton and Toutanova, Kristina. BERT : Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North A merican Chapter of the Association for Computational Linguistics: Hum...

    2019 doi

  105. [114]

    , citeulike-article-id =

    Bradski, G. , citeulike-article-id =. Dr. Dobb's Journal of Software Tools , keywords =

  106. [115]

    International Conference on Learning Representations , year=

    TabFact: A Large-scale Dataset for Table-based Fact Verification , author=. International Conference on Learning Representations , year=

  107. [116]

    Understanding tables with intermediate pre-training

    Eisenschlos, Julian and Krichene, Syrine and M. Understanding tables with intermediate pre-training. Findings of the Association for Computational Linguistics: EMNLP 2020. 2020. doi:10.18653/v1/2020.findings-emnlp.27

    2020 doi

  108. [117]

    Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems , pages =

    Jung, Daekyoung and Kim, Wonjae and Song, Hyunjoo and Hwang, Jeong-in and Lee, Bongshin and Kim, Bohyoung and Seo, Jinwook , title =. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems , pages =. 2017 , isbn =

    2017

  109. [118]

    ICML , year =

    Unifying Vision-and-Language Tasks via Text Generation , author =. ICML , year =

  110. [119]

    International Conference on Learning Representations , year=

    An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , author=. International Conference on Learning Representations , year=

  111. [120]

    Mask R-CNN , year=

    He, Kaiming and Gkioxari, Georgia and Dollár, Piotr and Girshick, Ross , booktitle=. Mask R-CNN , year=

  112. [121]

    arXiv preprint arXiv:2104.00369 , year=

    FeTaQA: Free-form Table Question Answering , author=. arXiv preprint arXiv:2104.00369 , year=

    arXiv

  113. [122]

    Girshick and Jian Sun , title =

    Shaoqing Ren and Kaiming He and Ross B. Girshick and Jian Sun , title =. CoRR , volume =. 2015 , url =. 1506.01497 , timestamp =

    2015 arXiv

  114. [123]

    Gomez and Lukasz Kaiser and Illia Polosukhin , title =

    Ashish Vaswani and Noam Shazeer and Niki Parmar and Jakob Uszkoreit and Llion Jones and Aidan N. Gomez and Lukasz Kaiser and Illia Polosukhin , title =. CoRR , volume =. 2017 , url =. 1706.03762 , timestamp =

    2017 arXiv

  115. [124]

    HuggingFace's Transformers: State-of-the-art Natural Language Processing , journal =

    Thomas Wolf and Lysandre Debut and Victor Sanh and Julien Chaumond and Clement Delangue and Anthony Moi and Pierric Cistac and Tim Rault and R. HuggingFace's Transformers: State-of-the-art Natural Language Processing , journal =. 2019 , url =. 1910.03771 , timestamp =

    2019 arXiv

  116. [125]

    Yuxin Wu and Alexander Kirillov and Francisco Massa and Wan-Yen Lo and Ross Girshick , title =

  117. [126]

    Microsoft

    Tsung. Microsoft. CoRR , volume =. 2014 , url =. 1405.0312 , timestamp =

    2014 arXiv

  118. [127]

    Integrating Image Data Extraction and Table Parsing Methods for Chart Question answering , year =

    Ahmed Masry and Enamul Hoque , journal =. Integrating Image Data Extraction and Table Parsing Methods for Chart Question answering , year =

  119. [128]

    CoRR , volume =

    Pranav Rajpurkar and Jian Zhang and Konstantin Lopyrev and Percy Liang , title =. CoRR , volume =. 2016 , url =. 1606.05250 , timestamp =

    2016 arXiv

  120. [129]

    ArXiv , year=

    Data Extraction from Charts via Single Deep Neural Network , author=. ArXiv , year=

  121. [130]

    Data Augmentation for Visual Question Answering

    Kafle, Kushal and Yousefhussien, Mohammed and Kanan, Christopher. Data Augmentation for Visual Question Answering. Proceedings of the 10th International Conference on Natural Language Generation. 2017. doi:10.18653/v1/W17-3529

    2017 doi

  122. [131]

    ArXiv , year=

    Layer Normalization , author=. ArXiv , year=

  123. [132]

    CoRR , year=

    Neural Programmer: Inducing Latent Programs with Gradient Descent , author=. CoRR , year=

  124. [133]

    ArXiv , year=

    Adversarial TableQA: Attention Supervision for Question Answering on Tables , author=. ArXiv , year=

  125. [134]

    2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , year=

    Graph-Structured Representations for Visual Question Answering , author=. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , year=

    2017

  126. [135]

    International Journal of Computer Vision , year=

    CornerNet: Detecting Objects as Paired Keypoints , author=. International Journal of Computer Vision , year=

  127. [136]

    C hart QA : A Benchmark for Question Answering about Charts with Visual and Logical Reasoning

    Masry, Ahmed and Do, Xuan Long and Tan, Jia Qing and Joty, Shafiq and Hoque, Enamul. C hart QA : A Benchmark for Question Answering about Charts with Visual and Logical Reasoning. Findings of the Association for Computational Linguistics: ACL 2022. 2022. doi:10.18653/v1/2022.f...

    2022 doi

  128. [137]

    2024 , eprint=

    CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs , author=. 2024 , eprint=

    2024

  129. [138]

    2022 , eprint=

    Chart-to-Text: A Large-Scale Benchmark for Chart Summarization , author=. 2022 , eprint=

    2022

  130. [139]

    2024 , eprint=

    ChartInstruct: Instruction Tuning for Chart Comprehension and Reasoning , author=. 2024 , eprint=

    2024

  131. [140]

    2024 , eprint=

    ChartGemma: Visual Instruction-tuning for Chart Reasoning in the Wild , author=. 2024 , eprint=

    2024

  132. [141]

    Google Search , year =

  133. [142]

    arXiv preprint arXiv:2409.12191 , year=

    Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution , author=. arXiv preprint arXiv:2409.12191 , year=

    arXiv

  134. [143]

    arXiv preprint arXiv:2408.03326 , year=

    LLaVA-OneVision: Easy Visual Task Transfer , author=. arXiv preprint arXiv:2408.03326 , year=

    arXiv

  135. [144]

    arXiv preprint arXiv:2406.01574 , year=

    Mmlu-pro: A more robust and challenging multi-task language understanding benchmark , author=. arXiv preprint arXiv:2406.01574 , year=

    arXiv

  136. [145]

    arXiv preprint arXiv:2311.07453 , year=

    ChartCheck: An Evidence-Based Fact-Checking Dataset over Real-World Chart Images , author=. arXiv preprint arXiv:2311.07453 , year=

    arXiv

  137. [146]

    Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checking

    Akhtar, Mubashara and Cocarascu, Oana and Simperl, Elena. Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checking. Findings of the Association for Computational Linguistics: EACL 2023. 2023. doi:10.18653/v1/2023.findings-eacl.30

    2023 doi

  138. [147]

    arXiv preprint arXiv:2210.06628 , year=

    OpenCQA: Open-ended Question Answering with Charts , author=. arXiv preprint arXiv:2210.06628 , year=

    arXiv

  139. [148]

    2025 , eprint=

    Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling , author=. 2025 , eprint=

    2025

  140. [149]

    2024 , eprint=

    The Llama 3 Herd of Models , author=. 2024 , eprint=

    2024

  141. [150]

    2024 , eprint=

    GPT-4 Technical Report , author=. 2024 , eprint=

    2024

  142. [151]

    2024 , eprint=

    Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context , author=. 2024 , eprint=

    2024

  143. [152]

    2019 , eprint=

    CoQA: A Conversational Question Answering Challenge , author=. 2019 , eprint=

    2019

  144. [153]

    2018 , eprint=

    HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering , author=. 2018 , eprint=

    2018

  145. [154]

    2024 , eprint=

    Qwen2 Technical Report , author=. 2024 , eprint=

    2024

  146. [155]

    2024 , eprint=

    DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding , author=. 2024 , eprint=

    2024

  147. [156]

    2024 , eprint=

    Ovis: Structural Embedding Alignment for Multimodal Large Language Model , author=. 2024 , eprint=

    2024

  148. [157]

    2024 , eprint=

    Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone , author=. 2024 , eprint=

    2024

  149. [158]

    2024 , eprint=

    TinyChart: Efficient Chart Understanding with Visual Token Merging and Program-of-Thoughts Learning , author=. 2024 , eprint=

    2024

  150. [159]

    2024 , eprint=

    Building and better understanding vision-language models: insights and future directions , author=. 2024 , eprint=

    2024

  151. [160]

    2023 , eprint=

    UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoning , author=. 2023 , eprint=

    2023

  152. [161]

    Computer Graphics Forum , volume=

    Chart question answering: State of the art and future directions , author=. Computer Graphics Forum , volume=. 2022 , organization=

    2022

  153. [162]

    Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

    Reimers, Nils and Gurevych, Iryna. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing. 2019

    2019

  154. [163]

    2021 , eprint=

    Learning Transferable Visual Models From Natural Language Supervision , author=. 2021 , eprint=

    2021

  155. [164]

    2023 , eprint=

    Chain-of-Thought Prompting Elicits Reasoning in Large Language Models , author=. 2023 , eprint=

    2023

  156. [165]

    2023 , eprint=

    Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks , author=. 2023 , eprint=

    2023

  157. [166]

    arXiv preprint arXiv:1709.00103 , year=

    Seq2sql: Generating structured queries from natural language using reinforcement learning , author=. arXiv preprint arXiv:1709.00103 , year=

    arXiv

  158. [167]

    arXiv preprint arXiv:2112.12926 , year=

    nvBench: A large-scale synthesized dataset for cross-domain natural language to visualization task , author=. arXiv preprint arXiv:2112.12926 , year=

    arXiv

  159. [168]

    Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems , pages=

    Collecting and characterizing natural language utterances for specifying data visualizations , author=. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems , pages=

    2021

  160. [169]

    2021 IEEE 14th Pacific Visualization Symposium (PacificVis) , pages=

    Advisor: Automatic visualization answer for natural-language question on tabular data , author=. 2021 IEEE 14th Pacific Visualization Symposium (PacificVis) , pages=. 2021 , organization=

    2021

  161. [170]

    IEEE Transactions on Visualization and Computer Graphics , year=

    Viseval: A benchmark for data visualization in the era of large language models , author=. IEEE Transactions on Visualization and Computer Graphics , year=

  162. [171]

    Communication design quarterly review , volume=

    Data visualization , author=. Communication design quarterly review , volume=. 2015 , publisher=

    2015

  163. [172]

    2016 2nd International conference on contemporary computing and informatics (IC3I) , pages=

    Big data visualization: Tools and challenges , author=. 2016 2nd International conference on contemporary computing and informatics (IC3I) , pages=. 2016 , organization=

    2016

  164. [173]

    Journal of Open Source Software , volume=

    Seaborn: statistical data visualization , author=. Journal of Open Source Software , volume=

  165. [174]

    Building machine learning and deep learning models on google cloud platform: A comprehensive guide for beginners , pages=

    Matplotlib and seaborn , author=. Building machine learning and deep learning models on google cloud platform: A comprehensive guide for beginners , pages=. 2019 , publisher=

    2019

  166. [175]

    Computer Graphics Forum , pages=

    Natural Language Generation for Visualizations: State of the Art, Challenges and Future Directions , author=. Computer Graphics Forum , pages=. 2024 , organization=

    2024

  167. [176]

    arXiv preprint arXiv:2303.08774 , year=

    Gpt-4 technical report , author=. arXiv preprint arXiv:2303.08774 , year=

    arXiv

  168. [177]

    arXiv preprint arXiv:2107.03374 , year=

    Evaluating large language models trained on code , author=. arXiv preprint arXiv:2107.03374 , year=

    arXiv

  169. [178]

    Proceedings of the ACM on Management of Data , volume=

    Automated Data Visualization from Natural Language via Large Language Models: An Exploratory Study , author=. Proceedings of the ACM on Management of Data , volume=. 2024 , publisher=

    2024

  170. [179]

    arXiv preprint arXiv:2305.18486 , year=

    A systematic study and comprehensive evaluation of ChatGPT on benchmark datasets , author=. arXiv preprint arXiv:2305.18486 , year=

    arXiv

  171. [180]

    arXiv preprint arXiv:2203.10244 , year=

    Chartqa: A benchmark for question answering about charts with visual and logical reasoning , author=. arXiv preprint arXiv:2203.10244 , year=

    arXiv

  172. [181]

    IEEE transactions on visualization and computer graphics , volume=

    Towards natural language interfaces for data visualization: A survey , author=. IEEE transactions on visualization and computer graphics , volume=. 2022 , publisher=

    2022

  173. [182]

    Advances in Neural Information Processing Systems , volume=

    Is your code generated by chatgpt really correct? rigorous evaluation of large language models for code generation , author=. Advances in Neural Information Processing Systems , volume=

  174. [183]

    Journal of Software: Evolution and Process , volume=

    Llms for science: Usage for code generation and data analysis , author=. Journal of Software: Evolution and Process , volume=. 2025 , publisher=

    2025

  175. [184]

    arXiv preprint arXiv:2305.08377 , year=

    Text classification via large language models , author=. arXiv preprint arXiv:2305.08377 , year=

    arXiv

  176. [185]

    arXiv preprint arXiv:2312.10997 , year=

    Retrieval-augmented generation for large language models: A survey , author=. arXiv preprint arXiv:2312.10997 , year=

    arXiv

  177. [186]

    Computing in science & engineering , volume=

    Matplotlib: A 2D graphics environment , author=. Computing in science & engineering , volume=. 2007 , publisher=

    2007

  178. [187]

    IEEE transactions on visualization and computer graphics , volume=

    Vega-lite: A grammar of interactive graphics , author=. IEEE transactions on visualization and computer graphics , volume=. 2016 , publisher=

    2016

  179. [188]

    2018 , publisher=

    Data analysis and visualization using python , author=. 2018 , publisher=

    2018

  180. [189]

    Ieee Access , volume=

    Chat2vis: Generating data visualizations via natural language using chatgpt, codex and gpt-3 large language models , author=. Ieee Access , volume=. 2023 , publisher=

    2023

  181. [190]

    arXiv preprint arXiv:2005.03257 , year=

    Quda: natural language queries for visual data analytics , author=. arXiv preprint arXiv:2005.03257 , year=

    2005 arXiv

  182. [191]

    2023 IEEE VIS Workshop on Visualization Education, Literacy, and Activities (EduVis) , pages=

    Beyond generating code: Evaluating gpt on a data visualization course , author=. 2023 IEEE VIS Workshop on Visualization Education, Literacy, and Activities (EduVis) , pages=. 2023 , organization=

    2023

  183. [192]

    arXiv preprint arXiv:2402.02167 , year=

    Vi (E) va LLM! A Conceptual Stack for Evaluating and Interpreting Generative AI-based Visualizations , author=. arXiv preprint arXiv:2402.02167 , year=

    arXiv

  184. [193]

    arXiv preprint arXiv:2308.12950 , year=

    Code llama: Open foundation models for code , author=. arXiv preprint arXiv:2308.12950 , year=

    arXiv

  185. [194]

    arXiv preprint arXiv:2310.06825 , year=

    Mistral 7B , author=. arXiv preprint arXiv:2310.06825 , year=

    arXiv

  186. [195]

    arXiv preprint arXiv:2302.13971 , year=

    Llama: Open and efficient foundation language models , author=. arXiv preprint arXiv:2302.13971 , year=

    arXiv

  187. [196]

    5 technical report , author=

    Qwen2. 5 technical report , author=. arXiv preprint arXiv:2412.15115 , year=

    arXiv

  188. [197]

    Frontiers in Education , volume=

    Is GPT-4 a reliable rater? Evaluating consistency in GPT-4's text ratings , author=. Frontiers in Education , volume=. 2023 , organization=

    2023

  189. [198]

    Harvard Data Science Review , volume=

    Why is data visualization important? what is important in data visualization? , author=. Harvard Data Science Review , volume=

  190. [199]

    arXiv preprint arXiv:2408.05346 , year=

    DataNarrative: Automated data-driven storytelling with visualizations and texts , author=. arXiv preprint arXiv:2408.05346 , year=

    arXiv

  191. [200]

    Reflexion: language agents with verbal reinforcement learning , booktitle =

    Noah Shinn and Federico Cassano and Ashwin Gopinath and Karthik Narasimhan and Shunyu Yao , editor =. Reflexion: language agents with verbal reinforcement learning , booktitle =. 2023 , url =

    2023

  192. [201]

    CoRR , volume =

    William Saunders and Catherine Yeh and Jeff Wu and Steven Bills and Long Ouyang and Jonathan Ward and Jan Leike , title =. CoRR , volume =. 2022 , url =. doi:10.48550/ARXIV.2206.05802 , eprinttype =. 2206.05802 , timestamp =

    2022 doi arXiv

  193. [202]

    arXiv preprint arXiv:2501.12948 , year=

    Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning , author=. arXiv preprint arXiv:2501.12948 , year=

    arXiv

  194. [203]

    arXiv preprint arXiv:2401.14196 , year=

    DeepSeek-Coder: When the Large Language Model Meets Programming--The Rise of Code Intelligence , author=. arXiv preprint arXiv:2401.14196 , year=

    arXiv

  195. [204]

    International conference on machine learning , pages=

    Learning transferable visual models from natural language supervision , author=. International conference on machine learning , pages=. 2021 , organization=

    2021

  196. [205]

    Sentence- BERT : Sentence Embeddings using S iamese BERT -Networks

    Reimers, Nils and Gurevych, Iryna. Sentence- BERT : Sentence Embeddings using S iamese BERT -Networks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP...

    2019 doi

  197. [206]

    The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations , author=. Color Research & Application: Endorsed by Inter-Society Color Council, The Colour Group (Great Britain), Canadian Society for Color, Color Science As...

    2005

  198. [207]

    IEEE Transactions on Visualization and Computer Graphics , volume=

    NL4DV: A toolkit for generating analytic specifications for data visualization from natural language queries , author=. IEEE Transactions on Visualization and Computer Graphics , volume=. 2020 , publisher=

    2020

  199. [208]

    Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining , pages=

    Rgvisnet: A hybrid retrieval-generation neural framework towards automatic data visualization generation , author=. Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining , pages=

  200. [209]

    arXiv preprint arXiv:2311.16483 , year=

    Chartllama: A multimodal llm for chart understanding and generation , author=. arXiv preprint arXiv:2311.16483 , year=

    arXiv

  201. [210]

    Advances in Neural Information Processing Systems , volume=

    Judging llm-as-a-judge with mt-bench and chatbot arena , author=. Advances in Neural Information Processing Systems , volume=

  202. [211]

    arXiv preprint arXiv:2411.15594 , year=

    A survey on llm-as-a-judge , author=. arXiv preprint arXiv:2411.15594 , year=

    arXiv

  203. [212]

    Advances in Neural Information Processing Systems , volume=

    Self-refine: Iterative refinement with self-feedback , author=. Advances in Neural Information Processing Systems , volume=

  204. [213]

    arXiv preprint arXiv:2407.21783 , year=

    The llama 3 herd of models , author=. arXiv preprint arXiv:2407.21783 , year=

    arXiv

  205. [214]

    IEEE computer graphics and applications , volume=

    Data2vis: Automatic generation of data visualizations using sequence-to-sequence recurrent neural networks , author=. IEEE computer graphics and applications , volume=. 2019 , publisher=

    2019

  206. [215]

    arXiv preprint arXiv:2410.03859 , year=

    Swe-bench multimodal: Do ai systems generalize to visual software domains? , author=. arXiv preprint arXiv:2410.03859 , year=

    arXiv

  207. [216]

    Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing , pages=

    Text2vis: A challenging and diverse benchmark for generating multimodal visualizations from text , author=. Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing , pages=

    2025

  208. [217]

    International Conference on Learning Representations , volume=

    Chartmimic: Evaluating lmm's cross-modal reasoning capability via chart-to-code generation , author=. International Conference on Learning Representations , volume=

  209. [218]

    Findings of the Association for Computational Linguistics: NAACL 2025 , pages=

    Plot2code: A comprehensive benchmark for evaluating multi-modal large language models in code generation from scientific plots , author=. Findings of the Association for Computational Linguistics: NAACL 2025 , pages=

    2025

  210. [219]

    arXiv preprint arXiv:2312.15915 , year=

    Chartbench: A benchmark for complex visual reasoning in charts , author=. arXiv preprint arXiv:2312.15915 , year=

    arXiv

  211. [220]

    Proceedings of the 31st International Conference on Computational Linguistics: Industry Track , pages=

    Chartgemma: Visual instruction-tuning for chart reasoning in the wild , author=. Proceedings of the 31st International Conference on Computational Linguistics: Industry Track , pages=

  212. [221]

    arXiv preprint arXiv:2210.03629 , year=

    React: Synergizing reasoning and acting in language models , author=. arXiv preprint arXiv:2210.03629 , year=

    arXiv

  213. [222]

    Advances in neural information processing systems , volume=

    Self-refine: Iterative refinement with self-feedback , author=. Advances in neural information processing systems , volume=

  214. [223]

    Advances in neural information processing systems , volume=

    Reflexion: Language agents with verbal reinforcement learning , author=. Advances in neural information processing systems , volume=

  215. [224]

    arXiv preprint arXiv:2510.04023 , year=

    Llm-based data science agents: A survey of capabilities, challenges, and future directions , author=. arXiv preprint arXiv:2510.04023 , year=

  216. [225]

    The American Statistician , pages=

    A survey on large language model-based agents for statistics and data science , author=. The American Statistician , pages=. 2025 , publisher=

    2025

  217. [226]

    Aligning Text, Code, and Vision: A Multi-Objective Reinforcement Learning Framework for Text-to-Visualization

    Rahman, Mizanur and Islam, Mohammed Saidul and Laskar, Md Tahmid Rahman and Joty, Shafiq and Hoque, Enamul. Aligning Text, Code, and Vision: A Multi-Objective Reinforcement Learning Framework for Text-to-Visualization. Proceedings of the 19th Conference of the E uropean Chapte...

    2026 doi

  218. [227]

    Findings of the Association for Computational Linguistics: EMNLP 2024 , pages=

    Mmcode: Benchmarking multimodal large language models for code generation with visually rich programming problems , author=. Findings of the Association for Computational Linguistics: EMNLP 2024 , pages=

    2024

  219. [228]

    Design2code: Benchmarking multimodal code generation for automated front-end engineering , author=. Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) , pages=

    2025

  220. [229]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    SVGEditBench: A Benchmark Dataset for Quantitative Assessment of LLM's SVG Editing Capabilities , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  221. [230]

    Proceedings of the ACM SIGCHI symposium on engineering interactive computing systems , pages=

    pix2code: Generating code from a graphical user interface screenshot , author=. Proceedings of the ACM SIGCHI symposium on engineering interactive computing systems , pages=

  222. [231]

    arXiv preprint arXiv:1905.13750 , year=

    Sketch2code: Generating a website from a paper mockup , author=. arXiv preprint arXiv:1905.13750 , year=

    1905 arXiv

  223. [232]

    arXiv preprint arXiv:2305.14637 , year=

    Learning UI-to-Code Reverse Generator Using Visual Critic Without Rendering , author=. arXiv preprint arXiv:2305.14637 , year=

    arXiv

  224. [233]

    Proceedings of the 2023 conference on empirical methods in natural language processing , pages=

    G-eval: NLG evaluation using gpt-4 with better human alignment , author=. Proceedings of the 2023 conference on empirical methods in natural language processing , pages=

    2023

  225. [234]

    Advances in neural information processing systems , volume=

    Judging llm-as-a-judge with mt-bench and chatbot arena , author=. Advances in neural information processing systems , volume=

  226. [235]

    arXiv preprint arXiv:2404.04475 , year=

    Length-controlled alpacaeval: A simple way to debias automatic evaluators , author=. arXiv preprint arXiv:2404.04475 , year=

    arXiv

  227. [236]

    International Conference on Learning Representations , volume=

    Prometheus: Inducing fine-grained evaluation capability in language models , author=. International Conference on Learning Representations , volume=

  228. [237]

    International Conference on Learning Representations , volume=

    Judgelm: Fine-tuned large language models are scalable judges , author=. International Conference on Learning Representations , volume=

  229. [238]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Tifa: Accurate and interpretable text-to-image faithfulness evaluation with question answering , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  230. [239]

    European Conference on Computer Vision , pages=

    Evaluating text-to-visual generation with image-to-text generation , author=. European Conference on Computer Vision , pages=. 2024 , organization=

    2024

  231. [240]

    Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages=

    Viescore: Towards explainable metrics for conditional image synthesis evaluation , author=. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages=

  232. [241]

    The Second Tiny Papers Track at ICLR 2024 , year=

    Exploring GPT-4 vision for text-to-image synthesis evaluation , author=. The Second Tiny Papers Track at ICLR 2024 , year=

    2024

  233. [242]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    Gpt-4v (ision) is a human-aligned evaluator for text-to-3d generation , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  234. [243]

    Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages=

    Can large language models be an alternative to human evaluations? , author=. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages=

Pith tools

Reviewed August 15, 2026 · model on record in the stance chip above.