REVIEW 1 cited by
ChartEditor: A Human-AI Paired Tool for Authoring Pictorial Charts
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Pictorial charts are favored for their memorability and visual appeal, offering a more engaging alternative to basic charts. However, their creation can be complex and time-consuming due to the lack of native support in popular visualization tools like Tableau. While AI-generated content (AIGC) tools have lowered the barrier to creating pictorial charts, they often lack precise design control. To address this issue, we introduce ChartEditor, a human-AI paired tool that transforms basic charts into pictorial versions based on user intent. ChartEditor decomposes chart images into visual components and organizes them within a hierarchical tree. Based on this tree, users can express their intent in natural language, which is then translated into modifications to the hierarchy. In addition, users can directly interact with and modify specific chart components via an intuitive interface to achieve fine-grained design control. A user study demonstrates the effectiveness and usability of ChartEditor in simplifying the creation of pictorial charts.
Forward citations
Cited by 1 Pith paper
-
ArtChart: Faithful Artistic Chart Generation with Integrated Text Rendering
ArtChart, a ControlNet + GRPO + multi-expert distillation system, achieves about 9.1/10 math, 9.5/10 text, and 7.7/10 layout on a new 2K bilingual artistic-chart benchmark, well above open baselines.
Reference graph
Works this paper leans on
-
[2]
Visualisations with seman- tic icons: Assessing engagement with distracting elements
Muna Alebri, Enrico Costanza, Georgia Panagiotidou, Duncan P Brumby, Fatima Althani, and Riccardo Bovo. Visualisations with seman- tic icons: Assessing engagement with distracting elements. International Journal of Human-Computer Studies , 191:103343, 2024
work page 2024
-
[3]
Authoring data-driven videos with dataclips
Fereshteh Amini, Nathalie Henry Riche, Bongshin Lee, Andres Monroy- Hernandez, and Pourang Irani. Authoring data-driven videos with dataclips. IEEE transactions on visualization and computer graphics , 23(1):501–510, 2016
work page 2016
-
[4]
Chart-Text: A Fully Automated Chart Image Descriptor
A Balaji, T Ramanathan, and V Sonathi. Chart-text: A fully automated chart image descriptor. arxiv 2018. arXiv preprint arXiv:1812.10636
work page Pith review arXiv 2018
-
[5]
Carliss Y . Baldwin and Kim B. Clark. Design Rules: The Power of Modularity. MIT Press, Cambridge, MA, 2000
work page 2000
-
[6]
Useful junk? the effects of visual embellishment on comprehension and memorability of charts
Scott Bateman, Regan L Mandryk, Carl Gutwin, Aaron Genest, David McDine, and Christopher Brooks. Useful junk? the effects of visual embellishment on comprehension and memorability of charts. In Proceedings of the SIGCHI conference on human factors in computing systems, pages 2573–2582, 2010
work page 2010
-
[7]
An empirical study on using visual embellishments in visualization
Rita Borgo, Alfie Abdul-Rahman, Farhan Mohamed, Philip W Grant, Irene Reppa, Luciano Floridi, and Min Chen. An empirical study on using visual embellishments in visualization. IEEE Transactions on Visualization and Computer Graphics , 18(12):2759–2768, 2012
work page 2012
-
[8]
Beyond memorability: Visualization recognition and recall
Michelle A Borkin, Zoya Bylinskii, Nam Wook Kim, Constance May Bainbridge, Chelsea S Yeh, Daniel Borkin, Hanspeter Pfister, and Aude Oliva. Beyond memorability: Visualization recognition and recall. IEEE transactions on visualization and computer graphics , 22(1):519–528, 2015
work page 2015
-
[9]
Michelle A Borkin, Azalea A V o, Zoya Bylinskii, Phillip Isola, Shashank Sunkavalli, Aude Oliva, and Hanspeter Pfister. What makes a visual- ization memorable? IEEE transactions on visualization and computer graphics, 19(12):2306–2315, 2013
work page 2013
Show all 76 references
-
[10]
Using thematic analysis in psychol- ogy
Virginia Braun and Victoria Clarke. Using thematic analysis in psychol- ogy. Qualitative research in psychology , 3(2):77–101, 2006
2006
-
[11]
Crowdsourcing- based data extraction from visualization charts
Chengliang Chai, Guoliang Li, Ju Fan, and Yuyu Luo. Crowdsourcing- based data extraction from visualization charts. In ICDE, pages 1814–
-
[12]
Crowdchart: Crowdsourced data extraction from visualization charts
Chengliang Chai, Guoliang Li, Ju Fan, and Yuyu Luo. Crowdchart: Crowdsourced data extraction from visualization charts. IEEE Trans. Knowl. Data Eng. , 33(11):3537–3549, 2021
2021
-
[13]
Mystique: Deconstructing svg charts for layout reuse
Chen Chen, Bongshin Lee, Yunhai Wang, Yunjeong Chang, and Zhicheng Liu. Mystique: Deconstructing svg charts for layout reuse. IEEE Transactions on Visualization and Computer Graphics , 2023
2023
-
[14]
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation, page 833–851
Liang-Chieh Chen, Yukun Zhu, George Papandreou, Florian Schroff, and Hartwig Adam. Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation, page 833–851. Springer International Publishing, 2018
2018
-
[15]
Towards automated infographic design: Deep learning-based auto- extraction of extensible timeline
Zhutian Chen, Yun Wang, Qianwen Wang, Yong Wang, and Huamin Qu. Towards automated infographic design: Deep learning-based auto- extraction of extensible timeline. IEEE transactions on visualization and computer graphics, 26(1):917–926, 2019
2019
-
[16]
Schwing, and Alexander Kirillov
Bowen Cheng, Alexander G. Schwing, and Alexander Kirillov. Per-pixel classification is not all you need for semantic segmentation. 2021
2021
-
[17]
Chartreader: A unified framework for chart derendering and comprehension without heuristic rules
Zhi-Qi Cheng, Qi Dai, and Alexander G Hauptmann. Chartreader: A unified framework for chart derendering and comprehension without heuristic rules. In Proceedings of the IEEE/CVF International Con- ference on Computer Vision , pages 22202–22213, 2023
2023
-
[18]
Cnocr [optical character recognition tool], 2023
CnOCR. Cnocr [optical character recognition tool], 2023
2023
-
[19]
Microsoft visio, 2023
Microsoft Corporation. Microsoft visio, 2023. Accessed: 2024-09-12
2023
-
[20]
View: Visual information extraction widget for improving chart images accessibility
Jinglun Gao, Yin Zhou, and Kenneth E Barner. View: Visual information extraction widget for improving chart images accessibility. In 2012 19th IEEE international conference on image processing , pages 2865–2868. IEEE, 2012
2012
-
[21]
Visltr: Visualization-in-the-loop table reasoning
Jianing Hao, Zhuowen Liang, Chunting Li, Yuyu Luo, and Wei Zeng. Visltr: Visualization-in-the-loop table reasoning. CoRR, abs/2406.03753, 2024
2024 arXiv
-
[22]
Isotype visualiza- tion: Working memory, performance, and engagement with pictographs
Steve Haroz, Robert Kosara, and Steven L Franconeri. Isotype visualiza- tion: Working memory, performance, and engagement with pictographs. In Proceedings of the 33rd annual ACM conference on human factors in computing systems , pages 1191–1200, 2015
2015
-
[23]
Deconstructing and restyling d3 visualizations
Jonathan Harper and Maneesh Agrawala. Deconstructing and restyling d3 visualizations. In Proceedings of the 27th annual ACM symposium on User interface software and technology , pages 253–262, 2014
2014
-
[24]
Converting basic d3 charts into reusable style templates
Jonathan Harper and Maneesh Agrawala. Converting basic d3 charts into reusable style templates. IEEE transactions on visualization and computer graphics, 24(3):1274–1286, 2017
2017
-
[25]
Nasa-task load index (nasa-tlx); 20 years later
Sandra G Hart. Nasa-task load index (nasa-tlx); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, volume 50, pages 904–908. Sage publications Sage CA: Los Angeles, CA, 2006
2006
-
[26]
Lineex: data extraction from scientific line charts
Muhammad Yusuf Hassan, Mayank Singh, et al. Lineex: data extraction from scientific line charts. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , pages 6213–6221, 2023
2023
-
[27]
Software design patterns for information visualization
Jeffrey Heer and Maneesh Agrawala. Software design patterns for information visualization. IEEE Transactions on Visualization and Computer Graphics, 12, 2006
2006
-
[28]
Searching the visual style and structure of d3 visualizations
Enamul Hoque and Maneesh Agrawala. Searching the visual style and structure of d3 visualizations. IEEE transactions on visualization and computer graphics, 26(1):1236–1245, 2019
2019
-
[29]
C2ideas: Supporting creative interior color design ideation with a large language model
Yihan Hou, Manling Yang, Hao Cui, Lei Wang, Jie Xu, and Wei Zeng. C2ideas: Supporting creative interior color design ideation with a large language model. In Proceedings of the CHI Conference on Human Factors in Computing Systems , pages 1–18, 2024
2024
-
[30]
Chartsense: Interactive data extraction from chart images
Daekyoung Jung, Wonjae Kim, Hyunjoo Song, Jeong-in Hwang, Bong- shin Lee, Bohyoung Kim, and Jinwook Seo. Chartsense: Interactive data extraction from chart images. In Proceedings of the 2017 chi conference on human factors in computing systems , pages 6706–6717, 2017
2017
-
[31]
Berg, Wan-Yen Lo, Piotr Doll ´ar, and Ross Girshick
Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C. Berg, Wan-Yen Lo, Piotr Doll ´ar, and Ross Girshick. Segment anything. arXiv:2304.02643, 2023
2023 arXiv
-
[32]
Smile or scowl? looking at infographic design through the affective lens
Xingyu Lan, Yang Shi, Yueyao Zhang, and Nan Cao. Smile or scowl? looking at infographic design through the affective lens. IEEE Transactions on Visualization and Computer Graphics , 27(6):2796– 2807, 2021
2021
-
[33]
The dawn of natural language to SQL: are we fully ready? Proc
Boyan Li, Yuyu Luo, Chengliang Chai, Guoliang Li, and Nan Tang. The dawn of natural language to SQL: are we fully ready? Proc. VLDB Endow., 17(11):3318–3331, 2024
2024
-
[34]
Semantic-sam: Segment and recognize anything at any granularity
Feng Li, Hao Zhang, Peize Sun, Xueyan Zou, Shilong Liu, Jianwei Yang, Chunyuan Li, Lei Zhang, and Jianfeng Gao. Semantic-sam: Segment and recognize anything at any granularity. arXiv preprint arXiv:2307.04767, 2023
2023 arXiv
-
[35]
Coinsight: Visual storytelling for hierarchical tables with connected insights
Guozheng Li, Runfei Li, Yunshan Feng, Yu Zhang, Yuyu Luo, and Chi Harold Liu. Coinsight: Visual storytelling for hierarchical tables with connected insights. IEEE Trans. Vis. Comput. Graph., 30(6):3049– 3061, 2024
2024
-
[36]
Gligen: Open-set grounded text-to-image generation
Yuheng Li, Haotian Liu, Qingyang Wu, Fangzhou Mu, Jianwei Yang, Jianfeng Gao, Chunyuan Li, and Yong Jae Lee. Gligen: Open-set grounded text-to-image generation. In Proceedings of the IEEE/CVF JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021 14 Conference on Computer V...
2021
-
[37]
A survey of NL2SQL with large language models: Where are we, and where are we going? CoRR, abs/2408.05109, 2024
Xinyu Liu, Shuyu Shen, Boyan Li, Peixian Ma, Runzhi Jiang, Yuyu Luo, Yuxin Zhang, Ju Fan, Guoliang Li, and Nan Tang. A survey of NL2SQL with large language models: Where are we, and where are we going? CoRR, abs/2408.05109, 2024
2024
-
[38]
Chartocr: Data extraction from charts images via a deep hybrid framework
Junyu Luo, Zekun Li, Jinpeng Wang, and Chin-Yew Lin. Chartocr: Data extraction from charts images via a deep hybrid framework. In Proceedings of the IEEE/CVF winter conference on applications of computer vision, pages 1917–1925, 2021
1917
-
[39]
Deepeye: Towards automatic data visualization
Yuyu Luo, Xuedi Qin, Nan Tang, and Guoliang Li. Deepeye: Towards automatic data visualization. In ICDE, pages 101–112. IEEE Computer Society, 2018
2018
-
[40]
Synthesizing natural language to visualization (NL2VIS) benchmarks from NL2SQL benchmarks
Yuyu Luo, Nan Tang, Guoliang Li, Chengliang Chai, Wenbo Li, and Xuedi Qin. Synthesizing natural language to visualization (NL2VIS) benchmarks from NL2SQL benchmarks. In SIGMOD Conference, pages 1235–1247. ACM, 2021
2021
-
[41]
Natural language to visualization by neural machine translation
Yuyu Luo, Nan Tang, Guoliang Li, Jiawei Tang, Chengliang Chai, and Xuedi Qin. Natural language to visualization by neural machine translation. IEEE Trans. Vis. Comput. Graph. , 28(1):217–226, 2022
2022
-
[42]
Learned data-aware image representations of line charts for similarity search
Yuyu Luo, Yihui Zhou, Nan Tang, Guoliang Li, Chengliang Chai, and Leixian Shen. Learned data-aware image representations of line charts for similarity search. Proc. ACM Manag. Data , 1(1):88:1–88:29, 2023
2023
-
[43]
Show me: Automatic presentation for visual analysis
Jock Mackinlay, Pat Hanrahan, and Chris Stolte. Show me: Automatic presentation for visual analysis. IEEE Transactions on Visualization and Computer Graphics, 13(6):1137–1144, 2007
2007
-
[44]
Chartdetective: Easy and accurate interactive data ex- traction from complex vector charts
Damien Masson, Sylvain Malacria, Daniel V ogel, Edward Lank, and G´ery Casiez. Chartdetective: Easy and accurate interactive data ex- traction from complex vector charts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, pages 1–17, 2023
2023
-
[45]
Midjourney [ai image generation tool], 2023
MidJourney. Midjourney [ai image generation tool], 2023
2023
-
[46]
Visualization Analysis and Design
Tamara Munzner. Visualization Analysis and Design. CRC Press, 2014
2014
-
[47]
Chatgpt (september 2023 version) [large language model], 2023
OpenAI. Chatgpt (september 2023 version) [large language model], 2023
2023
-
[48]
Dall·e 3: Bridging text and image with natural language under- standing
OpenAI. Dall·e 3: Bridging text and image with natural language under- standing. https://cdn.openai.com/papers/dall-e-3.pdf, 2024. Accessed: 2024-12-18
2024
-
[49]
Generative agents: Interactive simulacra of human behavior
Joon Sung Park, Joseph O’Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. Generative agents: Interactive simulacra of human behavior. In Proceedings of the 36th annual acm symposium on user interface software and technology, pages 1–22, 2023
2023
-
[50]
Reverse-engineering visualizations: Re- covering visual encodings from chart images
Jorge Poco and Jeffrey Heer. Reverse-engineering visualizations: Re- covering visual encodings from chart images. In Computer graphics forum, volume 36, pages 353–363. Wiley Online Library, 2017
2017
-
[51]
Extracting and retargeting color mappings from bitmap images of visualizations
Jorge Poco, Angela Mayhua, and Jeffrey Heer. Extracting and retargeting color mappings from bitmap images of visualizations. IEEE transactions on visualization and computer graphics , 24(1):637–646, 2017
2017
-
[52]
Retrieve-then-adapt: Example-based auto- matic generation for proportion-related infographics
Chunyao Qian, Shizhao Sun, Weiwei Cui, Jian-Guang Lou, Haidong Zhang, and Dongmei Zhang. Retrieve-then-adapt: Example-based auto- matic generation for proportion-related infographics. IEEE Transactions on Visualization and Computer Graphics , 27(2):443–452, 2020
2020
-
[53]
Making data visualization more efficient and effective: a survey
Xuedi Qin, Yuyu Luo, Nan Tang, and Guoliang Li. Making data visualization more efficient and effective: a survey. VLDB J., 29(1):93– 117, 2020
2020
-
[54]
Interpretation of quantities displayed in pictorial charts
Tobias Rolfes. Interpretation of quantities displayed in pictorial charts. Frontiers in Psychology, 12:609027, 2021
2021
-
[55]
U-net: Con- volutional networks for biomedical image segmentation
Olaf Ronneberger, Philipp Fischer, and Thomas Brox. U-net: Con- volutional networks for biomedical image segmentation. CoRR, abs/1505.04597, 2015
2015 arXiv
-
[56]
Thomas L. Saaty. The Analytic Hierarchy Process . McGraw-Hill, New York, NY , 1980
1980
-
[57]
Revision: Automated classification, analysis and redesign of chart images
Manolis Savva, Nicholas Kong, Arti Chhajta, Li Fei-Fei, Maneesh Agrawala, and Jeffrey Heer. Revision: Automated classification, analysis and redesign of chart images. In Proceedings of the 24th annual ACM symposium on User interface software and technology , pages 393–402, 2011
2011
-
[58]
Data playwright: Authoring data videos with annotated narration
Leixian Shen, Haotian Li, Yun Wang, Tianqi Luo, Yuyu Luo, and Huamin Qu. Data playwright: Authoring data videos with annotated narration. IEEE Transactions on Visualization and Computer Graphics , pages 1–14, 2024
2024
-
[59]
Supporting expressive and faithful pictorial visualization design with visual style transfer
Yang Shi, Pei Liu, Siji Chen, Mengdi Sun, and Nan Cao. Supporting expressive and faithful pictorial visualization design with visual style transfer. IEEE Transactions on Visualization and Computer Graphics , 29(1):236–246, 2022
2022
-
[60]
Data animator: Authoring expressive animated data graphics
John R Thompson, Zhicheng Liu, and John Stasko. Data animator: Authoring expressive animated data graphics. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems , CHI ’21, New York, NY , USA, 2021. Association for Computing Machinery
2021
-
[61]
Dynavis: Dynamically synthesized ui widgets for visualization editing
Priyan Vaithilingam, Elena L Glassman, Jeevana Priya Inala, and Chenglong Wang. Dynavis: Dynamically synthesized ui widgets for visualization editing. In Proceedings of the CHI Conference on Human Factors in Computing Systems , pages 1–17, 2024
2024
-
[62]
Yolov8: A novel object detection algo- rithm with enhanced performance and robustness
Rejin Varghese and Sambath M. Yolov8: A novel object detection algo- rithm with enhanced performance and robustness. In 2024 International Conference on Advances in Data Engineering and Intelligent Computing Systems (ADICS), pages 1–6, 2024
2024
-
[63]
Towards natural language-based visualization authoring
Yun Wang, Zhitao Hou, Leixian Shen, Tongshuang Wu, Jiaqi Wang, He Huang, Haidong Zhang, and Dongmei Zhang. Towards natural language-based visualization authoring. IEEE Transactions on Visual- ization and Computer Graphics , 29(1):1222–1232, 2022
2022
-
[64]
viz2viz: Prompt- driven stylized visualization generation using a diffusion model
Jiaqi Wu, John Joon Young Chung, and Eytan Adar. viz2viz: Prompt- driven stylized visualization generation using a diffusion model. arXiv preprint arXiv:2304.01919, 2023
2023 arXiv
-
[65]
Chartinsights: Evaluating multimodal large language models for low-level chart question answering
Yifan Wu, Lutao Yan, Leixian Shen, Yunhai Wang, Nan Tang, and Yuyu Luo. Chartinsights: Evaluating multimodal large language models for low-level chart question answering. In EMNLP (Findings), pages 12174– 12200. Association for Computational Linguistics, 2024
2024
-
[66]
Let the chart spark: Embedding semantic context into chart with text-to-image generative model
Shishi Xiao, Suizi Huang, Yue Lin, Yilin Ye, and Wei Zeng. Let the chart spark: Embedding semantic context into chart with text-to-image generative model. IEEE Transactions on Visualization and Computer Graphics, 30(1):284–294, 2024
2024
-
[67]
Typedance: Creating semantic typographic logos from image through personalized generation
Shishi Xiao, Liangwei Wang, Xiaojuan Ma, and Wei Zeng. Typedance: Creating semantic typographic logos from image through personalized generation. In Proceedings of the CHI Conference on Human Factors in Computing Systems, CHI ’24, New York, NY , USA, 2024. Association for Comp...
2024
-
[68]
Haichart: Human and AI paired visualization system
Yupeng Xie, Yuyu Luo, Guoliang Li, and Nan Tang. Haichart: Human and AI paired visualization system. Proc. VLDB Endow., 17(11):3178– 3191, 2024
2024
-
[69]
ChartDETR: A multi-shape detection network for visual chart recognition
Wenyuan Xue, Dapeng Chen, Baosheng Yu, Yifei Chen, Sai Zhou, and Wei Peng. ChartDETR: A multi-shape detection network for visual chart recognition. arXiv preprint arXiv:2308.07743 , 2023
2023 arXiv
-
[70]
Generative AI for visualization: State of the art and future directions
Yilin Ye, Jianing Hao, Yihan Hou, Zhan Wang, Shishi Xiao, Yuyu Luo, and Wei Zeng. Generative AI for visualization: State of the art and future directions. Vis. Informatics, 8(1):43–66, 2024
2024
-
[71]
Metaglyph: Automatic generation of metaphoric glyph-based visualization
Lu Ying, Xinhuan Shu, Dazhen Deng, Yuchen Yang, Tan Tang, Lingyun Yu, and Yingcai Wu. Metaglyph: Automatic generation of metaphoric glyph-based visualization. IEEE Transactions on Visualization and Computer Graphics, 29(1):331–341, 2022
2022
-
[72]
Inpaint anything: Segment anything meets image inpainting
Tao Yu, Runseng Feng, Ruoyu Feng, Jinming Liu, Xin Jin, Wenjun Zeng, and Zhibo Chen. Inpaint anything: Segment anything meets image inpainting. arXiv preprint arXiv:2304.06790 , 2023
2023 arXiv
-
[73]
Designrepair: Dual-stream design guideline-aware frontend repair with large language models
Mingyue Yuan, Jieshan Chen, Zhenchang Xing, Aaron Quigley, Yuyu Luo, Gelareh Mohammadi, Qinghua Lu, and Liming Zhu. Designrepair: Dual-stream design guideline-aware frontend repair with large language models. CoRR, abs/2411.01606, 2024
2024 arXiv
-
[74]
Dataquilt: Extracting visual elements from images to craft pictorial visualizations
Jiayi Eris Zhang, Nicole Sultanum, Anastasia Bezerianos, and Fanny Chevalier. Dataquilt: Extracting visual elements from images to craft pictorial visualizations. In Proceedings of the 2020 chi conference on human factors in computing systems , pages 1–13, 2020
2020
-
[75]
Adding conditional control to text-to-image diffusion models
Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Adding conditional control to text-to-image diffusion models
-
[76]
The stories we tell about data: Surveying data-driven storytelling using visualization
Zhenpeng Zhao and Niklas Elmqvist. The stories we tell about data: Surveying data-driven storytelling using visualization. IEEE Computer Graphics and Applications , 43(4):97–110, 2023
2023
-
[77]
Are large language models good statisticians? CoRR, abs/2406.07815, 2024
Yizhang Zhu, Shiyin Du, Boyan Li, Yuyu Luo, and Nan Tang. Are large language models good statisticians? CoRR, abs/2406.07815, 2024. JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021 15 Siyu YAN is an MPhil student at the Info Hub, Hong Kong University of Science and Te...
2024 arXiv
Discussion (0). Continue with ORCID to comment.