A Qualitative Analysis of Common Practices in Annotations: A Taxonomy and Design Space
Pith reviewed 2026-05-24 08:28 UTC · model grok-4.3
The pith
Annotations on visualizations follow patterns in purpose, mechanism and data source that form a design space.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Qualitative coding of 1,800 real-world annotated charts reveals patterns in analytic purposes, mechanisms and data sources for annotations, which are organized into a design space of key design choices for chart annotations.
What carries the argument
The design space of annotations synthesized from purposes, mechanisms and data sources identified in the coded charts.
If this is right
- The design space acts as a practical framework for chart annotations.
- Case studies demonstrate how the space enhances communication of visualization insights.
- Patterns show variations in annotation use depending on chart type and purpose.
Where Pith is reading between the lines
- Tool builders could embed the design space to suggest annotations automatically.
- The categories might apply to interactive visualizations beyond the static ones studied.
- Future work could test if following the design space improves user understanding of charts.
Load-bearing premise
The set of 1,800 static annotated charts sufficiently represents common annotation practices to support a general design space.
What would settle it
Identification of a substantial number of annotated charts whose purposes, mechanisms or data sources fall outside the categories in the proposed design space.
Figures
read the original abstract
Annotations play a vital role in highlighting critical aspects of visualizations, aiding in data externalization and exploration, collaborative sensemaking, and visual storytelling. However, despite their widespread use, we identified a lack of a design space for common practices for annotations. In this paper, we evaluated over 1,800 static annotated charts to understand how people annotate visualizations in practice. Through qualitative coding of these diverse real-world annotated charts, we explored three primary aspects of annotation usage patterns: analytic purposes for chart annotations (e.g., present, identify, summarize, or compare data features), mechanisms for chart annotations (e.g., types and combinations of annotations used, frequency of different annotation types across chart types, etc.), and the data source used to generate the annotations. We then synthesized our findings into a design space of annotations, highlighting key design choices for chart annotations. We presented three case studies illustrating our design space as a practical framework for chart annotations to enhance the communication of visualization insights. All supplemental materials are available at {https://shorturl.at/bAGM1}.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper reports a qualitative analysis of over 1,800 static annotated charts collected from real-world sources. It identifies three main aspects of annotation practice—analytic purposes (present, identify, summarize, compare), mechanisms (annotation types, combinations, and frequency by chart type), and data sources—then synthesizes these observations into a design space of key design choices, which is illustrated via three case studies.
Significance. If the sampled corpus is representative, the work supplies the first large-scale empirical taxonomy of annotation practices in visualization, filling a documented gap and offering a practical framework that could guide both tool design and authoring guidelines.
major comments (2)
- [Methods] Methods section: the abstract and text state that 1,800 charts were evaluated but provide no description of the search strategy, platforms, inclusion/exclusion criteria, language or domain coverage, or sampling frame. This information is required to evaluate whether the corpus supports generalization to a design space that claims to capture 'common practices.'
- [Methods] Methods section: no details are given on the qualitative coding process, including number of coders, codebook development, or any measure of inter-coder reliability. Without these, the reproducibility and robustness of the three primary aspects and the resulting design space cannot be assessed.
Simulated Author's Rebuttal
We thank the referee for their constructive comments on the methods. We agree that additional detail is needed and will revise the manuscript to address both points.
read point-by-point responses
-
Referee: [Methods] Methods section: the abstract and text state that 1,800 charts were evaluated but provide no description of the search strategy, platforms, inclusion/exclusion criteria, language or domain coverage, or sampling frame. This information is required to evaluate whether the corpus supports generalization to a design space that claims to capture 'common practices.'
Authors: We agree that the Methods section requires expansion. The revised manuscript will add a dedicated subsection detailing the search strategy (targeted queries across news sites, visualization blogs, academic papers, and public repositories), platforms sampled, inclusion/exclusion criteria (static charts containing at least one annotation; exclusion of interactive visualizations, non-chart graphics, and duplicates), language coverage (English-language sources), domain coverage (news, science, business, education), and sampling frame (stratified collection to ensure diversity across chart types). These additions will support the claim that the corpus captures common practices. revision: yes
-
Referee: [Methods] Methods section: no details are given on the qualitative coding process, including number of coders, codebook development, or any measure of inter-coder reliability. Without these, the reproducibility and robustness of the three primary aspects and the resulting design space cannot be assessed.
Authors: We acknowledge the omission. The revised Methods section will describe the coding process: two authors performed iterative open coding on an initial subset of 200 charts to develop the codebook for analytic purposes, mechanisms, and data sources; the codebook was refined through discussion; the remaining charts were coded by one author with spot-checks by the second. We will report inter-coder reliability (Cohen's kappa) computed on a 10% random sample to demonstrate robustness of the taxonomy and design space. revision: yes
Circularity Check
No circularity: empirical qualitative synthesis from external corpus
full rationale
The paper conducts qualitative coding on an external collection of 1,800 real-world static annotated charts to identify usage patterns and synthesize a design space. No equations, fitted parameters, or predictions appear; the taxonomy is presented as an inductive summary of observed practices rather than a derivation that reduces to its inputs by construction. Self-citations, if present, are not load-bearing for the central claims, which rest on the coded corpus itself. This is a standard empirical qualitative study whose validity hinges on sampling and coding rigor, not on definitional or self-referential reduction.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption The 1,800 static annotated charts form a representative sample of common annotation practices.
Reference graph
Works this paper leans on
-
[1]
K. Ajani, E. Lee, C. Xiong, C. N. Knaflic, W. Kemper, and S. Fran- coneri. Declutter and focus: Empirically evaluating design guidelines for effective data communication. IEEE Trans. on Visual Comput. Graphics, 28(10):3351–3364, 2021. doi: 10.1109/TVCG.2021.3068337 1
-
[2]
R. Amar, J. Eagan, and J. Stasko. Low-level components of analytic activity in information visualization. In IEEE InfoVis, pp. 111–117, 2005. doi: 10.1109/INFOVIS.2005.24 4
- [3]
-
[4]
S. Bateman, R. L. Mandryk, C. Gutwin, A. Genest, D. McDine, and C. Brooks. Useful junk? the effects of visual embellishment on compre- hension and memorability of charts. In ACM CHI, pp. 2573–2582, 2010. doi: 10.1145/1753326.1753716 1, 3
-
[5]
M. Borkin, Z. Bylinskii, N. W. Kim, C. M. Bainbridge, C. S. Yeh, D. Borkin, H. Pfister, and A. Oliva. Beyond memorability: Visualiza- tion recognition and recall. IEEE Trans. on Visual Comput. Graphics , 22(1):519–528, 2015. doi: 10.1109/TVCG.2015.2467732 1, 3
-
[6]
M. Borkin, A. A. V o, Z. Bylinskii, P. Isola, S. Sunkavalli, A. Oliva, and H. Pfister. What makes a visualization memorable? IEEE Trans. on Visual Comput. Graphics, 19(12):2306–2315, 2013. doi: 10.1109/TVCG.2013. 234 1, 3
-
[7]
J. Boy, F. Detienne, and J.-D. Fekete. Storytelling in information visualiza- tions: Does it engage users to explore data? In ACM CHI, pp. 1449–1458,
-
[8]
doi: 10.1145/2702123.2702452 3
-
[9]
V . Braun and V . Clarke. Thematic analysis. American Psychological Association, 2012. doi: 10.1080/17439760.2016.1262613 2
-
[10]
M. Brehmer, B. Lee, N. Henry Riche, D. Tittsworth, K. Lytvynets, D. Edge, and C. White. Timeline storyteller: The design & deployment of an in- teractive authoring tool for expressive timeline narratives. In Computa- tion+Journalism Symposium, pp. 1–5, February 2019. 3
work page 2019
-
[11]
M. Brehmer and T. Munzner. A multi-level typology of abstract visualiza- tion tasks. IEEE Trans. on Visual Comput. Graphics, 19(12):2376–2385,
-
[12]
doi: 10.1109/TVCG.2013.124 2, 4, 5, 7
-
[13]
S. Bresciani and M. J. Eppler. The benefits of synchronous collaborative information visualization: Evidence from an experimental evaluation. IEEE Trans. on Visual Comput. Graphics, 15(6):1073–1080, 2009. doi: 10.1109/TVCG.2009.188 3
-
[14]
C. Bryan, K.-L. Ma, and J. Woodring. Temporal summary images: An approach to narrative visualization via interactive annotation generation and placement. IEEE Trans. on Visual Comput. Graphics, 23(1):511–520,
-
[15]
doi: 10.1109/TVCG.2016.2598876 3
-
[16]
A. Cedilnik and P. Rheingans. Procedural annotation of uncertain infor- mation. In IEEE Visualization, pp. 77–84, 2000. doi: 10.1109/VISUAL. 2000.885679 1, 3
-
[20]
E. K. Choe, B. Lee, and M. Schraefel. Characterizing visualization in- sights from quantified selfers’ personal data presentations. IEEE Comput. Graphics Appl., 35(4):28–37, 2015. doi: 10.1109/MCG.2015.51 3
-
[21]
R. Chun. Giving guidance to graphs: Evaluating annotations of data visualizations for the news. Visual Commun. Q., 27(2):84–97, 2020. doi: 10.1080/15551393.2020.1749842 3
-
[22]
K. Dapena and P. Santilli. Rising inflation looks less severe using pre- pandemic comparisons, 2021. 8, 9
work page 2021
-
[24]
S. Ellis and D. P. Groth. A collaborative annotation system for data visualization. In Advanced Visual Interfaces, pp. 411–414. ACM, 2004. doi: 10.1145/989863.989938 1, 3
- [25]
- [26]
-
[27]
N. Ferreira, D. Fisher, and A. C. Konig. Sample-oriented task-driven visualizations: allowing users to make better, more confident decisions. In ACM CHI, pp. 571–580, 2014. doi: 10.1145/2556288.2557131 3
-
[28]
K. Gadhave, Z. Cutler, and A. Lex. Reusing interactive analysis workflows. Comput. Graphics Forum, 41(3):133–144, 2022. doi: 10.1111/cgf.14528 3
-
[29]
K. Gadhave, J. Görtler, Z. Cutler, C. Nobre, O. Deussen, M. Meyer, J. M. Phillips, and A. Lex. Predicting intent behind selections in scatterplot visualizations. Inf. Visualization, 20(4):207–228, 2021. doi: 10.1177/ 14738716211038604 3
work page 2021
-
[30]
T. Gao, J. R. Hullman, E. Adar, B. Hecht, and N. Diakopoulos. Newsviews: an automated pipeline for creating custom geovisualizations for news. In ACM CHI, pp. 3005–3014, 2014. doi: 10.1145/2556288.2557228 3
-
[31]
S. Gratzl, A. Lex, N. Gehlenborg, N. Cosgrove, and M. Streit. From visual exploration to storytelling and back again. Comput. Graphics Forum, 35(3):491–500, 2016. doi: 10.1111/cgf.12925 3
-
[32]
D. P. Groth and K. Streefkerk. Provenance and annotation for visual ex- ploration systems. IEEE Trans. on Visual Comput. Graphics, 12(6):1500– 1510, 2006. doi: 10.1109/TVCG.2006.101 3
-
[33]
J. Heer and M. Agrawala. Design considerations for collaborative visual analytics. In IEEE VAST, pp. 171–178, 2007. doi: 10.1057/palgrave.ivs. 9500167 3
-
[34]
J. Heer and B. Shneiderman. Interactive dynamics for visual analysis. Commun. ACM, 55(4):45–54, 2012. doi: 10.1145/2133806.2133821 1, 3
-
[35]
J. Heer, F. Viégas, and M. Wattenberg. V oyagers and voyeurs: supporting asynchronous collaborative information visualization. In ACM CHI, pp. 1029–1038, 2007. doi: 10.1145/1240624.1240781 3
-
[36]
J. Hoffswell, A. Satyanarayan, and J. Heer. Visual debugging techniques for reactive data visualization. Comput. Graphics Forum, 35(3):271–280,
-
[37]
doi: 10.1111/cgf.12903 3
-
[38]
A. Hopkins, M. Correll, and A. Satyanarayan. Visualint: Sketchy in situ annotations of chart construction errors. Comput. Graphics Forum, 39(3):219–228, 2020. doi: 10.1111/cgf.13975 3
-
[39]
J. Hullman and N. Diakopoulos. Visualization rhetoric: Framing effects in narrative visualization. IEEE Trans. on Visual Comput. Graphics , 17(12):2231–2240, 2011. doi: 10.1109/TVCG.2011.255 1, 3
-
[40]
J. Hullman, N. Diakopoulos, and E. Adar. Contextifier: automatic genera- tion of annotated stock visualizations. In ACM CHI, pp. 2707–2716, 2013. doi: 10.1145/2470654.2481374 2, 3
-
[41]
J. Hullman, S. Drucker, N. H. Riche, B. Lee, D. Fisher, and E. Adar. A deeper understanding of sequence in narrative visualization. IEEE Trans. on Visual Comput. Graphics, 19(12):2406–2415, 2013. doi: 10. 1109/TVCG.2013.119 3
work page 2013
-
[42]
T. Isenberg, P. Neumann, S. Carpendale, S. Nix, and S. Greenberg. Inter- active annotations on large, high-resolution information displays. In IEEE Visualization, pp. 124–125, 2006. 1
work page 2006
-
[44]
Y .-a. Kang and J. Stasko. Characterizing the intelligence analysis process through a longitudinal field study: Implications for visual analytics. Inf. Visualization, 13(2):134–158, 2014. doi: 10.1177/1473871612468877 3
- [45]
-
[46]
doi: 10.1145/3411764.3445720 3
- [47]
-
[48]
H.-K. Kong, Z. Liu, and K. Karahalios. Internal and external visual cue preferences for visualizations in presentations. Comput. Graphics Forum, 36(3):515–525, 2017. doi: 10.1111/cgf.13207 2, 3
-
[49]
H.-K. Kong, W. Zhu, Z. Liu, and K. Karahalios. Understanding visual 10 To appear in IEEE Transactions on Visualization and Computer Graphics cues in visualizations accompanied by audio narrations. In ACM CHI, pp. 1–13, 2019. doi: 10.1145/3290605.3300280 1, 3
-
[50]
N. Kong and M. Agrawala. Perceptual interpretation of ink annotations on line charts. In ACM UIST, pp. 233–236, 2009. doi: 10.1145/1622176. 1622219 3
-
[51]
N. Kong and M. Agrawala. Graphical overlays: Using layered elements to aid chart reading. IEEE Trans. on Visual Comput. Graphics, 18(12):2631– 2638, 2012. doi: 10.1109/TVCG.2012.229 2
-
[52]
R. Kosara and J. Mackinlay. Storytelling: The next step for visualization. IEEE Comput., 46(5):44–50, 2013. doi: 10.1109/MC.2013.36 3
-
[53]
B. Lee, R. Kazi, and G. Smith. Sketchstory: Telling more engaging stories with data through freeform sketching. IEEE Trans. on Visual Comput. Graphics, 19(12):2416–2425, 2013. doi: 10.1109/tvcg.2013.191 3
-
[54]
B. Lee, N. H. Riche, P. Isenberg, and S. Carpendale. More than telling a story: Transforming data into visually shared stories. IEEE Comput. Graphics Appl., 35(5):84–90, 2015. doi: 10.1109/MCG.2015.99 1
-
[55]
H. Lin, D. Akbaba, M. Meyer, and A. Lex. Data hunches: Incorporating personal knowledge into visualizations. IEEE Trans. on Visual Comput. Graphics, 29(1):504–514, 2022. doi: 10.1109/TVCG.2022.3209451 3
-
[56]
H. Lin, R. A. Metcalf, J. Wilburn, and A. Lex. Sanguine: Visual analysis for patient blood management. Inf. Visualization, 20(2-3):123–137, 2021. doi: 10.1177/14738716211028565 3
-
[57]
L. Liu, A. P. Boone, I. T. Ruginski, L. Padilla, M. Hegarty, S. H. Creem- Regehr, W. B. Thompson, C. Yuksel, and D. H. House. Uncertainty visualization by representative sampling from prediction ensembles. IEEE Trans. on Visual Comput. Graphics , 23(9):2165–2178, 2016. doi: 10. 1109/TVCG.2016.2607204 3
-
[58]
N. Mahyar, A. Sarvghad, and M. Tory. Note-taking in co-located collabora- tive visual analytics: Analysis of an observational study. Inf. Visualization, 11(3):190–204, 2012. doi: 10.1177/1473871611433713 1, 3
-
[59]
N. Mahyar and M. Tory. Supporting communication and coordination in collaborative sensemaking. IEEE Trans. on Visual Comput. Graphics, 20(12):1633–1642, 2014. doi: 10.1109/TVCG.2014.2346573 1
-
[60]
R. Martinez-Maldonado, V . Echeverria, G. Fernandez Nieto, and S. Buck- ingham Shum. From data to insights: A layered storytelling approach for multimodal learning analytics. In ACM CHI, pp. 1–15, 2020. doi: 10. 1145/3313831.3376148 3
-
[61]
D. Masson, S. Malacria, G. Casiez, and D. V ogel. Charagraph: Interactive generation of charts for realtime annotation of data-rich paragraphs. In ACM CHI, pp. 1–18, 2023. doi: 10.1145/3544548.3581091 3
-
[62]
A. Mathisen, T. Horak, C. N. Klokmose, K. Grønbæk, and N. Elmqvist. Insideinsights: Integrating data-driven reporting in collaborative visual analytics. Comput. Graphics Forum, 38(3):649–661, 2019. doi: 10.1111/ cgf.13717 3
work page 2019
-
[63]
M. L. McHugh. Interrater reliability: the kappa statistic. Biochem. Med., 22(3):276–282, 2012. doi: 10.11613/BM.2012.031 4
-
[64]
T. Munzner. Visualization analysis and design. CRC press, Boca Raton FL, 2014. doi: 10.1201/b17511 1, 2
-
[65]
Ohyicong/google-image-scraper: A library to scrap google images
Ohyicong. Ohyicong/google-image-scraper: A library to scrap google images. 3
-
[66]
A. Ottley, A. Kaszowska, R. J. Crouser, and E. M. Peck. The curious case of combining text and visualization. EuroVis (Short Papers), 2019. doi: 10.2312/evs.20191181 3
-
[67]
T. W. Post. Four charts that analyze how omicron’s wave compares to previous coronavirus peaks, 2022. 2, 8
work page 2022
- [68]
-
[69]
M. D. Rahman, G. J. Quadri, and P. Rosen. A qualitative evaluation and taxonomy of student annotations on bar charts. IEEE VIS Workshop on Visualization for Communication, 2022. doi: 10.31219/osf.io/e5vfy 4
-
[70]
M. D. Rahman, G. J. Quadri, and P. Rosen. Exploring annotation strategies in professional visualizations: Insights from prominent us news portals. IEEE VIS Workshop on Visualization for Communication, 2023. doi: 10. 31219/osf.io/fd8zj 3
work page 2023
-
[71]
D. Ren, M. Brehmer, B. Lee, T. Höllerer, and E. K. Choe. Chartaccent: Annotation for data-driven storytelling. In IEEE PacificVis, pp. 230–239,
-
[72]
doi: 10.1109/PACIFICVIS.2017.8031599 2, 3
- [74]
-
[75]
doi: 10.1145/3290605.3300272 3
-
[76]
P. M. Sanderson and C. Fisher. Exploratory sequential data analysis: Foundations. Hum.–Comput. Interact., 9(3-4):251–317, 1994. doi: 10. 1207/s15327051hci0903&4_2 3
work page 1994
-
[77]
A. Satyanarayan and J. Heer. Authoring narrative visualizations with ellipsis. Comput. Graphics Forum, 33(3):361–370, 2014. doi: 10.1111/cgf .12392 3
work page doi:10.1111/cgf 2014
-
[78]
M. Schwab, D. Saffo, Y . Zhang, S. Sinha, C. Nita-Rotaru, J. Tompkin, C. Dunne, and M. Borkin. Visconnect: Distributed event synchronization for collaborative visualization. IEEE Trans. on Visual Comput. Graphics, 27(2):347–357, 2020. doi: 10.1109/TVCG.2020.3030366 3
-
[79]
E. Segel and J. Heer. Narrative visualization: Telling stories with data. IEEE Trans. on Visual Comput. Graphics, 16(6):1139–1148, 2010. doi: 10.1109/TVCG.2010.179 1, 3
-
[80]
R. Sevastjanova, M. El-Assady, A. J. Bradley, C. Collins, M. Butt, and D. Keim. Visinreport: Complementing visual discourse analytics through personalized insight reports. IEEE Trans. on Visual Comput. Graphics, p. preprint, 2021. doi: 10.1109/TVCG.2021.3104026 3
-
[81]
Y . Shi, X. Lan, J. Li, Z. Li, and N. Cao. Communicating with motion: A design space for animated visual narratives in data videos. In ACM CHI, pp. 1–13, 2021. doi: 10.1145/3411764.3445337 3
-
[82]
Y . B. Shrinivasan, D. Gotzy, and J. Lu. Connecting the dots in visual analysis. In IEEE VAST, pp. 123–130, 2009. doi: 10.1109/V AST.2009. 5333023 1, 3
work page doi:10.1109/v 2009
-
[83]
H. Stitz, S. Gratzl, H. Piringer, T. Zichner, and M. Streit. Knowledgepearls: Provenance-based visualization retrieval. IEEE Trans. on Visual Comput. Graphics, 25(1):120–130, 2018. doi: 10.1109/TVCG.2018.2865024 3
- [84]
-
[85]
C. Stokes, V . Setlur, B. Cogley, A. Satyanarayan, and M. A. Hearst. Striking a balance: Reader takeaways and preferences when integrating text and charts. IEEE Trans. on Visual Comput. Graphics, 29(1):1233– 1243, 2022. doi: 10.1109/TVCG.2022.3209383 3
-
[86]
C. D. Stolper, B. Lee, N. Henry Riche, and J. Stasko. Emerging and recur- ring data-driven storytelling techniques: Analysis of a curated collection of recent stories. Technical Report MSR-TR-2016-14, Microsoft, April
work page 2016
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.