Visualizing Historical Book Trade Data: An Iterative Design Study with Close Collaboration with Domain Experts
Pith reviewed 2026-05-24 07:01 UTC · model grok-4.3
The pith
A visual analytics tool developed through expert collaboration helps historians explore book trade data from multiple perspectives.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
By following a variant of the Nine-Stage Framework in close collaboration with domain experts, the authors created DanteExploreVis, a visual analytics tool whose panels allow historians to explore, explain, and present book trade data from multiple perspectives, with qualitative evaluation confirming that the interface meets the stated domain requirements.
What carries the argument
DanteExploreVis, the visual analytics interface whose coordinated panels surface geographical, chronological, and relational features of book trade records.
If this is right
- Historians gain the ability to surface buried geographical and chronological patterns in book circulation records.
- The tool supports three distinct activities: exploration, explanation, and presentation of the data.
- Design choices for each panel are tied directly to requirements gathered from domain experts.
- Lessons from the process can guide similar visualization projects in the humanities.
Where Pith is reading between the lines
- The same iterative collaboration method could be tested on other historical datasets such as trade routes or migration records.
- Future versions might add quantitative logging of user interactions to complement the qualitative evaluation.
- The panels could be adapted for public-facing exhibits if the underlying data were made accessible through an online version.
Load-bearing premise
Close collaboration with domain experts via the design framework produces a tool whose value is shown adequately by qualitative feedback alone.
What would settle it
A side-by-side test in which domain experts complete pattern-identification tasks on the same book trade dataset using DanteExploreVis versus text records and show no measurable difference in speed or accuracy would challenge the central claim.
Figures
read the original abstract
The circulation of historical books has always been an area of interest for historians. However, the data used to represent the journey of a book across different places and times can be difficult for domain experts to digest due to buried geographical and chronological features within text-based presentations. This situation provides an opportunity for collaboration between visualization researchers and historians. This paper describes a design study where a variant of the Nine-Stage Framework was employed to develop a Visual Analytics (VA) tool called DanteExploreVis. This tool was designed to aid domain experts in exploring, explaining, and presenting book trade data from multiple perspectives. We discuss the design choices made and how each panel in the interface meets the domain requirements. We also present the results of a qualitative evaluation conducted with domain experts. The main contributions of this paper include: 1) the development of a VA tool to support domain experts in exploring, explaining, and presenting book trade data; 2) a comprehensive documentation of the iterative design, development, and evaluation process following the variant Nine-Stage Framework; 3) a summary of the insights gained and lessons learned from this design study in the context of the humanities field; and 4) reflections on how our approach could be applied in a more generalizable way.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper claims to have developed DanteExploreVis, a visual analytics tool for historians to explore, explain, and present historical book trade data from multiple perspectives, by following a variant of the Nine-Stage Framework in an iterative design study with domain experts. It documents the design process, interface panels and choices, qualitative evaluation results, insights and lessons learned in the humanities, and reflections on broader applicability. The four listed contributions center on the tool itself, the process documentation, humanities-specific insights, and generalizability reflections.
Significance. If the claims hold, the work adds a documented design-study case in the humanities to the visualization literature, where such examples remain relatively sparse. Explicit credit is due for the transparent documentation of the iterative process (including how domain requirements shaped panels) and the use of close expert collaboration rather than purely researcher-driven design. The paper correctly positions itself within the standard evidentiary norms of design studies by relying on qualitative feedback without claiming quantitative superiority or broad generalizability.
major comments (2)
- [§5] §5 (Evaluation): the qualitative results are summarized at a high level without reporting participant count, session protocol, or direct mappings from expert feedback to specific design changes or domain-requirement satisfaction; this leaves the central claim that the tool effectively supports exploration/explanation/presentation only moderately supported.
- [§4] §4 (DanteExploreVis description): while each panel is said to meet domain requirements, the text does not provide concrete examples of how particular visual encodings or interactions address the 'buried geographical and chronological features' mentioned in the abstract, weakening the ability to assess the design rationale.
minor comments (2)
- [Abstract] Abstract: the sentence on evaluation results could preview one or two concrete outcomes rather than stating only that an evaluation 'was conducted.'
- [§3] The variant of the Nine-Stage Framework is referenced repeatedly; a brief explicit list of the modifications (e.g., in §3) would improve traceability for readers unfamiliar with the original framework.
Simulated Author's Rebuttal
We thank the referee for the constructive feedback and the recommendation of minor revision. The comments highlight opportunities to strengthen the evidentiary support in the evaluation and to make the design rationale more explicit. We address both points below and will incorporate the requested details in the revised manuscript.
read point-by-point responses
-
Referee: [§5] §5 (Evaluation): the qualitative results are summarized at a high level without reporting participant count, session protocol, or direct mappings from expert feedback to specific design changes or domain-requirement satisfaction; this leaves the central claim that the tool effectively supports exploration/explanation/presentation only moderately supported.
Authors: We agree that the current summary of the qualitative evaluation is high-level and would benefit from additional detail to more firmly support the claims. In the revised manuscript we will expand §5 to report the exact number of domain-expert participants, describe the session protocol (including duration, tasks, and interview format), and provide explicit mappings that link individual pieces of expert feedback to concrete design changes and to the satisfaction of the stated domain requirements. revision: yes
-
Referee: [§4] §4 (DanteExploreVis description): while each panel is said to meet domain requirements, the text does not provide concrete examples of how particular visual encodings or interactions address the 'buried geographical and chronological features' mentioned in the abstract, weakening the ability to assess the design rationale.
Authors: We will revise §4 to supply concrete examples that directly connect specific visual encodings and interactions to the buried geographical and chronological features highlighted in the abstract. For each relevant panel we will illustrate, with reference to the data, how the chosen encodings surface patterns that remain hidden in the original text-based records, thereby clarifying the design rationale. revision: yes
Circularity Check
No significant circularity identified
full rationale
The paper is a standard visualization design study documenting an iterative process (variant of Nine-Stage Framework) and qualitative expert feedback for the DanteExploreVis tool. No equations, fitted parameters, predictions, or self-referential definitions appear. Claims rest on described collaboration and external domain-expert input rather than any reduction to the paper's own inputs by construction. The Nine-Stage Framework is an external reference, not a self-citation chain. This matches the expected evidentiary standard for such papers with no load-bearing circular steps.
Axiom & Free-Parameter Ledger
axioms (2)
- domain assumption The Nine-Stage Framework (or a close variant) is an appropriate and effective structure for iterative visualization design studies involving domain experts.
- domain assumption Qualitative evaluation with domain experts provides reliable evidence that a visualization tool meets requirements for exploring, explaining, and presenting data.
Reference graph
Works this paper leans on
-
[1]
A. Abdul-Rahman, E. Maguire, and M. Chen. Comparing Three Designs of Macro-Glyphs for Poetry Visualization. In N. Elmqvist, M. Hlaw- itschka, and J. Kennedy, eds., EuroVis - Short Papers. The Eurographics Association, 2014. doi: 10.2312/eurovisshort.20141165 2
- [2]
-
[3]
Agafonkin and other contributors
V . Agafonkin and other contributors. Leaflet: A JavaScript library for interactive maps. https://leafletjs.com, 2021. Accessed: 2023-03-
work page 2021
-
[4]
T. Arnold, N. Ayers, J. Madron, R. Nelson, and L. Tilton. Visualizing a large spatiotemporal collection of historic photography with a generous interface. In 2020 IEEE 5th Workshop on Visualization for the Digital Humanities (VIS4DH), pp. 30–35. IEEE, 2020. doi: 10.1109/VIS4DH51463. 2020.00010 2
-
[5]
M. Bostock. D3.js - data-driven documents. https://d3js.org/, 2011. Accessed: 2023-03-02. 6
work page 2011
-
[6]
M. Brehmer. Why Visualization? Task Abstraction for Analysis and Design. PhD thesis, University of British Columbia, April 2016. 3, 5
work page 2016
-
[7]
M. Brehmer, S. Ingram, J. Stray, and T. Munzner. Overview: The design, adoption, and analysis of a visual document mining tool for investigative journalists. IEEE Trans. Visualization & Computer Graphics, 20(12):2271– 2280, 2014. doi: 10.1109/TVCG.2014.2346431 2, 3
-
[8]
M. Brehmer and T. Munzner. A multi-level typology of abstract visualiza- tion tasks. IEEE Transactions on Visualization and Computer Graphics, 19(12):2376–2385, 2013. doi: 10.1109/TVCG.2013.124 5
-
[9]
M. Brhel, H. Meth, A. Maedche, and K. Werder. Exploring principles of user-centered agile software development: A literature review.Information and Software Technology, 61:163–181, 2015. doi: 10.1016/j.infsof.2015.01. 004 2
- [10]
-
[11]
B. Buxton. Sketching user experiences: getting the design right and the right design. Morgan kaufmann, 2010. 2
work page 2010
-
[12]
B. Camburn, V . Viswanathan, J. Linsey, D. Anderson, D. Jensen, R. Craw- ford, K. Otto, and K. Wood. Design prototyping methods: state of the art in strategies, techniques, and guidelines. Design Science, 3:e13, 2017. doi: 10.1017/dsj.2017.10 2
-
[13]
R. P. G. Cavalcante. React-leaflet-ant-path. https://github.com/ rubenspgcavalcante/react-leaflet-ant-path , 2021. Accessed: 2023-03-02. 7
work page 2021
-
[14]
C. CERL. Material Evidence in Incunabula. https://data.cerl.org/ mei/_search, 2015. 1, 2
work page 2015
-
[15]
C. CERL. MEI map. http://documents.cerl.org/jupyter/mei_ map_current.html, 2021. Accessed: 2023-03-02. 3
work page 2021
- [16]
-
[17]
A. Ciula, M. Vieira, G. Ferraro, T. Ong, S. Perovic, R. Mucignat, N. Val- mori, B. Deseure, and E. J. Mannucci. Small data and process in data visualization: The radical translations case study. In 2021 IEEE 6th Work- shop on Visualization for the Digital Humanities (VIS4DH), pp. 1–6. IEEE,
work page 2021
-
[18]
doi: 10.48550/arXiv.2110.09349 2
-
[19]
T. S. Da Silva, A. Martin, F. Maurer, and M. Silveira. User-centered design and agile methods: a systematic review. In 2011 AGILE conference, pp. 77–86. IEEE, 2011. doi: 10.1109/AGILE.2011.24 2
-
[20]
B. Dingman, G. W. Tigwell, and K. Shinohara. Interview and think aloud accessibility for deaf and hard of hearing participants in design research. In Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility. Association for Computing Machinery, New York, NY , USA, 2021. doi:10.1145/3441852.3476526 3
-
[21]
C. Dondi. “15cBooktrade”: An evidence-based assessment and visu- alization of the distribution, sale and reception of printed books in the renaissance. Gazette du livre médiéval , 60(1):83–101, 2013. doi: 10. 3406/galim.2013.2035 2
-
[22]
C. Dondi. From the 15cBOOKTRADE Project website. https:// 15cbooktrade.ox.ac.uk/, (accessed in 2021). 2
work page 2021
-
[23]
B. Dumas, B. Moerman, S. Trullemans, and B. Signer. Artvis: Combining advanced visualisation and tangible interaction for the exploration, analysis and browsing of digital artwork collections. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces, A VI ’14, p. 65–72. Association for Computing Machinery, New York, NY , USA,
work page 2014
-
[24]
doi: 10.1145/2598153.2598159 3
-
[25]
D. Edelstein, P. Findlen, G. Ceserani, C. Winterer, and N. Coleman. Histor- ical Research in a Digital Age: Reflections from the Mapping the Republic of Letters Project. The American Historical Review, 122(2):400–424, 03
-
[26]
doi: 10.1093/ahr/122.2.400 3
-
[27]
J. Eirich, J. Bonart, D. Jackle, M. Sedlmair, U. Schmid, K. Fischbach, T. Schreck, and J. Bernard. Irvine: A design study on analyzing correlation patterns of electrical engines. IEEE Trans. Visualization & Computer Graphics, 28(01):11–21, 2022. doi: 10.1109/TVCG.2021.3114797 2
-
[28]
I. Etikan and K. Bala. Sampling and sampling methods. Biometrics & Biostatistics International Journal, 5(6):00149, 2017. doi: 10.15406/bbij. 2017.05.00149 8
-
[29]
I. Etikan, S. A. Musa, R. S. Alkassim, et al. Comparison of convenience sampling and purposive sampling. American Journal of Theoretical and Applied Statistics, 5(1):1–4, 2016. doi: 10.11648/j.ajtas.20160501.11 8
-
[30]
M. E. Fonteyn, B. Kuipers, and S. J. Grobe. A description of think aloud method and protocol analysis. Qualitative health research, 3(4):430–441,
-
[31]
doi: 10.1177/104973239300300403 3
-
[32]
C. Forsell and M. Cooper. A guide to reporting scientific evaluation in visualization. In Proceedings of the International Working Conference on Advanced Visual Interfaces, p. 608–611. Association for Computing Machinery, New York, NY , USA, 2012. doi:10.1145/2254556.2254668 3
-
[33]
D. Guo. Visual analytics of spatial interaction patterns for pandemic decision support. International Journal of Geographical Information Science, 21(8):859–877, 2007. doi: 10.1080/13658810701349037 3
-
[34]
J. He, H. Chen, Y . Chen, X. Tang, and Y . Zou. Variable-based spatiotem- poral trajectory data visualization illustrated. IEEE Access, 7:143646– 143672, 2019. doi: 10.1109/ACCESS.2019.2942844 3
-
[35]
A., Hekker, S., Stello, D., Guti ´errez-Soto, J., Handberg, R., Huber, D., et al
D. Holten and J. van Wijk. Force-directed edge bundling for graph visu- alization. Comput. Graph. Forum, 28:983–990, 06 2009. doi: 10.1111/j. 1467-8659.2009.01450.x 3, 5, 7
work page doi:10.1111/j 2009
-
[36]
W. Huang, ed. Handbook of Human Centric Visualization. Springer New York, NY , New York, NY , 1 ed., 2014. doi:10.1007/978-1-4614-7485-2 3
-
[37]
X. Huang, Y . Zhao, C. Ma, J. Yang, X. Ye, and C. Zhang. Trajgraph: A graph-based visual analytics approach to studying urban network central- ities using taxi trajectory data. IEEE Trans. Visualization & Computer Graphics, 22(1):160–169, 2016. doi: 10.1109/TVCG.2015.2467771 3
-
[38]
C. Ling and E. C. Delmelle. Classifying multidimensional trajectories of neighbourhood change: A self-organizing map and k-means approach. Annals of GIS, 22(3):173–186, 2016. doi: 10.1080/19475683.2016.1191545 3
- [39]
-
[40]
S. McKenna, D. Mazur, J. Agutter, and M. Meyer. Design activity frame- work for visualization design. IEEE Trans. Visualization & Computer Graphics, 20(12):2191–2200, 2014. doi: 10.1109/TVCG.2014.2346331 2, 9
-
[41]
V . Müller, C. Sieg, and L. Linsen. Uncertainty-aware topic modeling visualization. In 2021 IEEE 6th Workshop on Visualization for the Digital Humanities (VIS4DH), pp. 12–18. IEEE Computer Society, Los Alamitos, CA, USA, 2021. doi: 10.1109/VIS4DH53644.2021.00007 2
-
[42]
T. Munzner. A nested model for visualization design and validation. IEEE Trans. Visualization & Computer Graphics, 15(6):921–928, 2009. doi: 10. 1109/TVCG.2009.111 2
work page 2009
-
[43]
T. Munzner. Visualization Analysis and Design. AK Peters Visualization Series. CRC Press, 2014. 3, 5
work page 2014
-
[44]
J. Nielsen. Usability Engineering. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1994. 3, 8
work page 1994
-
[45]
C. Nobre, N. Gehlenborg, H. Coon, and A. Lex. Lineage: Visualizing multivariate clinical data in genealogy graphs. IEEE Trans. Visualization & Computer Graphics, 25(3):1543–1558, 2019. doi: 10.1109/TVCG.2018. 2811488 2
-
[46]
M. Oppermann and T. Munzner. Data-first visualization design studies. In 2020 IEEE Workshop on Evaluation and Beyond-Methodological Ap- proaches to Visualization (BELIV), pp. 74–80. IEEE Computer Society, Los Alamitos, CA, USA, 2020. doi: 10.1109/BELIV51497.2020.00016 2
-
[47]
G. Prickman, A. Holland, and R. Shepard. The Atlas of Early Printing. https://atlas.lib.uiowa.edu/, (accessed in 2021). 3
work page 2021
-
[48]
https://www.qualtrics.com, 2005
Qualtrics. https://www.qualtrics.com, 2005. Accessed: 2022-11-21. 8
work page 2005
-
[49]
D. Redin, D. Vilela, N. Nunes, M. Ribeiro, and C. Prandi. Vitflow: a 10 © 2023 IEEE. This is the author’s version of the article that has been published in IEEE Transactions on Visualization and Computer Graphics. The final version of this record is available at: xx.xxxx/TVCG.201x.xxxxxxx/ platform to visualize tourists flows in a rich interactive map-bas...
-
[50]
M. Sedlmair, M. Meyer, and T. Munzner. Design study methodology: Reflections from the trenches and the stacks. IEEE Trans. Visualization & Computer Graphics, 18(12):2431–2440, 2012. doi: 10.1109/TVCG.2012.213 1, 2, 3
- [51]
-
[52]
A. Skupin and R. Hagelman. Visualizing demographic trajectories with self-organizing maps. GeoInformatica, 9(2):159–179, 2005. doi: 10.1007/ s10707-005-6670-2 3
work page 2005
- [53]
-
[54]
U. H. Syeda, P. Murali, L. Roe, B. Berkey, and M. A. Borkin. Design study “lite” methodology: Expediting design studies and enabling the synergy of visualization pedagogy and social good. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, CHI ’20, pp. 1–13. Association for Computing Machinery, 2020. doi: 10.1145/3313831. 3376829 2
-
[55]
M. Tory and T. Möller. Evaluating visualizations: Do expert reviews work? IEEE Computer Graphics & Applications, 25(5):8–11, 2005. doi: 10.1109/MCG.2005.102 3
-
[56]
T. Vancisin, M. Orr, and U. Hinrichs. Externalizing transformations of historical documents: Opportunities for provenance-driven visualization. In 2020 IEEE 5th Workshop on Visualization for the Digital Humanities (VIS4DH), pp. 36–42. IEEE, 2020. doi: 10.1109/VIS4DH51463.2020.00011 2
-
[57]
M. Winter, H. Baumeister, U. Frick, M. Tallon, M. Reichert, and R. Pryss. Exploring the usability of the german covid-19 contact tracing app in a combined eye tracking and retrospective think aloud study. 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), pp. 2215–2221, 2021. doi: 10.1109/EMBC46164. 202...
-
[58]
J. Wood, J. Dykes, and A. Slingsby. Visualisation of origins, destinations and flows with od maps. The Cartographic Journal, 47(2):117–129, 2010. doi: 10.1179/000870410X12658023467367 3
-
[59]
Y . Xing, C. Dondi, R. Borgo, and A. Abdul-Rahman. A Design Study of Visualizing Historical Book Movement. In M. Agus, W. Aigner, and T. Hoellt, eds.,EuroVis 2022 - Short Papers. The Eurographics Association,
work page 2022
-
[60]
doi: 10.2312/evs.20221100 1, 2
- [61]
-
[62]
P. Zhang, J. Carey, D. Te’eni, and M. Tremaine. Integrating human- computer interaction development into the systems development life cycle: a methodology. Communications of the Association for Information Sys- tems, 15(1):29, 2005. doi: 10.17705/1CAIS.01529 2
-
[63]
W. Zhang, J. K. Wong, X. Wang, Y . Gong, R. Zhu, K. Liu, Z. Yan, S. Tan, H. Qu, S. Chen, et al. Cohortva: A visual analytic system for interactive exploration of cohorts based on historical data. IEEE Trans. Visualization & Computer Graphics, 29(1):756–766, 2023. doi: 10.1109/ TVCG.2022.3209483 2
- [64]
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.