pith. sign in

arxiv: 2604.15342 · v1 · submitted 2026-03-13 · 💻 cs.HC

SuperProvenanceWidgets: Tracking and Visualizing Analytic Provenance Across UI Control Elements

Antariksh Verma , Kaustubh Odak , Arpit Narechania This is my paper

Pith reviewed 2026-05-15 11:28 UTC · model grok-4.3

classification 💻 cs.HC
keywords provenance trackingUI visualizationanalytic workflowsuser interface designinteraction loggingbias mitigation
0
0 comments X

The pith

SuperProvenanceWidgets extends tracking of user interactions to span multiple UI controls simultaneously.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper presents SuperProvenanceWidgets as an extension to the ProvenanceWidgets library. It adds a SuperWidget that tracks and visualizes provenance across several UI elements rather than one at a time. Through three example scenarios the authors show how this helps audit workflows, reduce biases in exploration, and improve interface design. A self-assessment with Cognitive Dimensions of Notations evaluates developer usability. The library is released as open source.

Core claim

SuperProvenanceWidgets features a new SuperWidget that tracks recency and frequency of interactions across multiple UI controls and overlays this information to show how, when, and whether different controls were used.

What carries the argument

The SuperWidget, a cross-control component that aggregates provenance data from individual UI controls to provide a unified view of usage patterns.

If this is right

  • Analysis workflows can be audited and shared more transparently.
  • Users can identify and address biases in how they explore data through different controls.
  • Developers gain insights for designing and personalizing user interfaces based on actual usage.
  • The Cognitive Dimensions assessment guides improvements in the library's notation for developers.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • Integration into existing tools could make provenance tracking standard in data analysis software.
  • Future work might quantify the bias mitigation effects in controlled experiments.
  • Similar cross-element tracking could apply to other domains like web forms or dashboard interfaces.

Load-bearing premise

The three example usage scenarios and the Cognitive Dimensions self-assessment suffice to demonstrate the SuperWidget's practical value without user studies or quantitative evaluations.

What would settle it

A controlled user study measuring no significant improvement in workflow auditing or bias reduction when using the SuperWidget compared to individual widgets.

Figures

Figures reproduced from arXiv: 2604.15342 by Antariksh Verma, Arpit Narechania, Kaustubh Odak.

Figure 1
Figure 1. Figure 1: SuperProvenanceWidgets: a JavaScript library comprising UI controls and a [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Figure 2: Different representations of user interactions (a) as a Sankey flow diagram and (b) as a Gantt chart. [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: Two checkboxes with different interaction statuses [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figure 5
Figure 5. Figure 5: Temporal View: (a) empty interaction status, (b) inter [PITH_FULL_IMAGE:figures/full_fig_p004_5.png] view at source ↗
Figure 6
Figure 6. Figure 6: Scenario: (a) Widgets are out of viewport during a [PITH_FULL_IMAGE:figures/full_fig_p005_6.png] view at source ↗
Figure 7
Figure 7. Figure 7: High-level process diagram for offline UI layout [PITH_FULL_IMAGE:figures/full_fig_p006_7.png] view at source ↗
read the original abstract

ProvenanceWidgets is an existing JavaScript library that tracks the recency and frequency of user interactions with individual UI controls (e.g., range sliders and dropdowns) and dynamically overlays this provenance onto them. In this work, we introduce SuperProvenanceWidgets, an extension to ProvenanceWidgets featuring a new SuperWidget that similarly tracks and visualizes provenance but across multiple UI controls, enabling users to understand how, when, and whether different UI controls were used. Through three example usage scenarios, we demonstrate how this cross-control SuperWidget helps (a) audit and share analysis workflows, (b) surface and mitigate exploration biases, and (c) facilitate user interface design and personalization. We also perform a technical self-assessment using the Cognitive Dimensions of Notations to evaluate the library's usability for developers. SuperProvenanceWidgets is integrated into the ProvenanceWidgets library and is available as open-source software at ProvenanceWidgets.github.io, empowering developers to build advanced provenance applications.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

1 major / 0 minor

Summary. The manuscript introduces SuperProvenanceWidgets as an extension to the existing ProvenanceWidgets JavaScript library. The key addition is a SuperWidget that tracks and visualizes analytic provenance across multiple UI controls (rather than per-control). Utility is illustrated via three usage scenarios for workflow auditing, bias surfacing/mitigation, and UI design/personalization; the authors also include a technical self-assessment via the Cognitive Dimensions of Notations framework. The library is released as open-source software integrated with the original ProvenanceWidgets repository.

Significance. If the cross-control tracking functions as described, the work supplies a concrete, reusable component for provenance-aware interfaces that could support more transparent analytic workflows. The open-source release and integration with an established library are clear strengths. The significance for practical HCI applications is reduced, however, because the utility claims rest entirely on illustrative scenarios and a developer-oriented self-assessment rather than any user evaluation or quantitative outcome measures.

major comments (1)
  1. [three example usage scenarios] The central claims that the SuperWidget 'helps (a) audit and share analysis workflows, (b) surface and mitigate exploration biases, and (c) facilitate user interface design and personalization' are supported solely by three illustrative scenarios (described in the abstract and the usage-scenarios portion of the manuscript). No user studies, controlled comparisons, bias-detection metrics, task-performance data, or other empirical validation are reported. This directly affects the strength of the practical-utility assertions.

Simulated Author's Rebuttal

1 responses · 0 unresolved

We thank the referee for the constructive feedback and for recognizing the value of the open-source release and integration with the existing ProvenanceWidgets library. We address the major comment below.

read point-by-point responses

  1. Referee: [three example usage scenarios] The central claims that the SuperWidget 'helps (a) audit and share analysis workflows, (b) surface and mitigate exploration biases, and (c) facilitate user interface design and personalization' are supported solely by three illustrative scenarios (described in the abstract and the usage-scenarios portion of the manuscript). No user studies, controlled comparisons, bias-detection metrics, task-performance data, or other empirical validation are reported. This directly affects the strength of the practical-utility assertions.

    Authors: We agree that the practical-utility assertions rest on illustrative scenarios rather than empirical user studies or quantitative metrics. The manuscript presents SuperProvenanceWidgets as a systems contribution: a reusable JavaScript extension that adds cross-control provenance tracking. The three scenarios are designed to demonstrate how the SuperWidget's functionality can be applied in realistic contexts (workflow auditing, bias surfacing, and UI personalization), consistent with how other HCI toolkits and libraries are typically introduced. The Cognitive Dimensions of Notations assessment supplies a developer-oriented evaluation of the library's usability. To strengthen alignment between claims and evidence, we will revise the abstract and the usage-scenarios section to explicitly characterize the scenarios as illustrative examples of potential use rather than validated outcomes. This is a minor textual clarification. revision: yes

Circularity Check

0 steps flagged

No significant circularity in the derivation chain

full rationale

The paper introduces SuperProvenanceWidgets as a direct code extension to the cited ProvenanceWidgets library, with utility shown through three new illustrative scenarios and a standard Cognitive Dimensions self-assessment. No mathematical derivations, equations, predictions, fitted parameters, or uniqueness theorems are present. The central contribution consists of independent new functionality and examples that do not reduce to self-definitions, fitted inputs renamed as predictions, or load-bearing self-citations; the prior library serves as external foundation rather than a circular premise.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 1 invented entities

The paper introduces a software component without fitted parameters, unstated axioms, or new postulated entities beyond the named SuperWidget; it relies on standard web development practices and the existing library.

invented entities (1)
  • SuperWidget no independent evidence
    purpose: To track and visualize provenance across multiple UI controls simultaneously
    New component introduced in the extension to enable cross-control tracking, with no independent evidence provided beyond the implementation description.

pith-pipeline@v0.9.0 · 5476 in / 1134 out tokens · 41571 ms · 2026-05-15T11:28:51.740871+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

49 extracted references · 49 canonical work pages

  1. [1]

    Wolfgang Aigner, Stephan Hoffmann, and Alexander Rind. 2013. Evalbench: A software library for visualization evaluation. InComputer Graphics Forum, Vol. 32. Wiley Online Library, 41–50. doi:10.1111/cgf.12091

    work page doi:10.1111/cgf.12091 2013

  2. [2]

    Sriram Karthik Badam, Zehua Zeng, Emily Wall, Alex Endert, and Niklas Elmqvist

    work page

  3. [3]

    InGraphics Interface

    Supporting Team-First Visual Analytics through Group Activity Represen- tations.. InGraphics Interface. 208–213. doi:10.5555/3141475.3141515

    work page doi:10.5555/3141475.3141515

  4. [4]

    Patrick Baudisch, Desney Tan, Maxime Collomb, Dan Robbins, Ken Hinckley, Maneesh Agrawala, Shengdong Zhao, and Gonzalo Ramos. 2006. Phosphor: explaining transitions in the user interface using afterglow effects. InProceedings of the 19th annual ACM symposium on User interface software and technology. 169–178. doi:10.1145/1166253.1166280

    work page doi:10.1145/1166253.1166280 2006

  5. [5]

    Louis Bavoil, Steven P Callahan, Patricia J Crossno, Juliana Freire, Carlos E Scheidegger, Cláudio T Silva, and Huy T Vo. 2005. Vistrails: Enabling interactive multiple-view visualizations. InVIS 05. IEEE Visualization, 2005.IEEE, 135–142. doi:10.1109/VISUAL.2005.1532788

    work page doi:10.1109/visual.2005.1532788 2005

  6. [6]

    Alan F Blackwell, Carol Britton, Anna Cox, Thomas RG Green, Corin Gurr, Gada Kadoda, Maria S Kutar, Martin Loomes, Chrystopher L Nehaniv, Marian Pe- tre, et al. 2001. Cognitive dimensions of notations: Design tools for cognitive technology. InCognitive Technology: Instruments of Mind: 4th International Con- ference, CT 2001 Coventry, UK, August 6–9, 2001 ...

    work page doi:10.1007/3-540-44617-6_31 2001

  7. [7]

    Jeremy E Block, Shaghayegh Esmaeili, Eric D Ragan, John R Goodall, and G David Richardson. 2023. The Influence of Visual Provenance Representa- tions on Strategies in a Collaborative Hand-off Data Analysis Scenario.IEEE Transactions on Visualization and Computer Graphics29, 1 (2023), 1113–1123. doi:10.1109/TVCG.2022.3209495

    work page doi:10.1109/tvcg.2022.3209495 2023

  8. [8]

    Zoya Bylinskii, Nam Wook Kim, Peter O’Donovan, Sami Alsheikh, Spandan Madan, Hanspeter Pfister, Fredo Durand, Bryan Russell, and Aaron Hertzmann

    work page

  9. [9]

    InACM UIST

    Learning Visual Importance for Graphic Designs and Data Visualizations. InACM UIST

    work page

  10. [10]

    Steven P Callahan, Juliana Freire, Emanuele Santos, Carlos E Scheidegger, Cláu- dio T Silva, and Huy T Vo. 2006. VisTrails: visualization meets data management. InProceedings of the 2006 ACM SIGMOD international conference on Management of data. 745–747. doi:10.1145/1142473.1142574

    work page doi:10.1145/1142473.1142574 2006

  11. [11]

    Akhilesh Camisetty, Chaitanya Chandurkar, Maoyuan Sun, and David Koop

    work page

  12. [12]

    Enhancing Web-based Analytics Applications through Provenance.IEEE Transactions on Visualization and Computer Graphics25 (2019), 131–141. doi:10. 1109/TVCG.2018.2865039

    work page arXiv 2019

  13. [13]

    Yang Chen, Scott Barlowe, and Jing Yang. 2010. Click2Annotate: Automated Insight Externalization with Rich Semantics. In2010 IEEE Symposium on Visual Analytics Science and Technology. IEEE, 155–162

    work page 2010

  14. [14]

    Zach Cutler, Kiran Gadhave, and Alexander Lex. 2020. Trrack: A library for provenance-tracking in web-based visualizations. In2020 IEEE Visualization Conference (VIS). IEEE, 116–120. doi:10.1109/VIS47514.2020.00030

    work page doi:10.1109/vis47514.2020.00030 2020

  15. [15]

    Dijkstra

    Edsger W. Dijkstra. 1982.On the Role of Scientific Thought. Springer New York, New York, NY, 60–66. doi:10.1007/978-1-4612-5695-3_12

    work page doi:10.1007/978-1-4612-5695-3_12 1982

  16. [16]

    Yiren Ding, Jack Wilburn, Hilson Shrestha, Akim Ndlovu, Kiran Gadhave, Car- olina Nobre, Alexander Lex, and Lane Harrison. 2023. reVISit: Supporting Scalable Evaluation of Interactive Visualizations. In2023 IEEE Visualization and Visual Analytics (VIS). 31–35. doi:10.1109/VIS54172.2023.00015

    work page doi:10.1109/vis54172.2023.00015 2023

  17. [17]

    Anders Drachen. 2015. Behavioral telemetry in games user research.Game user experience evaluation(2015), 135–165. doi:10.1007/978-3-319-15985-0_7

    work page doi:10.1007/978-3-319-15985-0_7 2015

  18. [18]

    Cody Dunne, Nathalie Henry Riche, Bongshin Lee, Ronald Metoyer, and George Robertson. 2012. GraphTrail: Analyzing large multivariate, heterogeneous net- works while supporting exploration history. InProceedings of the SIGCHI Confer- ence on Human Factors in Computing Systems. 1663–1672. doi:10.1145/2207676. 2208293

    work page doi:10.1145/2207676 2012

  19. [19]

    Klaus Eckelt, Kiran Gadhave, Alexander Lex, and Marc Streit. 2023. Loops: Leveraging Provenance and Visualization to Support Exploratory Data Analysis in Notebooks.OSF Preprint(2023). doi:10.31219/osf.io/79eyn

    work page doi:10.31219/osf.io/79eyn 2023

  20. [20]

    Tommy Ellkvist, David Koop, Erik W Anderson, Juliana Freire, and Cláudio Silva

    work page

  21. [21]

    InProvenance and Annotation of Data and Processes

    Using Provenance to Support Real-Time Collaborative Design of Workflows. InProvenance and Annotation of Data and Processes

    work page

  22. [22]

    Alex Endert, Patrick Fiaux, and Chris North. 2012. Semantic Interaction for Sensemaking: Inferring Analytical Reasoning for Model Steering.IEEE Transactions on Visualization and Computer Graphics18, 12 (2012), 2879–2888. doi:10.1109/TVCG.2012.260

    work page doi:10.1109/tvcg.2012.260 2012

  23. [23]

    Peck, and Lane Harrison

    Mi Feng, Cheng Deng, Evan M. Peck, and Lane Harrison. 2017. HindSight: En- couraging Exploration through Direct Encoding of Personal Interaction History. IEEE Transactions on Visualization and Computer Graphics23, 1 (2017), 351–360. doi:10.1109/TVCG.2016.2599058

    work page doi:10.1109/tvcg.2016.2599058 2017

  24. [24]

    Kiran Gadhave, Zach Cutler, and Alexander Lex. 2024. Persist: Persistent and Reusable Interactions in Computational Notebooks. InComputer Graphics Forum

    work page 2024

  25. [25]

    Steven Gomez and David Laidlaw. 2012. Modeling Task Performance for a Crowd of Users from Interaction Histories. InACM CHI

    work page 2012

  26. [26]

    googleanalytics [n. d.]. Google Analytics. https://marketingplatform.google.com/ about/analytics. Accessed: June 15, 2024

    work page 2024

  27. [27]

    Samuel Gratzl, Alexander Lex, Nils Gehlenborg, Nicola Cosgrove, and Marc Streit

    work page

  28. [28]

    InComputer Graphics Forum

    From Visual Exploration to Storytelling and Back Again. InComputer Graphics Forum

    work page

  29. [29]

    Troy Costa Kohwalter, Leonardo Gresta Paulino Murta, and Esteban Walter Gon- zalez Clua. 2017. Capturing game telemetry with provenance. In2017 16th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames). IEEE, 66–75. doi:10.1109/SBGames.2017.00016

    work page doi:10.1109/sbgames.2017.00016 2017

  30. [30]

    Zhicheng Liu and Jeffrey Heer. 2014. The Effects of Interactive Latency on Exploratory Visual Analysis.IEEE Transactions on Visualization and Computer Graphics20, 12 (2014), 2122–2131

    work page 2014

  31. [31]

    Karthic Madanagopal, Eric D Ragan, and Perakath Benjamin. 2019. Analytic provenance in practice: The role of provenance in real-world visualization and data analysis environments.IEEE Computer Graphics and Applications39, 6 (2019), 30–45. doi:10.1109/MCG.2019.2933419

    work page doi:10.1109/mcg.2019.2933419 2019

  32. [32]

    George A Miller. 1994. The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information.Psychological Review101, 2 (1994), 343

    work page 1994

  33. [33]

    Arpit Narechania, Adam Coscia, Emily Wall, and Alex Endert. 2022. Lumos: Increasing Awareness of Analytic Behavior during Visual Data Analysis.IEEE Transactions on Visualization and Computer Graphics28, 1 (2022), 1009–1018. doi:10.1109/TVCG.2021.3114827

    work page doi:10.1109/tvcg.2021.3114827 2022

  34. [34]

    Arpit Narechania, Shunan Guo, Eunyee Koh, Alex Endert, and Jane Hoffswell

    work page

  35. [35]

    doi:10.1109/TVCG.2025.3571708

    Utilizing Provenance as an Attribute for Visual Data Analysis: A Design Probe with ProvenanceLens.IEEE Transactions on Visualization and Computer Graphics(2025). doi:10.1109/TVCG.2025.3571708

    work page doi:10.1109/tvcg.2025.3571708 2025

  36. [36]

    Arpit Narechania, Kaustubh Odak, Mennatallah El-Assady, and Alex Endert. 2024. ProvenanceWidgets: A Library of UI Control Elements to Track and Dynamically Overlay Analytic Provenance.IEEE Transactions on Visualization and Computer Graphics(2024)

    work page 2024

  37. [37]

    2024.Designing, Developing, and Democratizing Guidance for Visual Analytics

    Arpit Ajay Narechania. 2024.Designing, Developing, and Democratizing Guidance for Visual Analytics. Ph. D. Dissertation. Georgia Institute of Technology

    work page 2024

  38. [38]

    Phong H Nguyen, Kai Xu, Andy Bardill, Betul Salman, Kate Herd, and BL William Wong. 2016. SenseMap: Supporting Browser-based Online Sensemaking through Analytic Provenance. InIEEE V AST

    work page 2016

  39. [39]

    Chris North, Remco Chang, Alex Endert, Wenwen Dou, Richard May, Bill Pike, and Glenn Fink. 2011. Analytic provenance: process+ interaction+ insight. In CHI’11 Extended Abstracts on Human Factors in Computing Systems. 33–36. doi:10. 1145/1979742.1979570

    work page arXiv 2011

  40. [40]

    Jamal R Paden, Arpit Narechania, and Alex Endert. 2024. BiasBuzz: Combining Visual Guidance with Haptic Feedback to Increase Awareness of Analytic Behav- ior during Visual Data Analysis. InExtended Abstracts of the CHI Conference on Human Factors in Computing Systems. 1–7. doi:10.1145/3613905.3651064

    work page doi:10.1145/3613905.3651064 2024

  41. [41]

    Pike, John Stasko, Remco Chang, and Theresa A

    William A. Pike, John Stasko, Remco Chang, and Theresa A. O’Connell. 2009. The Science of Interaction.Information Visualization8, 4 (2009), 263–274. arXiv:https://doi.org/10.1057/ivs.2009.22 doi:10.1057/ivs.2009.22

    work page doi:10.1057/ivs.2009.22 2009

  42. [42]

    Eric D Ragan, Alex Endert, Jibonananda Sanyal, and Jian Chen. 2016. Characteriz- ing provenance in visualization and data analysis: an organizational framework of provenance types and purposes.IEEE Transactions on Visualization and Computer Graphics22, 1 (2016), 31–40. doi:10.1109/TVCG.2015.2467551

    work page doi:10.1109/tvcg.2015.2467551 2016

  43. [43]

    Ali Sarvghad and Melanie Tory. 2015. Exploiting analysis history to support collaborative data analysis. InProceedings of the 41st Graphics Interface Conference. 123–130

    work page 2015

  44. [44]

    Yedendra B Shrinivasan, David Gotz, and Jie Lu. 2009. Connecting the Dots in Visual Analysis. InIEEE V AST

    work page 2009

  45. [45]

    2015.A/B testing: The most powerful way to turn clicks into customers

    Dan Siroker and Pete Koomen. 2015.A/B testing: The most powerful way to turn clicks into customers. John Wiley & Sons

    work page 2015

  46. [46]

    Amy Skopik and Carl Gutwin. 2005. Improving revisitation in fisheye views with visit wear. InProceedings of the SIGCHI Conference on Human Factors in Computing Systems. 771–780. doi:10.1145/1054972.1055079

    work page doi:10.1145/1054972.1055079 2005

  47. [48]

    Emily Wall, Arpit Narechania, Adam Coscia, Jamal Paden, and Alex Endert. 2022. Left, Right, and Gender: Exploring Interaction Traces to Mitigate Human Biases. IEEE Transactions on Visualization and Computer Graphics28, 1 (2022), 966–975. doi:10.1109/TVCG.2021.3114862

    work page doi:10.1109/tvcg.2021.3114862 2022

  48. [49]

    Amelia Wattenberger. 2021. Footsteps for VS Code. https://marketplace. visualstudio.com/items?itemName=Wattenberger.footsteps

    work page 2021

  49. [50]

    Wesley Willett, Jeffrey Heer, and Maneesh Agrawala. 2007. Scented Widgets: Improving navigation cues with embedded visualizations.IEEE Transactions on Visualization and Computer Graphics13, 6 (2007), 1129–1136. doi:10.1109/TVCG. 2007.70589

    work page doi:10.1109/tvcg 2007