Pith. sign in

REVIEW 3 major objections 4 minor 71 references

A Design Study on Voice-based Interaction for Immersive Network Visualization and Analysis

T0 review · 3 major / 4 minor · reviewed 2026-08-01 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read This design study claims that making voice the primary input for immersive network visualization—backed by a large-language-model pipeline—improves perceived usability and lowers the cognitive effort of formulating commands compared to cont

desk verdict Solid design study with a transparent technical evaluation; the comparative usability claim against controllers is the weak link, and the abstract overstates it. read the letter →

arxiv 2607.26526 v1 pith:A5SGNQJ5 submitted 2026-07-29 cs.HC

Sam Yu-Te Lee , Hsin-Ai Chen , Sarah Yuniar , David Bauer , Kwan-Liu Ma This is my paper · ORCID
classification cs.HC
keywords voiceuserinterfaceimmersiveanalyticsnetworkvisualizationnaturallanguagelargemodelsvirtualrealitydesignstudyinteractionfluidity
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper argues that voice can serve as the primary input modality for immersive network visualization, with controllers relegated to a supporting role, and that this arrangement improves perceived usability and reduces the mental cost of composing commands. To make this case, it builds a working virtual-reality system in which spoken requests are automatically transcribed, interpreted by a large-language-model pipeline, and translated into a sequence of graph operations and database queries, so a user can say "color the female smokers in red and bring them closer" instead of navigating menus and clicking nodes. A technical evaluation shows the command pipeline is highly accurate on typical commands and reasonably robust on adversarial ones, while a user study with ten participants reports that voice felt more intuitive and less physically demanding than controller interaction. The paper frames its contribution as a design finding: usability is the main barrier to adopting immersive analytics, and voice-first interaction is a way to lower that barrier while increasing interaction fluidity.

What carries the argument

The load-bearing component is the voice-to-command interpretation pipeline: an automatic speech recognizer feeds a transcript into two parallel large-language-model stages—text correction and ambiguity detection—and, when the command is unambiguous, a single model call emits an index-aligned pair of an action sequence (drawn from a fixed fifteen-action vocabulary) and a graph-database query per action. The system also maintains a table of current visual attributes so later commands can reference the previous state of the graph (e.g., "color the red nodes blue"), and a conditional clarification stage handles under-specified requests. This pipeline is what lets one sentence bundle predicates a

What would settle it

Run a within-subjects experiment with the same three network-authoring tasks in two conditions—voice-primary and controller-only—with order counterbalanced across participants, and compare objective measures (task completion time, error rate) plus validated self-reports (NASA-TLX workload, System Usability Scale). If the controller-only condition matches or beats voice-primary on workload and perceived usability, the paper's central relative-usability claim is refuted.

Watch

Extended reading notes

Core claim

The central claim is that voice-primary interaction can improve perceived usability relative to controller-based interaction in immersive network authoring, because users can express intent in natural language rather than compressing it into terse instructions. The paper demonstrates this with a research-through-design artifact: a VR system whose voice-to-command pipeline maps spoken utterances to an ordered list of actions from a fifteen-action vocabulary (select, color, shape, move, layout, arithmetic, and so on) plus one graph-database query per action. The pipeline runs text correction and ambiguity detection in parallel, and routes ambiguous commands to a clarification question instead

Load-bearing premise

The conclusion that voice improves usability relative to controllers rests on users' self-reports and experimenter observation during a voice-primary session, without a matched controller-only condition for the same tasks, so the apparent advantage could stem from novelty, participant inexperience, or the lack of a fair baseline rather than from voice itself.

Editorial extensions

If this is right

  • Voice-primary interaction can reduce the specification cost of network authoring, since a single utterance can express multiple coordinated parameters that would require a sequence of operations across many UI elements.
  • Because users are relieved from learning UI positions and maintaining precise controller movements, voice input may lower a key usability barrier to adoption of immersive visualization.
  • Voice-based interaction can increase interaction fluidity by letting users express intent in natural language without forcing them to compress it into terse instructions, while also reducing physical effort.
  • Voice-first design may change exploration behavior: participants tended to remain stationary and ask the system to bring data closer, suggesting that hybrid designs combining voice with embodied and controller-based interaction deserve exploration.
  • Systems should provide explicit mechanisms for ambiguity handling and command discoverability, such as example-command panels and clarification questions, to support natural-language interaction.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The relative-usability claim would be much stronger with a controlled comparison in which the same authoring tasks are performed with a matched controller-only condition; the current study's comparison was retrospective, so the magnitude of the voice advantage over controllers remains unquantified.
  • A likely consequence of voice-first design is that graph authoring becomes query-driven rather than widget-driven: users will compose multi-parameter requests, which may change how analytics tools are documented, taught, and extended.
  • The observed tendency of users to stay stationary suggests a design opportunity: voice interfaces could explicitly prompt physical navigation or support spatial deixis (e.g., "those nodes over there") to better balance conversational and embodied interaction.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. The paper presents a research-through-design (RtD) study of a voice-primary interaction system for immersive network visualization and analysis. The system combines a Large Language Model (LLM) pipeline (text correction, ambiguity detection, clarification, action–query generation) that maps transcribed speech to a fixed vocabulary of graph actions and Cypher queries, with controller input retained for node selection and dashboard operations. The technical evaluation is based on 175 labeled utterances in three waves (balanced core, held-out adversarial expansion, and boundary probes), reporting near-perfect performance on the core wave, high performance on the expansion wave, and 50% clarification accuracy on the boundary probes. A qualitative user study with 10 participants (7 sociology, 3 computer science) used three open-ended network analysis tasks and found positive perceived usability, intuitiveness, and preference for voice input. The paper concludes with design implications for usability, interaction fluidity, and adoption of immersive analytics. The abstract makes the comparative claim that voice interactions improve perceived usability relative to controller-based interaction and lower the cognitive effort of formulating commands.

Significance. The paper's contribution is a transparently documented RtD artifact: the system is open-sourced, the LLM prompts are included in the appendix, and the technical evaluation is careful and reproducible, with three corpus waves, repeated invocations at temperature 0, a failure analysis, and explicit boundary probing. The design implications regarding discoverability, ambiguity handling, and social considerations are useful for the immersive analytics community. However, the headline comparative claim—that voice-primary interaction improves perceived usability relative to controller-based interaction—rests on a study design without a same-task controller-only baseline. The authors themselves acknowledge in §7.4 that modality preference observations rely on self-reports and experimenter observation, and that a controlled quantitative study is needed. Thus the central claim, as stated in the abstract and introduction, is stronger than the evidence presented. The qualitative findings are still a legitimate RtD contribution, but the paper should either temper the comparative claim or provide the missing baseline.

major comments (3)
  1. [§6.1, §6.2.2, §7.4; Abstract] The abstract claims that "voice interactions can improve perceived usability relative to controller-based interaction and lower the cognitive effort of formulating commands." This comparative claim is not supported by the study design. All ten participants performed the tasks only in the voice-primary condition (voice for commands, controller for node selection and dashboard), with no controller-only condition for the same tasks. The §6.2.2 comparison is built on retrospective self-reports and experimenter observation during that single condition. The paper correctly acknowledges this limitation in §7.4, but the abstract and introduction do not carry the same caveat. Since the comparative statement is the paper's stated contribution, the claims should be scoped to "participants perceived the voice-primary system positively" or a same-task baseline should be provided.
  2. [§5.2, Table 2, §5.3, §7.4] The boundary probes in Table 2 show that the pipeline correctly clarified only 50% of requests that name unsupported analytic concepts (e.g., cycle detection, pathfinding); in the remaining cases it fabricated structurally valid but semantically ungrounded queries. The failure analysis (§5.3) documents this coercion failure mode. While the discussion in §7.4 is honest about this limitation, the abstract's broader statement about supporting "complex, multi-parameter operations" and the general framing of the system as enabling network authoring should be explicitly scoped to the tested fifteen-action vocabulary. This is not a fatal flaw, but the contribution statement should reflect the measured boundary.
  3. [§6.2.3] The evidence for "lower cognitive effort of formulating commands" comes primarily from participant comparisons of voice versus text input (e.g., P2's comment about typing forcing summarization), not from comparisons of voice versus controller interaction. The abstract phrases this as a relative improvement over controller-based interaction, but the interview data support a claim about voice versus text/typing more directly. Please align the claim with the evidence or gather the missing comparative data.
minor comments (4)
  1. [Throughout] There are several typographical issues where "Voice" appears as "V oice" (e.g., §1, §3.4.1, §7.1).
  2. [Figure 5] For n=10, the violin-style distribution is difficult to read. Reporting medians and interquartile ranges, or a small table of Likert responses, would make the ratings easier to interpret.
  3. [§5.1] The corpus construction is described only at a high level. A few representative examples from the 'adversarial expansion' wave would help readers judge the difficulty and the nature of the held-out cases.
  4. [§5.2] The note that the complete run cost $0.16 is interesting, but it may be misread as a generalizable cost estimate. Please clarify that this refers to the specific 525-invocation run on the given dataset and model.

Circularity Check

0 steps flagged · score 1.0 of 10

No derivation loop; the usability claim is an empirical finding with an acknowledged missing baseline, not a circular inference.

full rationale

The paper makes no predictive or first-principles claim derived from its inputs. The central claim—voice-primary interaction improves perceived usability and lowers cognitive effort—rests on a qualitative user study (Section 6) with participant interviews and Likert ratings, not on a fitted parameter or an equation. The technical evaluation (Section 5) measures an LLM pipeline against a manually labeled corpus; the labels are an external criterion to the mapping being tested, and the paper states that no test cases appear in prompts and each held-out case was verified absent from prompt text. The comparative 'improvement over controller-based interaction' is weakened by the absence of a same-task controller-only baseline and by reliance on self-reports, as the paper itself concedes in §7.4; but this is a validity threat, not circularity. Several cited works are by the authors (e.g., [5], [24], [29], [33], [35]), but they are background related work and are not invoked to force the central conclusion. No equation, fitted value, or uniqueness theorem is recycled as a prediction. Hence no circular step is present; at most the self-authored corpus and small sample limit generalizability.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

No free parameters or invented entities; the central claim is empirical and rests on system design assumptions and study-design choices rather than on fitted quantities.

assumptions (3)
  • domain assumption LLM-based speech recognition and interpretation are sufficiently robust to support the interaction paradigm (Section 3.4, 7.4).
    The system's viability assumes the gpt-4o-mini pipeline resolves commands with acceptable accuracy and latency; the technical evaluation quantifies this, but the user study only qualitatively checks it.
  • domain assumption Perceived usability and cognitive effort can be validly assessed from self-reports by ten participants in a non-controlled study (Section 6.1, 7.4).
    The claim that voice improves perceived usability rests on interviews and Likert scales without a controller baseline or performance logs.
  • domain assumption The task taxonomy [37,54] and the chosen command vocabulary cover the relevant network authoring operations (Section 3.2).
    The design assumes the fixed fifteen-action vocabulary is a sufficient operationalization of network authoring for the study.

how reviews work

0 comments
Cite this review

Pith. "Pith review of A Design Study on Voice-based Interaction for Immersive Network Visualization and Analysis." pith.science (2026). https://pith.science/paper/A5SGNQJ5

@misc{pith2026260726526,
  author       = {Pith},
  title        = {Pith review of: A Design Study on Voice-based Interaction for Immersive Network Visualization and Analysis},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/A5SGNQJ5}},
  note         = {Machine review of arXiv:2607.26526}
}
read the original abstract

Visual network analysis leverages network visualization authoring techniques to facilitate sensemaking, serendipitous discovery, and hypothesis verification on network data. However, transferring the same paradigm to immersive environments is non-trivial due to insufficient UI affordance for authoring operations. Researchers have studied combining multiple modalities for interactions, but the high learning curve of such input systems limits their adoption by typical data analysts, let alone for network analytics. In this work, we investigate the advantages and limitations of voice as the primary input modality with a research-through-design (RtD) study, in which we design a system that supports voice-based interactions for immersive network visualization facilitated by Large Language Models (LLMs). Through a user study on social network data analysis with participants from social science and computer science backgrounds, we find that voice interactions can improve perceived usability relative to controller-based interaction and lower the cognitive effort of formulating commands, since users can express intent in natural language rather than compressing it into terse instructions. We discuss design implications for immersive visualizations, highlighting how usability limits adoption while simplified interactions and voice-based controls enhance fluidity and support complex, multi-parameter operations.

Figures

Figures reproduced from arXiv: 2607.26526 by the authors.

Figure 1
Figure 1. Overview of the system. (a) an example command panel illustrating supported commands (b) main graph showing all the nodes and [PITH_FULL_IMAGE:figures/full_fig_p003_1.png] view at source ↗
Figure 2
Figure 2. The text panel displays (1) command history for improved [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. System architecture. The user’s voice input is first transcribed into text by the speech recognition module. A command classification [PITH_FULL_IMAGE:figures/full_fig_p005_3.png] view at source ↗
Figures from the paper (2 more)
Figure 4
Figure 4. Figure 4: Visualization generated in the illustrative use case by [PITH_FULL_IMAGE:figures/full_fig_p005_4.png]
Figure 5
Figure 5. Figure 5: Distribution of participant ratings (1–5 Likert scale) for [PITH_FULL_IMAGE:figures/full_fig_p007_5.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

71 extracted references · 12 canonical work pages

  1. [1]

    AlKadi, V

    M. AlKadi, V . Serrano, J. Scott-Brown, C. Plaisant, J.-D. Fekete, U. Hinrichs, and B. Bach. Understanding barriers to network explo- ration with visualization: A report from the trenches.IEEE Transac- tions on Visualization and Computer Graphics, 29(1):907–917, 2023. doi: 10.1109/TVCG.2022.3209487 2

    arXiv 2023

  2. [2]

    S. K. Badam, A. Srinivasan, N. Elmqvist, and J. Stasko. Affordances of input modalities for visual data exploration in immersive environ- ments. In2nd Workshop on Immersive Analytics, vol. 2, 2017. 1, 2

    2017

  3. [3]

    Bastian, S

    M. Bastian, S. Heymann, and M. Jacomy. Gephi: An open source software for exploring and manipulating networks.Proceedings of the International AAAI Conference on Web and Social Media, 3(1):361– 362, Mar. 2009. doi: 10.1609/icwsm.v3i1.13937 1

    doi:10.1609/icwsm.v3i1.13937 2009

  4. [4]

    Batch, A

    A. Batch, A. Cunningham, M. Cordeil, N. Elmqvist, T. Dwyer, B. H. Thomas, and K. Marriott. There is no spoon: Evaluating performance, space use, and presence with expert domain users in immersive ana- lytics.IEEE Transactions on Visualization and Computer Graphics, 26(1):536–546, 2020. doi: 10.1109/TVCG.2019.2934803 2, 8

    arXiv 2020

  5. [5]

    Bauer, C

    D. Bauer, C. Zheng, O.-H. Kwon, and K.-L. Ma. A multi-layout design for immersive visualization of hierarchical network data. In 2024 IEEE International Symposium on Mixed and Augmented Real- ity (ISMAR), pp. 1038–1047, 2024. doi: 10.1109/ISMAR62088.2024 .00120 2

    arXiv 2024

  6. [6]

    put-that-there

    R. A. Bolt. “put-that-there”: V oice and gesture at the graphics in- terface. InProceedings of the 7th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’80), pp. 262–270,

  7. [7]

    Braun and V

    V . Braun and V . Clarke. Using thematic analysis in psychology.Qual- itative Research in Psychology, 3(2):77–101, 2006. doi: 10.1191/ 1478088706qp063oa 7

    2006

  8. [8]

    B ¨uschel, J

    W. B ¨uschel, J. Chen, R. Dachselt, S. Drucker, T. Dwyer, C. G ¨org, T. Isenberg, A. Kerren, C. North, and W. Stuerzlinger. Interaction for immersive analytics. InImmersive Analytics, vol. 11190 ofLecture Notes in Computer Science, pp. 95–138. Springer, 2018. doi: 10.1007/ 978-3-030-01388-2 4 2, 8

    2018

Show all 71 references
  1. [9]

    Cordeil, A

    M. Cordeil, A. Cunningham, T. Dwyer, B. H. Thomas, and K. Mar- riott. ImAxes: Immersive axes as embodied affordances for interac- tive multivariate data visualisation. InProceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST ’17), pp. 71–8...

    2017

  2. [10]

    Cordeil, T

    M. Cordeil, T. Dwyer, K. Klein, B. Laha, K. Marriott, and B. H. Thomas. Immersive collaborative analysis of network connectivity: CA VE-style or head-mounted display?IEEE Transactions on Vi- sualization and Computer Graphics, 23(1):441–450, 2017. doi: 10. 1109/TVCG.2016.2599107 2

    2017

  3. [11]

    Csikszentmihalyi.Flow: The Psychology of Optimal Experience

    M. Csikszentmihalyi.Flow: The Psychology of Optimal Experience. Harper & Row, New York, 1990. 8

    1990

  4. [12]

    T. N. Dang, N. Pendar, and A. G. Forbes. TimeArcs: Visualizing fluc- tuations in dynamic networks.Computer Graphics Forum, 35(3):61– 69, 2016. doi: 10.1111/cgf.12882 2

    2016 doi

  5. [13]

    Derksen, T

    M. Derksen, T. Kuhlen, M. Botsch, and T. Weissker. Minimalism or creative chaos? on the arrangement and analysis of numerous scat- terplots in immersive 3D knowledge spaces.IEEE Transactions on Visualization and Computer Graphics, 31(5):3003–3013, 2025. doi: 10.1109/TVCG.2025....

    2025

  6. [14]

    Dhanoa, G

    V . Dhanoa, G. Molina Le ´on, E. Hoggan, E. Gr ¨oller, M. Streit, and N. Elmqvist. ”hey dashboard!”: Supporting voice, text, and pointing modalities in dashboard onboarding using large language models. In Proceedings of the 2026 CHI Conference on Human Factors in Com- puting S...

    2026

  7. [15]

    V . Dibia. LIDA: A tool for automatic generation of grammar-agnostic visualizations and infographics using large language models. InPro- ceedings of the 61st Annual Meeting of the Association for Computa- tional Linguistics (ACL 2023): System Demonstrations, pp. 113–126,

    2023

  8. [16]

    Drogemuller, A

    A. Drogemuller, A. Cunningham, J. Walsh, M. Cordeil, W. Ross, and B. H. Thomas. Evaluating navigation techniques for 3D graph visu- alizations in virtual reality. In2018 International Symposium on Big Data Visual and Immersive Analytics (BDVA), pp. 1–10, 2018. doi: 10 .1109/BD...

    2018

  9. [17]

    T. J. Dube and A. S. Arif. Text entry in virtual reality: A comprehen- sive review of the literature. InHuman-Computer Interaction (HCII 2019), vol. 11567 ofLecture Notes in Computer Science, pp. 419–437. Springer, 2019. doi: 10.1007/978-3-030-22643-5 33 2

    2019 doi

  10. [18]

    Elmqvist, A

    N. Elmqvist, A. V . Moere, H.-C. Jetter, D. Cernea, H. Reiterer, and T. Jankun-Kelly. Fluid interaction for information visualiza- tion.Information Visualization, 10(4):327–340, 2011. doi: 10.1177/ 1473871611413180 1, 8

    2011

  11. [19]

    B. Ens, B. Bach, M. Cordeil, U. Engelke, M. Serrano, W. Willett, A. Prouzeau, C. Anthes, W. B ¨uschel, C. Dunne, T. Dwyer, J. Gru- bert, J. H. Haga, N. Kirshenbaum, D. Kobayashi, T. Lin, M. Olaose- bikan, F. Pointecker, D. Saffo, N. Saquib, D. Schmalstieg, D. A. Szafir, M. Whi...

    2021

  12. [20]

    Faris and D

    R. Faris and D. Felmlee. Casualties of social combat: School networks of peer victimization and their consequences.American Sociological Review, 79(2):228–257, 2014. doi: 10.1177/0003122414524573 4

    2014 doi

  13. [21]

    Faris, D

    R. Faris, D. Felmlee, and C. McMillan. With friends like these: Ag- gression from amity and equivalence.American Journal of Sociology, 126(3):673–713, 2020. doi: 10.1086/712972 4

    2020 doi

  14. [22]

    Foundation

    B. Foundation. Blender - The Free and Open Source 3D Creation Software — blender.org. 4

  15. [23]

    Fuchs, C

    J. Fuchs, C. Dunne, M.-V . Heinle, D. A. Keim, and S. Di Bartolomeo. Motif simplification for biofabric network visualizations: Improving pattern recognition and interpretation.IEEE Transactions on Visual- ization and Computer Graphics, 32(1):604–614, 2026. doi: 10.1109/ TVCG....

    2026

  16. [24]

    Fujiwara, T

    T. Fujiwara, T. Crnovrsanin, and K.-L. Ma. Concise provenance of interactive network analysis.Visual Informatics, 2(4):213–224, 2018. doi: 10.1016/j.visinf.2018.12.002 3

    2018 doi

  17. [25]

    Gamper and M

    M. Gamper and M. Sch ¨onhuth. Visual network research (VNR) – a theoretical and methodological appraisal of an evolving field.Vi- sual Studies, 35(4):374–393, 2020. doi: 10.1080/1472586X.2020. 1808524 1

    2020 doi

  18. [26]

    T. Gao, M. Dontcheva, E. Adar, Z. Liu, and K. G. Karahalios. Data- Tone: Managing ambiguity in natural language interfaces for data vi- sualization. InProceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST ’15), p. 489–500, 2015. doi: 10.114...

    2015

  19. [27]

    Grubert, E

    J. Grubert, E. Ofek, M. Pahud, and P. O. Kristensson. Back to the future: Revisiting mouse and keyboard interaction for HMD-based immersive analytics. InCHI 2020 Workshop on Immersive Analytics,

    2020

  20. [28]

    D. Han, H. Zhu, W. Chen, J. Pan, R. Chen, X. Wang, Z. Wen, L. Weng, M. Zhu, Y . Wu, and R. Westermann. Nuwa: An authoring tool for graph visualizations. In2024 IEEE 17th Pacific Visualization Confer- ence (PacificVis), pp. 142–151, 2024. doi: 10.1109/PacificVis60374. 2024.00024 2

    2024

  21. [29]

    Huang, T

    Y .-J. Huang, T. Fujiwara, Y .-X. Lin, W.-C. Lin, and K.-L. Ma. A gesture system for graph visualization in virtual reality environments. In2017 IEEE Pacific Visualization Symposium (PacificVis), pp. 41– 45, 2017. doi: 10.1109/PACIFICVIS.2017.8031577 1, 2

    2017

  22. [30]

    L. Joos, M. T. Fischer, J. Rauscher, D. A. Keim, T. Dwyer, F. Schreiber, and K. Klein. Visual network analysis in immersive en- vironments: A survey, 2025. doi: 10.48550/arXiv.2501.08500 2

    2025 doi arXiv

  23. [31]

    L. Joos, S. Jaeger-Honz, F. Schreiber, D. A. Keim, and K. Klein. Vi- sual comparison of networks in VR.IEEE Transactions on Visual- ization and Computer Graphics, 28(11):3651–3661, 2022. doi: 10. 1109/TVCG.2022.3203001 2

    2022

  24. [32]

    Joshi, S

    A. Joshi, S. Kale, S. Chandel, and D. K. Pal. Likert scale: Ex- plored and explained.British journal of applied science & technology, 9 © 2026 IEEE. This is the author’s version of the article that has been published in the proceedings of IEEE Visualization conference. The fin...

    2026 doi

  25. [33]

    Kotlarek, O.-H

    J. Kotlarek, O.-H. Kwon, K.-L. Ma, P. Eades, A. Kerren, K. Klein, and F. Schreiber. A study of mental maps in immersive network visualiza- tion. In2020 IEEE Pacific Visualization Symposium (PacificVis), pp. 1–10, 2020. doi: 10.1109/PacificVis48177.2020.4722 2

    2020

  26. [34]

    Kraus, K

    M. Kraus, K. Klein, J. Fuchs, D. A. Keim, F. Schreiber, and M. Sedl- mair. The value of immersive visualization.IEEE Computer Graph- ics and Applications, 41(4):125–132, 2021. doi: 10.1109/MCG.2021 .3075258 1, 2, 8

    2021 doi

  27. [35]

    O.-H. Kwon, C. Muelder, K. Lee, and K.-L. Ma. A study of lay- out, rendering, and interaction methods for immersive graph visual- ization.IEEE Transactions on Visualization and Computer Graphics, 22(7):1802–1815, 2016. doi: 10.1109/TVCG.2016.2520921 2

    2016

  28. [36]

    LangChain.https://github.com/langchain-ai,

    LangChain. LangChain.https://github.com/langchain-ai,

  29. [37]

    B. Lee, C. Plaisant, C. S. Parr, J.-D. Fekete, and N. Henry. Task taxon- omy for graph visualization. InProceedings of the 2006 AVI Workshop on BEyond Time and Errors: Novel Evaluation Methods for Informa- tion Visualization (BELIV ’06), p. 1–5, 2006. doi: 10.1145/1168149. 116...

    2006 doi

  30. [38]

    Marriott, F

    K. Marriott, F. Schreiber, T. Dwyer, K. Klein, N. Henry Riche, T. Itoh, W. Stuerzlinger, and B. H. Thomas, eds.Immersive Analytics, vol. 11190 ofLecture Notes in Computer Science. Springer, 2018. doi: 10 .1007/978-3-030-01388-2 2

    2018

  31. [39]

    Munzner.Visualization Analysis and Design

    T. Munzner.Visualization Analysis and Design. A K Peters/CRC Press, 1st ed., 2014. doi: 10.1201/b17511 2, 7

    2014 doi

  32. [40]

    Narechania, A

    A. Narechania, A. Srinivasan, and J. Stasko. NL4DV: A toolkit for generating analytic specifications for data visualization from natural language queries.IEEE Transactions on Visualization and Computer Graphics, 27(2):369–379, 2021. doi: 10.1109/TVCG.2020.3030378 2

    2021

  33. [41]

    Neo4j Graph Database.https://neo4j.com, 2024

    Neo4j, Inc. Neo4j Graph Database.https://neo4j.com, 2024. Accessed: 2026-02-07. 4, 6

    2024

  34. [42]

    Nobre, M

    C. Nobre, M. Meyer, M. Streit, and A. Lex. The state of the art in visu- alizing multivariate networks.Computer Graphics Forum, 38(3):807– 832, 2019. doi: 10.1111/cgf.13728 2

    2019 doi

  35. [43]

    R Foundation for Statistical Computing, Vienna, Austria, 2021

    R Core Team.R: A Language and Environment for Statistical Comput- ing. R Foundation for Statistical Computing, Vienna, Austria, 2021. 7

    2021

  36. [44]

    Saket, P

    B. Saket, P. Simonetto, and S. Kobourov. Group-level graph visual- ization taxonomy, 2014. doi: 10.48550/arXiv.1403.7421 1, 2

    2014 doi arXiv

  37. [45]

    Saktheeswaran, A

    A. Saktheeswaran, A. Srinivasan, and J. Stasko. Touch? speech? or touch and speech? investigating multimodal interaction for visual network exploration and analysis.IEEE Transactions on Visualiza- tion and Computer Graphics, 26(6):2168–2179, 2020. doi: 10.1109/ TVCG.2020.2970512 1, 2

    2020

  38. [46]

    Shannon, A

    P. Shannon, A. Markiel, O. Ozier, N. S. Baliga, J. T. Wang, D. Ra- mage, N. Amin, B. Schwikowski, and T. Ideker. Cytoscape: A soft- ware environment for integrated models of biomolecular interaction networks.Genome Research, 13(11):2498–2504, 2003. doi: 10.1101/ gr.1239303 1, 2, 7

    2003

  39. [47]

    L. Shen, E. Shen, Y . Luo, X. Yang, X. Hu, X. Zhang, Z. Tai, and J. Wang. Towards natural language interfaces for data visualization: A survey.IEEE Transactions on Visualization and Computer Graphics, 29(6):3121–3144, 2023. doi: 10.1109/TVCG.2022.3148007 2

    2023

  40. [48]

    Skarbez, N

    R. Skarbez, N. F. Polys, J. T. Ogle, C. North, and D. A. Bowman. Im- mersive analytics: Theory and research agenda.Frontiers in Robotics and AI, 6:82, 2019. doi: 10.3389/frobt.2019.00082 2, 8

    2019

  41. [49]

    H. Song, M. Johnson, K. Whitley, E. Krokos, and A. Varshney. Em- bodied natural language interaction (NLI): Speech input patterns in immersive analytics.IEEE Transactions on Visualization and Com- puter Graphics, 32(1):1098–1108, 2026. doi: 10.1109/TVCG.2025. 3634798 2

    2026 doi

  42. [50]

    Sorger, M

    J. Sorger, M. Waldner, W. Knecht, and A. Arleo. Immersive analytics of large dynamic networks via overview and detail navigation. In2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), pp. 144–1447, 2019. doi: 10.1109/AIVR46125.2019. 00030 8

    2019

  43. [51]

    Srinivasan, M

    A. Srinivasan, M. Dontcheva, E. Adar, and S. Walker. Discovering natural language commands in multimodal interfaces. InProceedings of the 24th International Conference on Intelligent User Interfaces (IUI ’19), p. 661–672, 2019. doi: 10.1145/3301275.3302292 4, 8

    2019

  44. [52]

    Srinivasan, N

    A. Srinivasan, N. Nyapathy, B. Lee, S. M. Drucker, and J. Stasko. Collecting and characterizing natural language utterances for specify- ing data visualizations. InProceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21), 2021. doi: 10. 1145/34117...

    2021

  45. [53]

    Srinivasan and V

    A. Srinivasan and V . Setlur. Snowy: Recommending utterances for conversational visual analysis. InThe 34th Annual ACM Symposium on User Interface Software and Technology (UIST ’21), p. 864–880,

  46. [54]

    Srinivasan and J

    A. Srinivasan and J. Stasko. Orko: Facilitating multimodal interaction for visual exploration and analysis of networks.IEEE Transactions on Visualization and Computer Graphics, 24(1):511–521, 2018. doi: 10. 1109/TVCG.2017.2745219 1, 2, 3

    2018

  47. [55]

    A. R. Teyseyre and M. R. Campo. An overview of 3d software visual- ization.IEEE Transactions on Visualization and Computer Graphics, 15(1):87–105, 2009. doi: 10.1109/TVCG.2008.86 1

    2009 doi

  48. [56]

    Unity, 2023

    Unity Technologies. Unity, 2023. Game development platform. 4

    2023

  49. [57]

    Unity Technologies,

    Unity Technologies.XR Interaction Toolkit. Unity Technologies,

  50. [58]

    Venturini, M

    T. Venturini, M. Jacomy, and P. Jensen. What do we see when we look at networks: Visual network analysis, relational ambiguity, and force- directed layouts.Big Data & Society, 8(1):20539517211018488,

  51. [59]

    von Landesberger, A

    T. von Landesberger, A. Kuijper, T. Schreck, J. Kohlhammer, J. van Wijk, J.-D. Fekete, and D. Fellner. Visual analysis of large graphs: State-of-the-art and future research challenges.Computer Graph- ics Forum, 30(6):1719–1749, 2011. doi: 10.1111/j.1467-8659.2011 .01898.x 2

    2011

  52. [60]

    Z. Wen, L. Weng, Y . Tang, R. Zhang, Y . Liu, B. Pan, M. Zhu, and W. Chen. Exploring multimodal prompt for visualization author- ing with large language models.IEEE Transactions on Visualization and Computer Graphics, pp. 1–16, 2026. doi: 10.1109/TVCG.2026. 3701510 2

    2026 doi

  53. [61]

    B. G. Witmer and M. J. Singer. Measuring presence in virtual environ- ments: A presence questionnaire.Presence: Teleoperators and Virtual Environments, 7(3):225–240, 1998. doi: 10.1162/105474698565686 8

    1998 doi

  54. [62]

    red" as

    J. Zimmerman, J. Forlizzi, and S. Evenson. Research through design as a method for interaction design research in HCI. InProceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’07), pp. 493–502, 2007. doi: 10.1145/1240624.1240704 8 10 © 2026 IEEE. This...

    2007

  55. [63]

    Accessed: 2026-02-07

    Version 3.0. Accessed: 2026-02-07. 4

    2026

  56. [65]

    doi: 10.1177/20539517211018488 1

    doi

  57. [70]

    NEVER append an extra action the user did not ask for ( exceptions: pairings this prompt itself mandates)

    Emit ONLY the actions the user explicitly requested. NEVER append an extra action the user did not ask for ( exceptions: pairings this prompt itself mandates)

  58. [71]

    actions

    If the input is an actionable command or question, " actions" must be NON-EMPTY. Return ONLY a JSON object. No markdown. No explanation. Example: {"actions":[["selectNode","n.grade=9"],[" colorNode","#FF0000"]],"queries":["MATCH (n:Node) WHERE n.grade=9 RETURN n",""]} 12

  59. [1980]

    doi: 10.1145/800250.807503 2

  60. [2020]

    doi: 10.48550/arXiv.2009.02927 2, 8

    arXiv:2009.02927. doi: 10.48550/arXiv.2009.02927 2, 8

    2009 doi arXiv

  61. [2021]

    doi: 10.1145/3472749.3474792 2

  62. [2023]

    doi: 10.18653/v1/2023.acl-demo.11 2

    2023 doi

  63. [2024]

    Accessed: 2026-02-07. 4

    2026

Pith tools

Reviewed August 1, 2026 · model on record in the stance chip above.