pith. sign in

arxiv: 1907.09146 · v1 · pith:VYAKPNXVnew · submitted 2019-07-22 · 💻 cs.GR · cs.HC

Motion Browser: Visualizing and Understanding Complex Upper Limb Movement Under Obstetrical Brachial Plexus Injuries

Gromit Yeuk-Yin Chan , Luis Gustavo Nonato , Alice Chu , Preeti Raghavan , Viswanath Aluru , Claudio T. Silva This is my paper

Pith reviewed 2026-05-24 18:00 UTC · model grok-4.3

classification 💻 cs.GR cs.HC
keywords visual analyticselectromyographybrachial plexus injurymotion analysisupper limbinteractive visualizationclinical decision support
0
0 comments X

The pith

Motion Browser combines EMG signals, joint motion and video in one interface so physicians can compare muscle patterns across limbs in brachial plexus injury patients.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper presents an interactive visual analytics system called Motion Browser that integrates electromyographic signals from multiple muscles, joint movement data, and video recordings of real-world tasks. It supplies coordinated views that let users extract and compare activity patterns between affected and unaffected limbs. The authors argue that without such integration, physicians are limited to vague statistical summaries, which restricts clinical insight. Case studies illustrate physicians using the system to observe how patients coordinate muscles and to form new treatment hypotheses. The work is grounded in a collaboration between computer scientists and rehabilitation physicians.

Core claim

Motion Browser supplies an efficient framework to extract and compare muscle activity patterns from a patient's limbs together with coordinated views that combine muscle signals, motion data, and video information, enabling physicians to analyze coordination that simple statistical summaries cannot reveal.

What carries the argument

Coordinated multi-modal views that link EMG traces, 3D joint trajectories, and synchronized video playback for side-by-side limb comparison.

If this is right

  • Physicians can identify which muscles activate together during specific tasks and adjust therapy accordingly.
  • Side-by-side comparison of affected and unaffected limbs can highlight compensatory patterns that are invisible in aggregate statistics.
  • The same platform can support longitudinal tracking of a single patient across multiple assessment sessions.
  • New research hypotheses about muscle recruitment order can be generated directly from the visualized data.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The interface design choices (what data are linked and how) may generalize to other multi-signal movement disorders beyond brachial plexus injury.
  • If the system is extended with automated pattern detection, it could reduce the time physicians spend manually scanning traces.
  • The case-study approach leaves open whether the observed hypothesis generation translates to measurable changes in patient outcomes.

Load-bearing premise

That giving physicians integrated visual access to the raw signals will let them generate better clinical hypotheses than they can with separate statistical summaries.

What would settle it

A controlled study in which physicians generate treatment hypotheses for the same patients using only standard statistical reports versus using Motion Browser, then measure whether the hypotheses differ in specificity or lead to different clinical decisions.

Figures

Figures reproduced from arXiv: 1907.09146 by Alice Chu, Claudio T. Silva, Gromit Yeuk-Yin Chan, Luis Gustavo Nonato, Preeti Raghavan, Viswanath Aluru.

Figure 1
Figure 1. Figure 1: MOTION BROWSER interface showing how to analyze patients’ limb muscles and movement with data collected from muscle sensors, motion sensors, and video recordings. A Muscle Bundle Comparison View displays the muscle signals of affected and unaffected limbs side by side. Statistics from motion sensors (a1) and stacked muscle activities (a2) are shown. Visual highlighting technique allows the extraction of th… view at source ↗
Figure 2
Figure 2. Figure 2: Examples of current tools for analyzing EMG data of muscle [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: Hierarchical task abstraction of the clinical workflow. Each box represents a task or subtask and each level of hierarchy has a plan. The [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figure 4
Figure 4. Figure 4: Entropy-based visual highlighting: (a) Transform the signals [PITH_FULL_IMAGE:figures/full_fig_p005_4.png] view at source ↗
Figure 6
Figure 6. Figure 6: When users remove a muscle, the corresponding bar charts will [PITH_FULL_IMAGE:figures/full_fig_p006_6.png] view at source ↗
Figure 5
Figure 5. Figure 5: Illustration of how users can discover the significant muscles on [PITH_FULL_IMAGE:figures/full_fig_p006_5.png] view at source ↗
Figure 8
Figure 8. Figure 8: System architecture for data storage, modeling, and visualization. [PITH_FULL_IMAGE:figures/full_fig_p007_8.png] view at source ↗
Figure 9
Figure 9. Figure 9: After using the analytic workflow shown in Fig. 5 on every patient to compare each affected and unaffected limbs, our experts summarized [PITH_FULL_IMAGE:figures/full_fig_p008_9.png] view at source ↗
Figure 10
Figure 10. Figure 10: Usage scenario of using MOTION BROWSER to anticipate clinical evaluation. The Muscle Bundle Comparison View in (a) displays the muscle activities from shoulder abduction conducted with the affected limb and the unaffected limb. The visual clues of important muscles’ activities combined with the difference of visible outcomes in (b) and (c) provide explanations for medical classifications. Our physicians t… view at source ↗
read the original abstract

The brachial plexus is a complex network of peripheral nerves that enables sensing from and control of the movements of the arms and hand. Nowadays, the coordination between the muscles to generate simple movements is still not well understood, hindering the knowledge of how to best treat patients with this type of peripheral nerve injury. To acquire enough information for medical data analysis, physicians conduct motion analysis assessments with patients to produce a rich dataset of electromyographic signals from multiple muscles recorded with joint movements during real-world tasks. However, tools for the analysis and visualization of the data in a succinct and interpretable manner are currently not available. Without the ability to integrate, compare, and compute multiple data sources in one platform, physicians can only compute simple statistical values to describe patient's behavior vaguely, which limits the possibility to answer clinical questions and generate hypotheses for research. To address this challenge, we have developed \systemname, an interactive visual analytics system which provides an efficient framework to extract and compare muscle activity patterns from the patient's limbs and coordinated views to help users analyze muscle signals, motion data, and video information to address different tasks. The system was developed as a result of a collaborative endeavor between computer scientists and orthopedic surgery and rehabilitation physicians. We present case studies showing physicians can utilize the information displayed to understand how individuals coordinate their muscles to initiate appropriate treatment and generate new hypotheses for future research.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

2 major / 2 minor

Summary. The paper presents Motion Browser, an interactive visual analytics system for integrating and visualizing electromyographic (EMG) signals from multiple muscles, joint motion data, and video recordings during real-world tasks for patients with obstetrical brachial plexus injuries (OBPI). Developed collaboratively with orthopedic and rehabilitation physicians, the system provides coordinated multi-modal views to extract muscle activity patterns and address the limitation of relying on vague statistical summaries. Case studies are included to demonstrate that physicians can use the displayed information to understand muscle coordination, initiate treatment, and generate new research hypotheses.

Significance. If the case studies were expanded to include concrete, traceable examples of hypothesis generation and clinical insights beyond existing methods, the work could offer a useful contribution to medical visualization by filling a gap in integrated analysis tools for complex neuromuscular coordination data. The collaborative design process is a positive aspect, but the current lack of quantitative support limits demonstrated impact.

major comments (2)
  1. [Case Studies] Case Studies section: The central claim that the system enables physicians to 'generate new hypotheses for future research' and 'initiate appropriate treatment' is load-bearing for the abstract and motivation but is supported only by high-level assertions of use; no specific examples of hypotheses formed, how the coordinated views revealed coordination patterns not visible in statistical summaries, or comparisons to baseline analysis methods are provided.
  2. [Abstract and Case Studies] Abstract and Evaluation/Case Studies: The paper asserts that the absence of integrated tools forces reliance on vague statistics and that the new views will directly enable better hypothesis generation, yet supplies no quantitative evaluation, user study metrics, error analysis, or outcome measures to substantiate efficiency or clinical utility claims.
minor comments (2)
  1. [Introduction] Introduction: The description of current physician workflows could be more precise about the exact statistical summaries used and the specific clinical questions that remain unanswerable.
  2. [System Overview] System description: Some figure captions and view labels could be clarified to make the mapping between visual encodings and EMG/motion data explicit without requiring cross-reference to the text.

Simulated Author's Rebuttal

2 responses · 1 unresolved

We thank the referee for the constructive feedback. We respond to each major comment below, indicating where revisions will be made.

read point-by-point responses

  1. Referee: [Case Studies] Case Studies section: The central claim that the system enables physicians to 'generate new hypotheses for future research' and 'initiate appropriate treatment' is load-bearing for the abstract and motivation but is supported only by high-level assertions of use; no specific examples of hypotheses formed, how the coordinated views revealed coordination patterns not visible in statistical summaries, or comparisons to baseline analysis methods are provided.

    Authors: We agree that the case studies would be strengthened by more concrete, traceable examples. The current text summarizes physician use at a high level without detailing specific hypotheses generated or direct before/after comparisons to statistical summaries. In revision we will expand the section with additional details from the documented physician sessions, including explicit examples of coordination patterns identified via the linked views and how these informed treatment or research questions. revision: yes

  2. Referee: [Abstract and Case Studies] Abstract and Evaluation/Case Studies: The paper asserts that the absence of integrated tools forces reliance on vague statistics and that the new views will directly enable better hypothesis generation, yet supplies no quantitative evaluation, user study metrics, error analysis, or outcome measures to substantiate efficiency or clinical utility claims.

    Authors: This is a design-study paper whose primary contribution is the integrated system and its qualitative demonstration in a new clinical domain. Standard practice in visualization design studies is to rely on case studies rather than controlled quantitative user studies with metrics; no such study was performed. We will add an explicit limitations paragraph discussing the absence of quantitative measures and outlining possible future evaluation approaches. revision: partial

standing simulated objections not resolved
  • Quantitative user-study metrics, error rates, or clinical outcome measures, which were not collected during the original work.

Circularity Check

0 steps flagged

No circularity: system description with no derivations or fitted predictions

full rationale

This is a visualization system paper presenting Motion Browser for EMG and motion data analysis. The abstract and described content contain no equations, parameter fitting, predictions, uniqueness theorems, or ansatzes. Claims rest on case studies of physician use rather than any derivation chain that could reduce to inputs by construction. No self-citation load-bearing steps or renamings of known results appear. The paper is self-contained as a tool description and case-study report; the skeptic concern about evidence strength in case studies is a matter of empirical support, not circularity.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 0 invented entities

This is a software-system paper; no mathematical free parameters, axioms, or invented physical entities are introduced. The central contribution is the described interface and workflow.

pith-pipeline@v0.9.0 · 5801 in / 1048 out tokens · 25936 ms · 2026-05-24T18:00:22.270549+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

49 extracted references · 49 canonical work pages

  1. [1]

    Aigner, S

    W. Aigner, S. Miksch, H. Schumann, and C. Tominski. Visualization of time-oriented data. Springer Science & Business Media, 2011

    work page 2011

  2. [2]

    Aigner, A

    W. Aigner, A. Rind, and S. Hoffmann. Comparative evaluation of an interactive time-series visualization that combines quantitative data with qualitative abstractions. In Computer Graphics Forum, vol. 31, pp. 995–

    work page

  3. [3]

    Wiley Online Library, 2012

    work page 2012

  4. [4]

    Al-Qattan, A

    M. Al-Qattan, A. El-Sayed, A. Al-Zahrani, S. Al-Mutairi, M. Al-Harbi, A. Al-Mutairi, and F. Al-Kahtani. Narakas classification of obstetric brachial plexus palsy revisited. Journal of Hand Surgery (European Volume), 34(6):788–791, 2009

    work page 2009

  5. [5]

    G. V . Anguelova, M. J. Malessy, E. W. Zwet, and J. G. Dijk. Extensive motor axonal misrouting after conservative treatment of obstetric brachial plexus lesions. Developmental Medicine & Child Neurology, 56(10):984– 989, 2014

    work page 2014

  6. [6]

    Bernard, A

    J. Bernard, A. V ¨ogele, R. Klein, and D. W. Fellner. Approaches and challenges in the visual-interactive comparison of human motion data. In VISIGRAPP (3: IVAPP), pp. 217–224, 2017

    work page 2017

  7. [7]

    Bernard, N

    J. Bernard, N. Wilhelm, B. Kr¨uger, T. May, T. Schreck, and J. Kohlhammer. Motionexplorer: Exploratory search in human motion capture data based on hierarchical aggregation. IEEE transactions on visualization and computer graphics, 19(12):2257–2266, 2013

    work page 2013

  8. [8]

    H. R. Beyer and K. Holtzblatt. Apprenticing with the customer. Commu- nications of the ACM, 38(5):45–52, 1995

    work page 1995

  9. [9]

    J. B. Bhatt, R. Glaser, A. Chavez, and E. Yung. Middle and lower trapezius strengthening for the management of lateral epicondylalgia: a case report. journal of orthopaedic & sports physical therapy, 43(11):841–847, 2013

    work page 2013

  10. [10]

    Correll and J

    M. Correll and J. Heer. Surprise! Bayesian weighting for de-biasing thematic maps. IEEE transactions on visualization and computer graphics, 23(1):651–660, 2017

    work page 2017

  11. [11]

    Dal Col, P

    A. Dal Col, P. Valdivia, F. Petronetto, F. Dias, C. T. Silva, and L. G. Nonato. Wavelet-based visual analysis of dynamic networks. IEEE transactions on visualization and computer graphics, 24(8):2456–2469, 2017

    work page 2017

  12. [12]

    F. Du, B. Shneiderman, C. Plaisant, S. Malik, and A. Perer. Coping with volume and variety in temporal event sequences: Strategies for sharpening analytic focus. IEEE Trans. Vis. Comput. Graph., 23(6):1636–1649, 2017

    work page 2017

  13. [13]

    B. T. Elhassan, E. R. Wagner, and J.-D. Werthel. Outcome of lower trapezius transfer to reconstruct massive irreparable posterior-superior rotator cuff tear. Journal of shoulder and elbow surgery, 25(8):1346–1353, 2016

    work page 2016

  14. [14]

    Gleicher

    M. Gleicher. Considerations for visualizing comparison. IEEE transac- tions on visualization and computer graphics, 24(1):413–423, 2018

    work page 2018

  15. [15]

    Harrower and C

    M. Harrower and C. A. Brewer. Colorbrewer. org: an online tool for selecting colour schemes for maps. The Cartographic Journal, 40(1):27– 37, 2003

    work page 2003

  16. [16]

    Heuberer, A

    P. Heuberer, A. Kranzl, B. Laky, W. Anderl, and C. Wurnig. Elec- tromyographic analysis: shoulder muscle activity revisited. Archives of orthopaedic and trauma surgery, 135(4):549–563, 2015

    work page 2015

  17. [17]

    Hullman, N

    J. Hullman, N. Diakopoulos, and E. Adar. Contextifier: automatic gen- eration of annotated stock visualizations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , pp. 2707–2716. ACM, 2013

    work page 2013

  18. [18]

    S. Jang, N. Elmqvist, and K. Ramani. Gestureanalyzer: visual analytics for pattern analysis of mid-air hand gestures. In Proceedings of the 2nd ACM symposium on Spatial user interaction, pp. 30–39. ACM, 2014

    work page 2014

  19. [19]

    S. Jang, N. Elmqvist, and K. Ramani. Motionflow: Visual abstraction and aggregation of sequential patterns in human motion tracking data. IEEE transactions on visualization and computer graphics, 22(1):21–30, 2016

    work page 2016

  20. [20]

    Javed and N

    W. Javed and N. Elmqvist. Exploring the design space of composite visualization. In Visualization Symposium, IEEE Pacific(PACIFICVIS), vol. 00, pp. 1–8, 02 2012. doi: 10.1109/PacificVis.2012.6183556

    work page doi:10.1109/paci 2012

  21. [21]

    Javed, B

    W. Javed, B. McDonnel, and N. Elmqvist. Graphical perception of multiple time series. IEEE transactions on visualization and computer graphics, 16(6):927–934, 2010

    work page 2010

  22. [22]

    Kehrer and H

    J. Kehrer and H. Hauser. Visualization and visual analysis of multifaceted scientific data: A survey. IEEE transactions on visualization and computer graphics, 19(3):495–513, 2013

    work page 2013

  23. [23]

    Kehrer, F

    J. Kehrer, F. Ladst¨adter, P. Muigg, H. Doleisch, A. Steiner, and H. Hauser. Hypothesis generation in climate research with interactive visual data exploration. IEEE Transactions on Visualization and Computer Graphics, 14(6):1579–1586, 2008

    work page 2008

  24. [24]

    R. Kincaid. Signallens: Focus+ context applied to electronic time series. IEEE Transactions on Visualization and Computer Graphics, 16(6):900– 907, 2010

    work page 2010

  25. [25]

    Kokoska and D

    S. Kokoska and D. Zwillinger. CRC standard probability and statistics tables and formulae. Crc Press, 1999

    work page 1999

  26. [26]

    P. R. Krekel, E. R. Valstar, J. De Groot, F. H. Post, R. G. Nelissen, and C. P. Botha. Visual analysis of multi-joint kinematic data. In Computer Graphics Forum, vol. 29, pp. 1123–1132. Wiley Online Library, 2010

    work page 2010

  27. [27]

    H. Lam, M. Tory, and T. Munzner. Bridging from goals to tasks with design study analysis reports. IEEE transactions on visualization and computer graphics, 24(1):435–445, 2018

    work page 2018

  28. [28]

    Q. Li, P. Xu, Y . Y . Chan, Y . Wang, Z. Wang, H. Qu, and X. Ma. A visual analytics approach for understanding reasons behind snowballing and comeback in moba games. IEEE transactions on visualization and computer graphics, 23(1):211–220, 2016

    work page 2016

  29. [29]

    T. Munzner. A nested process model for visualization design and valida- tion. IEEE Transactions on Visualization & Computer Graphics, (6):921– 928, 2009

    work page 2009

  30. [30]

    T. Munzner. Visualization analysis and design. CRC press, 2014

    work page 2014

  31. [31]

    K. T. Nguyen, H. Gauffin, A. Ynnerman, and T. Ropinski. Quantitative analysis of knee movement patterns through comparative visualization. In Visualization in Medicine and Life Sciences III , pp. 265–284. Springer, 2016

    work page 2016

  32. [32]

    J. Poco, A. Dasgupta, Y . Wei, W. Hargrove, C. Schwalm, R. Cook, E. Bertini, and C. Silva. Similarityexplorer: A visual inter-comparison tool for multifaceted climate data. In Computer Graphics Forum, vol. 33, pp. 341–350. Wiley Online Library, 2014

    work page 2014

  33. [33]

    Rong and P

    K. Rong and P. Bailis. Asap: prioritizing attention via time series smooth- ing. Proceedings of the VLDB Endowment, 10(11):1358–1369, 2017

    work page 2017

  34. [34]

    V . I. Sakellariou, N. K. Badilas, G. A. Mazis, N. A. Stavropoulos, H. K. Kotoulas, S. Kyriakopoulos, I. Tagkalegkas, and I. P. Sofianos. Brachial plexus injuries in adults: evaluation and diagnostic approach. ISRN ortho- pedics, 2014, 2014

    work page 2014

  35. [35]

    Saraiya, C

    P. Saraiya, C. North, V . Lam, and K. A. Duca. An insight-based longitu- dinal study of visual analytics. IEEE Transactions on Visualization and Computer Graphics, 12(6):1511–1522, 2006

    work page 2006

  36. [36]

    L. C. Sheffler, L. Lattanza, M. Sison-Williamson, and M. A. James. Biceps brachii long head overactivity associated with elbow flexion contracture in brachial plexus birth palsy. The Journal of Bone and Joint Surgery. American volume., 94(4):289, 2012

    work page 2012

  37. [37]

    Shepherd

    A. Shepherd. Hta as a framework for task analysis. Ergonomics, 41(11):1537–1552, 1998

    work page 1998

  38. [38]

    Shneiderman

    B. Shneiderman. The eyes have it: A task by data type taxonomy for information visualizations. In Visual Languages, 1996. Proceedings., IEEE Symposium on, pp. 336–343. IEEE, 1996

    work page 1996

  39. [39]

    Shneiderman and C

    B. Shneiderman and C. Plaisant. Strategies for evaluating information visualization tools: multi-dimensional in-depth long-term case studies. In Proceedings of the 2006 AVI workshop on BEyond time and errors: novel evaluation methods for information visualization, pp. 1–7. ACM, 2006

    work page 2006

  40. [40]

    G. Smith. Spike2 for windows, version 5. Cambridge Electronic Design Limited, Cambridge, 2003

    work page 2003

  41. [41]

    E. R. Tufte. The visual display of quantitative information, vol. 2. Graphics press Cheshire, CT, 2001

    work page 2001

  42. [42]

    Valdivia, F

    P. Valdivia, F. Dias, F. Petronetto, C. T. Silva, and L. G. Nonato. Wavelet- based visualization of time-varying data on graphs. In Visual Analytics Science and Technology (VAST), 2015 IEEE Conference on, pp. 1–8. IEEE, 2015

    work page 2015

  43. [43]

    T. D. Wang, C. Plaisant, B. Shneiderman, N. Spring, D. Roseman, G. Marc- hand, V . Mukherjee, and M. Smith. Temporal summaries: Supporting temporal categorical searching, aggregation and comparison. IEEE trans- actions on visualization and computer graphics, 15(6), 2009

    work page 2009

  44. [44]

    M. O. Ward and Z. Guo. Visual exploration of time-series data with shape space projections. In Computer Graphics Forum, vol. 30, pp. 701–710. Wiley Online Library, 2011

    work page 2011

  45. [45]

    Wilhelm, A

    N. Wilhelm, A. V¨ogele, R. Zsoldos, T. Licka, B. Kr¨uger, and J. Bernard. Furyexplorer: visual-interactive exploration of horse motion capture data. In Visualization and Data Analysis 2015, vol. 9397, p. 93970F. Interna- tional Society for Optics and Photonics, 2015

    work page 2015

  46. [46]

    Zhang, K

    Y . Zhang, K. Chanana, and C. Dunne. IDMVis: Temporal event sequence visualization for type 1 diabetes treatment decision support. IEEE trans- actions on visualization and computer graphics, 25(1):512–522, 2018

    work page 2018

  47. [47]

    J. Zhao, F. Chevalier, and R. Balakrishnan. Kronominer: using multi-foci navigation for the visual exploration of time-series data. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1737–1746. ACM, 2011

    work page 2011

  48. [48]

    J. Zhao, F. Chevalier, E. Pietriga, and R. Balakrishnan. Exploratory analy- sis of time-series with chronolenses. IEEE Transactions on Visualization and Computer Graphics, 17(12):2422–2431, 2011

    work page 2011

  49. [49]

    J. Zhao, S. M. Drucker, D. Fisher, and D. Brinkman. Timeslice: Interactive faceted browsing of timeline data. In Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 433–436. ACM, 2012

    work page 2012