pith. sign in

arxiv: 2604.10756 · v1 · submitted 2026-04-12 · 💻 cs.HC

Towards Universal Visualisation of Emotional States for Information Systems

Michal R Wrobel , Agnieszka Landowska , Karolina Makuch This is my paper

Pith reviewed 2026-05-10 15:33 UTC · model grok-4.3

classification 💻 cs.HC
keywords emotion visualizationaffective information systemsuser preferencesdiscrete emotionsdimensional modelvisual attributeshuman-computer interaction
0
0 comments X

The pith

Color, speed, and size correlate with discrete emotions while speed links to arousal, per user preferences.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The authors asked 419 participants to state their preferred ways to show emotions through visual features such as color, size, speed, shape, and animation type. Clear correlations emerged between color, speed, and size choices and specific discrete emotion categories. Speed also aligned with arousal levels when emotions were viewed in a dimensional framework. These patterns are offered as an early basis for creating consistent emotion displays that information systems could adopt. If reliable, such mappings would let software convey feelings in a more direct and shared manner without relying on text or labels alone.

Core claim

The study found that color, speed, and size correlated with selected discrete emotion labels, while speed correlated with arousal in a dimensional model. This is presented as a first step towards defining a universal emotion representation for use in information systems.

What carries the argument

A preference survey that maps visual parameters (color, size, speed, shape, animation type) onto both discrete emotion labels and dimensional arousal values.

Load-bearing premise

Self-reported preferences from 419 participants represent typical or universal associations suitable for information systems.

What would settle it

A follow-up study with a new group of participants that finds no statistically significant correlations, or entirely different mappings, between the same visual attributes and emotion categories.

Figures

Figures reproduced from arXiv: 2604.10756 by Agnieszka Landowska, Karolina Makuch, Michal R Wrobel.

Figure 1
Figure 1. Figure 1: Screenshots of the help screen for defining animation parameters (top) and specifying a values [PITH_FULL_IMAGE:figures/full_fig_p003_1.png] view at source ↗
Figure 2
Figure 2. Figure 2: Selected set of colors. 1. Blinking rectangle (r_blink) 2. Squeezing rectangle (r_squeeze) 3. Bouncing square (s_bouce) 4. Rotating square (s_rotate) 5. Rotating and enlarging square (s_enlarge) 6. Jumping triangle (t_jump) 7. Bouncing triangle (t_bouce) 8. Enlarging circle (c_enlarge) 9. Jumping circle (c_jump) 10. Rotating circle (c_rotate) [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: Selected set of animations. surprise, sadness, anger, disgust, contempt, fear, shyness, and guilt. Colors: Color selection was initially based on Plutchik’s theory of emotions [23]. The goal was to present participants with a wide range of colors, significantly different from each other. The initial selection was then modified after a pilot study in which participants indicated little difference between so… view at source ↗
Figure 4
Figure 4. Figure 4: Percentage of color indications for each emotion (white represents the sum of indications for [PITH_FULL_IMAGE:figures/full_fig_p005_4.png] view at source ↗
Figure 5
Figure 5. Figure 5: Colors relationship with VAD dimensions. [PITH_FULL_IMAGE:figures/full_fig_p006_5.png] view at source ↗
Figure 6
Figure 6. Figure 6: Speed and size for each label [PITH_FULL_IMAGE:figures/full_fig_p007_6.png] view at source ↗
Figure 7
Figure 7. Figure 7: Animations types for six selected labels [PITH_FULL_IMAGE:figures/full_fig_p008_7.png] view at source ↗
Figure 8
Figure 8. Figure 8: Animations relationship with VAD dimensions. [PITH_FULL_IMAGE:figures/full_fig_p009_8.png] view at source ↗
read the original abstract

The paper concerns affective information systems that represent and visualize human emotional states. The goal of the study was to find typical representations of discrete and dimensional emotion models in terms of color, size, speed, shape, and animation type. A total of 419 participants were asked about their preferences for emotion visualization. We found that color, speed, and size correlated with selected discrete emotion labels, while speed correlated with arousal in a dimensional model. This study is a first step towards defining a universal emotion representation for use in information systems.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

3 major / 1 minor

Summary. The manuscript reports results from a survey of 419 participants on their preferences for visualizing discrete and dimensional emotion models using visual parameters including color, size, speed, shape, and animation type. The authors identify correlations between color/speed/size and selected discrete emotion labels, and between speed and arousal in a dimensional model, framing the work as a first step toward universal emotion representations suitable for affective information systems.

Significance. If the reported mappings prove reliable, generalizable, and effective in deployed systems, the findings could support standardized visual encodings that improve interpretability in emotion-aware interfaces and affective computing applications. The sample size provides a reasonable starting point for preference data, but the absence of validation beyond self-report limits claims of universality or practical utility.

major comments (3)
  1. [Abstract] Abstract: The central claims of correlations between visual parameters and emotion labels are presented without any statistical details (e.g., correlation coefficients, p-values, confidence intervals, or error bars), participant demographics, or description of the analysis procedure, leaving the empirical support for the mappings only partially substantiated.
  2. [Results/Discussion (implied from abstract framing)] The study does not report any downstream validation of the identified preferences, such as emotion recognition accuracy tests, comparison against baseline visualizations, cross-cultural replication, or assessment of whether the mappings improve task performance or understanding when embedded in an actual information system.
  3. [Abstract and study description] The positioning of the results as a step toward 'universal' representations is not supported by evidence of generalizability; the sample is described only by size (419), with no details on recruitment, cultural diversity, or controls that would address whether self-reported preferences reflect perceptual mappings rather than aesthetic or idiosyncratic choices.
minor comments (1)
  1. [Abstract] The abstract and framing could more clearly distinguish between preference correlations and demonstrated communicative effectiveness to avoid overstatement of applicability to information systems.

Simulated Author's Rebuttal

3 responses · 0 unresolved

We thank the referee for the constructive feedback on our manuscript. The comments highlight important areas for improvement in reporting and framing. We have revised the abstract to include statistical details and demographics, expanded the discussion to address limitations and future validations, and adjusted the language around universality while providing more sample information. Our point-by-point responses follow.

read point-by-point responses

  1. Referee: [Abstract] Abstract: The central claims of correlations between visual parameters and emotion labels are presented without any statistical details (e.g., correlation coefficients, p-values, confidence intervals, or error bars), participant demographics, or description of the analysis procedure, leaving the empirical support for the mappings only partially substantiated.

    Authors: We agree that the abstract should provide more empirical details to substantiate the claims. The revised abstract now includes key statistical results, such as the correlation coefficients and associated p-values for the relationships between color, speed, size and discrete emotions, as well as for speed and arousal. A brief overview of the analysis procedure (e.g., correlation analysis) has been added, along with participant demographics including age, gender, and recruitment via an online platform. Full methodological details are provided in the body of the paper. revision: yes

  2. Referee: [Results/Discussion (implied from abstract framing)] The study does not report any downstream validation of the identified preferences, such as emotion recognition accuracy tests, comparison against baseline visualizations, cross-cultural replication, or assessment of whether the mappings improve task performance or understanding when embedded in an actual information system.

    Authors: We acknowledge that the current study is limited to preference elicitation through a survey and does not include downstream validation experiments. As stated in the manuscript, this work represents a first step. In the revised manuscript, we have added an explicit Limitations section that discusses the absence of validation studies, cross-cultural testing, and system integration assessments. We also outline future research directions to address these, including planned recognition accuracy tests and evaluations in affective information systems. This maintains the focus on the survey findings while transparently noting the scope. revision: partial

  3. Referee: [Abstract and study description] The positioning of the results as a step toward 'universal' representations is not supported by evidence of generalizability; the sample is described only by size (419), with no details on recruitment, cultural diversity, or controls that would address whether self-reported preferences reflect perceptual mappings rather than aesthetic or idiosyncratic choices.

    Authors: The referee correctly notes the limited description in the abstract. We have updated the abstract and study description to include recruitment details (online survey distributed through a crowdsourcing service to participants primarily from Western countries) and sample characteristics beyond size. We have also moderated the language to emphasize that the findings are a preliminary step 'towards' universal representations, explicitly acknowledging the lack of cross-cultural validation and potential influences of aesthetic preferences. We discuss in the paper how the consistent patterns observed support further investigation into perceptual mappings, but agree that additional controls and diverse samples are needed for stronger generalizability claims. revision: yes

Circularity Check

0 steps flagged

No circularity: empirical survey results derived from external participant data

full rationale

The paper conducts a survey of 419 participants to collect self-reported preferences for visualizing emotions via color, size, speed, shape, and animation. Reported correlations (color/speed/size with discrete labels; speed with arousal) are direct statistical summaries of these external inputs. No equations, models, or derivations are present that could reduce outputs to inputs by construction. No self-citations are invoked as load-bearing premises, and the study makes no fitted predictions or uniqueness claims that loop back to its own data. This is a standard empirical reporting structure with independent external grounding.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 0 invented entities

No free parameters or invented entities; relies on standard emotion models and survey methodology.

axioms (1)
  • domain assumption Participant self-reports accurately reflect emotional associations
    Assumed when interpreting survey answers as typical representations

pith-pipeline@v0.9.0 · 5378 in / 924 out tokens · 38167 ms · 2026-05-10T15:33:11.076421+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

25 extracted references · 25 canonical work pages

  1. [1]

    Emotion recognition and its applications

    Agata Kołakowska, Agnieszka Landowska, Mariusz Szwoch, Wioleta Szwoch, and Michal R Wrobel. “Emotion recognition and its applications”. In:Human-computer systems interaction: Backgrounds and applications 3(2014), pp. 51–62

    work page 2014

  2. [2]

    A survey on emotional visualization and visual analysis

    Jiaqi Wang et al. “A survey on emotional visualization and visual analysis”. In:Journal of Visual- ization26.1 (Feb. 2023), pp. 177–198.issn: 1875-8975.doi:10.1007/s12650-022-00872-5

    work page doi:10.1007/s12650-022-00872-5 2023

  3. [3]

    Challenges of Emotion De- tection Using Facial Expressions and Emotion Visualisation in Remote Communication

    Eylül Ertay, Hao Huang, Zhanna Sarsenbayeva, and Tilman Dingler. “Challenges of Emotion De- tection Using Facial Expressions and Emotion Visualisation in Remote Communication”. In:Ad- junct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Co...

    work page doi:10.1145/3460418.3479341 2021

  4. [4]

    Visualisingemotioninsupport of patient-physician communication: an empirical study

    HuaMa,XuSun,GlynLawson,QingfengWang,andYaorunZhang.“Visualisingemotioninsupport of patient-physician communication: an empirical study”. In:Behaviour & Information Technology (Aug. 2023).doi:10.1080/0144929X.2022.2097954

    work page doi:10.1080/0144929x.2022.2097954 2023

  5. [5]

    Design of an Interactive Mind Calligraphy System by Affec- tive Computing and Visualization Techniques for Real-Time Reflections of the Writer’s Emotions

    Chao-Ming Wang and Yu-Chen Chen. “Design of an Interactive Mind Calligraphy System by Affec- tive Computing and Visualization Techniques for Real-Time Reflections of the Writer’s Emotions”. In:Sensors20.20 (2020).issn: 1424-8220.doi:10.3390/s20205741

    work page doi:10.3390/s20205741 2020

  6. [6]

    Visualization method of emotion information for long distance interaction

    Jesus A. Garcia Sanchez, Atsushi Shibata, Kazuhiro Ohnishi, Fangyan Dong, and Kaoru Hirota. “Visualization method of emotion information for long distance interaction”. In:2014 International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM). 2014, pp. 1–6.doi:10.1109/HNICEM.2014.7016201

    work page doi:10.1109/hnicem.2014.7016201 2014

  7. [7]

    Modeling emotions for affect-aware applications

    Agata Kołakowska, Agnieszka Landowska, Mariusz Szwoch, Wioleta Szwoch, and Michał Wróbel. “Modeling emotions for affect-aware applications”. In:Information Systems Development and Ap- plications. Faculty of Management, University of Gdańsk, Polanf, 2015

    work page 2015

  8. [8]

    Constants across cultures in the face and emotion

    Paul Ekman and Wallace V Friesen. “Constants across cultures in the face and emotion.” In:Journal of personality and social psychology17.2 (1971), p. 124

    work page 1971

  9. [9]

    Development and validation of brief measures of positive and negative affect: the PANAS scales

    David Watson, Lee Anna Clark, and Auke Tellegen. “Development and validation of brief measures of positive and negative affect: the PANAS scales.” In:Journal of personality and social psychology 54.6 (1988), p. 1063

    work page 1988

  10. [10]

    A circumplex model of affect

    James A Russell. “A circumplex model of affect.” In:Journal of personality and social psychology 39.6 (1980), p. 1161

    work page 1980

  11. [11]

    Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament

    Albert Mehrabian. “Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament”. In:Current Psychology14 (1996), pp. 261–292. 11

    work page 1996

  12. [12]

    Emotion-Prints:Interaction- Driven Emotion Visualization on Multi-Touch Interfaces

    DanielCernea,ChristopherWeber,AchimEbert,andAndreasKerren.“Emotion-Prints:Interaction- Driven Emotion Visualization on Multi-Touch Interfaces”. In: vol. 9397. Feb. 2015.doi:10.1117/ 12.2076473

    work page 2015

  13. [13]

    Mood Swings: Design and evaluation of affective interactive art

    Leticia Bialoskorski, Joyce Westerink, and Egon L. van den Broek. “Mood Swings: Design and evaluation of affective interactive art”. In:The New Review of Hypermedia and Multimedia15 (Aug. 2009), pp. 173–191.doi:10.1080/13614560903131898

    work page doi:10.1080/13614560903131898 2009

  14. [14]

    A foundation for emotional expressivity

    Anna Ståhl, Petra Sundström, and Kristina Höök. “A foundation for emotional expressivity”. In: Proceedings of the 2005 Conference on Designing for User EXperience. DUX ’05. , San Francisco, California, USA, AIGA: American Institute of Graphic Arts, 2005, 33–es.isbn: 159593250X

    work page 2005

  15. [15]

    Music Emotion Visualization through Colour

    Januka Dharmapriya et al. “Music Emotion Visualization through Colour”. In:2021 International Conference on Electronics, Information, and Communication (ICEIC). 2021, pp. 1–6.doi:10 . 1109/ICEIC51217.2021.9369788

    work page arXiv 2021

  16. [16]

    Multifaceted Visualisation of Annotated Social Media Data

    Sanat Kumar Bista, Surya Nepal, and Cécile Paris. “Multifaceted Visualisation of Annotated Social Media Data”. In:2014 IEEE International Congress on Big Data. 2014, pp. 699–706.doi:10.1109/ BigData.Congress.2014.103

    work page 2014

  17. [17]

    A comparative evaluation of techniques for time se- ries visualizations of emotions

    Julia Sheidin, Joel Lanir, and Tsvi Kuflik. “A comparative evaluation of techniques for time se- ries visualizations of emotions”. In: Sept. 2019, pp. 1–9.isbn: 978-1-4503-7190-2.doi:10.1145/ 3351995.3352054

    work page arXiv 2019

  18. [18]

    AniSAM & AniAvatar: Animated Visualizations of Affective States

    Andreas Sonderegger, Klaus Heyden, Alain Chavaillaz, and Juergen Sauer. “AniSAM & AniAvatar: Animated Visualizations of Affective States”. In:Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. CHI ’16. San Jose, California, USA: Association for Computing Machinery, 2016, pp. 4828–4837.isbn: 9781450333627.doi:10.1145/2858036.2858365

    work page doi:10.1145/2858036.2858365 2016

  19. [19]

    Affective Color in Visualization

    Lyn Bartram, Abhisekh Patra, and Maureen Stone. “Affective Color in Visualization”. In:Pro- ceedings of the 2017 CHI Conference on Human Factors in Computing Systems. CHI ’17. Denver, Colorado, USA: Association for Computing Machinery, 2017, pp. 1364–1374.isbn: 9781450346559. doi:10.1145/3025453.3026041

    work page doi:10.1145/3025453.3026041 2017

  20. [20]

    Emotion visualization in Virtual Reality: An integrative review

    Andres Pinilla et al. “Emotion visualization in Virtual Reality: An integrative review”. In:Frontiers in Virtual Reality2 (2021).doi:10.3389/frvir.2021.630731

    work page doi:10.3389/frvir.2021.630731 2021

  21. [21]

    Visual analysis of online social media to open up the investigation of stance phenomena

    Kostiantyn Kucher, Teri Schamp-Bjerede, Andreas Kerren, Carita Paradis, and Magnus Sahlgren. “Visual analysis of online social media to open up the investigation of stance phenomena”. In: Information Visualization15.2 (2016), pp. 93–116.doi:10.1177/1473871615575079

    work page doi:10.1177/1473871615575079 2016

  22. [22]

    Differential emotions theory

    Carroll E Izard and Carroll E Izard. “Differential emotions theory”. In:Human emotions(1977), pp. 43–66

    work page 1977

  23. [23]

    A general psychoevolutionary theory of emotion

    Robert Plutchik. “A general psychoevolutionary theory of emotion”. In:Theories of emotion. Else- vier, 1980, pp. 3–33

    work page 1980

  24. [24]

    Journal of Behavior Therapy and Experimental Psychi- atry25(1), 49–59 (1994)

    Margaret M Bradley and Peter J Lang. “Measuring emotion: the self-assessment manikin and the semantic differential”. In:Journal of behavior therapy and experimental psychiatry25.1 (1994), pp. 49–59.doi:10.1016/0005-7916(94)90063-9

    work page doi:10.1016/0005-7916(94)90063-9 1994

  25. [25]

    Routledge, 2005.isbn: 978-0-24080688-4

    Patti Bellantoni.If It’s Purple, Someone’s Gonna Die: The Power of Color in Visual Storytelling. Routledge, 2005.isbn: 978-0-24080688-4. 12

    work page 2005