Music Interpretation and Emotion Perception: A Computational and Neurophysiological Investigation

Anastasia Georgaki; Christina Anagnostopoulou; Giorgos Stamou; Ioanna Zioga; Spyridon Kantarelis; Vassilis Lyberatos

arxiv: 2506.01982 · v4 · pith:K7Z6TWVNnew · submitted 2025-05-16 · 💻 cs.HC · cs.AI

Music Interpretation and Emotion Perception: A Computational and Neurophysiological Investigation

Vassilis Lyberatos , Spyridon Kantarelis , Ioanna Zioga , Christina Anagnostopoulou , Giorgos Stamou , Anastasia Georgaki This is my paper

Pith reviewed 2026-05-22 14:13 UTC · model grok-4.3

classification 💻 cs.HC cs.AI

keywords music performanceemotion perceptionimprovisationexpressivityneurophysiologyacoustic analysisaudience engagementemotional communication

0 comments

The pith

Expressive and improvisational music performances generate unique acoustic features that strengthen emotional responses and increase listener relaxation.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper examines how different ways of playing music, such as using standard pieces versus improvising, affect the emotions felt by both the musicians and their listeners. It combines sound analysis with measurements of brain activity and body responses to show that more expressive playing stands out in its sound qualities and leads to stronger feelings and more relaxation. Readers might care because this points to the value of allowing freedom in music making for better connection and emotional impact in performances and potentially in education or therapy.

Core claim

Professional musicians performed repertoire pieces, diatonic modal etudes, and improvisations with varying levels of expressiveness. Audio analysis identified unique acoustic features in expressive and improvisational performances, emotion annotations indicated stronger emotional responses, and neurophysiological measurements showed greater relaxation during improvisational performances.

What carries the argument

Multimodal integration of computational audio feature analysis and neurophysiological recordings to link performance expressivity with emotional perception.

If this is right

Expressive performances enhance emotional communication between musicians and audiences.
Improvisation specifically promotes greater relaxation in listeners.
Unique acoustic features in expressive playing correlate with stronger audience emotional reactions.
Levels of expressiveness play a key role in audience engagement during music listening.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

Music education could emphasize improvisational skills to improve emotional expression.
Therapeutic applications of music might focus on improvisation for relaxation benefits.
Similar multimodal methods could be applied to study emotional responses in other performing arts.
Computational tools for music could be developed to quantify expressivity for performance analysis.

Load-bearing premise

Emotional annotations accurately reflect true emotional states and the neurophysiological measurements reliably capture emotional perception without major influences from the performance environment.

What would settle it

A replication study with objective measures like heart rate variability or EEG patterns showing no significant differences in relaxation or emotional intensity between improvisational and non-improvisational performances would falsify the key findings.

Figures

Figures reproduced from arXiv: 2506.01982 by Anastasia Georgaki, Christina Anagnostopoulou, Giorgos Stamou, Ioanna Zioga, Spyridon Kantarelis, Vassilis Lyberatos.

**Figure 1.** Figure 1: Comparison of statistically significant acoustic features. Left: Analysis across performance conditions (Modes, [PITH_FULL_IMAGE:figures/full_fig_p005_1.png] view at source ↗

**Figure 2.** Figure 2: Lift of Emotions in the Non-Expressive to Ex [PITH_FULL_IMAGE:figures/full_fig_p005_2.png] view at source ↗

**Figure 3.** Figure 3: Distribution of reported emotions. Left: Comparison across performance conditions (Modes, Repertoire, Impro [PITH_FULL_IMAGE:figures/full_fig_p006_3.png] view at source ↗

**Figure 4.** Figure 4: Alpha rhythm power analysis across perfor [PITH_FULL_IMAGE:figures/full_fig_p006_4.png] view at source ↗

**Figure 5.** Figure 5: DECISION TREES for Peacefulness emotion tag: Performer (left) and Audience (right). These findings suggest that expressiveness enhances the clarity and transmission of emotional content in music. Concerning our third research question, on the neural level, there was a trend for higher alpha power in the improvisation setting compared to repertoire and mode. Brain oscillatory activity in the alpha frequenc… view at source ↗

read the original abstract

This study investigates emotional expression and perception in music performance using computational and neurophysiological methods. The influence of different performance settings, such as repertoire, diatonic modal etudes, and improvisation, as well as levels of expressiveness, on performers' emotional communication and listeners' reactions is explored. Professional musicians performed various tasks, and emotional annotations were provided by both performers and the audience. Audio analysis revealed that expressive and improvisational performances exhibited unique acoustic features, while emotion analysis showed stronger emotional responses. Neurophysiological measurements indicated greater relaxation in improvisational performances. This multimodal study highlights the significance of expressivity in enhancing emotional communication and audience engagement.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Desk Editor's Note private letter to a colleague

The paper runs a multimodal setup on expressivity in music tasks but the claims about emotional responses and relaxation rest on thin evidence without stats or validation checks.

read the letter

This paper looks at how expressive playing and improvisation change acoustic features in the sound and how performers and listeners react emotionally, using audio analysis plus some neurophysiological recordings. They had professional musicians do repertoire pieces, modal etudes, and free improvisation, collected annotations from both sides, and noted greater relaxation signals during the improvisational parts along with distinct audio patterns in the expressive ones. The setup brings together computational features and brain measures in one study, which is a reasonable step for this corner of music psychology even if similar combinations exist elsewhere. The direct comparison across task types gives a bit more texture than single-condition work. The soft spots sit in the missing pieces. The abstract gives no sample sizes, no statistical tests, no error bars, and no mention of controls for performance length, physical demands, or setting effects. Treating performer and audience ratings as accurate maps of transmitted emotion, and the neuro measures as clean markers of relaxation or perception, needs some validation like inter-rater checks or correlations with the audio data; without that the causal link to better communication stays loose. If the full methods section adds those details and shows the differences hold up, the work gains traction. Readers in affective computing or music performance research might pull a few practical ideas from the task design. It deserves peer review because the questions matter to the field and the basic approach is replicable, though referees will likely press hard on the analysis rigor and confound handling.

Referee Report

3 major / 2 minor

Summary. The manuscript reports a multimodal investigation of emotional expression and perception in music performance. Professional musicians performed repertoire pieces, diatonic modal etudes, and improvisations at varying levels of expressiveness. Both performers and audience members provided emotional annotations. Computational audio analysis identified unique acoustic features in expressive and improvisational performances linked to stronger emotional responses, while neurophysiological recordings indicated greater relaxation during improvisational performances. The authors conclude that expressivity enhances emotional communication and audience engagement.

Significance. If the quantitative results and controls are strengthened, the work could contribute to understanding how expressivity and improvisation shape emotional transmission in live music settings by combining acoustic feature extraction with neurophysiological signals. The multimodal design itself is a constructive element that could inform future studies in affective computing and music psychology.

major comments (3)

[Abstract] Abstract: The claims that 'audio analysis revealed that expressive and improvisational performances exhibited unique acoustic features' and 'emotion analysis showed stronger emotional responses' are presented without sample sizes, statistical tests, effect sizes, or error estimates, leaving the central quantitative support for the headline claim unverifiable.
[Methods] Methods/Results: No inter-rater reliability statistics or correlation analyses between performer/audience annotations and the extracted acoustic features are reported, so the assumption that annotations accurately index transmitted emotional states remains untested and load-bearing for the communication claim.
[Results] Results: The finding of 'greater relaxation in improvisational performances' from neurophysiological measurements lacks reported controls for confounds such as performance duration, motor demands, or setting familiarity, which directly affects whether relaxation can be attributed to emotional perception rather than extraneous factors.

minor comments (2)

[Abstract] Abstract: Adding the number of musicians, performances, and audience participants would immediately improve the reader's ability to gauge the scale of the study.
[Methods] The integration of computational and neurophysiological data streams is described at a high level; a brief schematic or table summarizing the multimodal fusion approach would aid clarity.

Simulated Author's Rebuttal

3 responses · 0 unresolved

We thank the referee for their thoughtful and constructive comments on our manuscript. We address each of the major comments below and outline the revisions we plan to make.

read point-by-point responses

Referee: [Abstract] Abstract: The claims that 'audio analysis revealed that expressive and improvisational performances exhibited unique acoustic features' and 'emotion analysis showed stronger emotional responses' are presented without sample sizes, statistical tests, effect sizes, or error estimates, leaving the central quantitative support for the headline claim unverifiable.

Authors: We agree with this observation. The abstract in the current version summarizes the findings at a high level without the supporting quantitative details. In the revised manuscript, we will expand the abstract to include the number of participants and performances (sample sizes), the specific statistical tests employed (e.g., repeated-measures ANOVA), effect sizes (Cohen's d), and standard errors or confidence intervals. This will ensure the claims are supported by verifiable quantitative evidence directly in the abstract. revision: yes
Referee: [Methods] Methods/Results: No inter-rater reliability statistics or correlation analyses between performer/audience annotations and the extracted acoustic features are reported, so the assumption that annotations accurately index transmitted emotional states remains untested and load-bearing for the communication claim.

Authors: We acknowledge that these analyses were not included in the original submission. To address this, we will compute inter-rater reliability using appropriate metrics such as intraclass correlation coefficients (ICC) for the emotional annotations provided by performers and audience members. Additionally, we will perform correlation analyses (e.g., Pearson correlations) between the annotation scores and the key acoustic features identified in the computational analysis. These results will be added to the Methods and Results sections to test and support the assumption that the annotations reflect transmitted emotional states. revision: yes
Referee: [Results] Results: The finding of 'greater relaxation in improvisational performances' from neurophysiological measurements lacks reported controls for confounds such as performance duration, motor demands, or setting familiarity, which directly affects whether relaxation can be attributed to emotional perception rather than extraneous factors.

Authors: We appreciate this important point regarding potential confounds. In our study, all performances were conducted in the same laboratory setting to control for familiarity, and we matched performance durations as closely as possible across conditions. Motor demands were inherent to the performance type but we will add a section discussing these factors and any steps taken to mitigate them, such as using relative measures or baseline corrections in the neurophysiological data analysis. We will also report any available data on performance durations and discuss limitations regarding motor demands. If feasible, additional post-hoc analyses will be included. revision: partial

Circularity Check

0 steps flagged

Empirical multimodal study relies on direct measurements with no derivation chain

full rationale

The paper reports an experimental protocol with professional musicians performing repertoire, etudes, and improvisations; collecting performer and audience emotional annotations; extracting acoustic features from audio; and recording neurophysiological signals. No equations, fitted parameters, predictive models, or self-citation chains appear in the provided text. All reported outcomes (unique acoustic features, stronger emotional responses, greater relaxation) are presented as direct results of the measurements rather than outputs derived from prior results within the same paper. The study is therefore self-contained against external benchmarks and receives the default non-circularity finding.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 0 invented entities

The central claims rest on standard domain assumptions from affective science rather than new free parameters, invented entities, or ad-hoc axioms introduced by the paper.

axioms (1)

domain assumption Emotional states and communication can be validly inferred from self-reported annotations combined with neurophysiological signals such as relaxation measures.
The study directly uses performer and audience annotations plus neurophysiological data to conclude stronger emotional responses and greater relaxation.

pith-pipeline@v0.9.0 · 5649 in / 1373 out tokens · 69988 ms · 2026-05-22T14:13:08.429607+00:00 · methodology

discussion (0)

Lean theorems connected to this paper

Citations machine-checked in the Pith Canon. Every link opens the source theorem in the public Lean library.

IndisputableMonolith/Cost/FunctionalEquation.lean washburn_uniqueness_aczel unclear

?

unclear
Relation between the paper passage and the cited Recognition theorem.

Audio analysis revealed that expressive and improvisational performances exhibited unique acoustic features... Neurophysiological measurements indicated greater relaxation in improvisational performances.
IndisputableMonolith/Foundation/RealityFromDistinction.lean reality_from_one_distinction unclear

?

unclear
Relation between the paper passage and the cited Recognition theorem.

We employed interpretable machine learning techniques, specifically DECISION TREES, to explore the relationships between emotions, audio features, and biosignals.

What do these tags mean?

matches: The paper's claim is directly supported by a theorem in the formal canon.
supports: The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
extends: The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
uses: The paper appears to rely on the theorem as machinery.
contradicts: The paper's claim conflicts with a theorem or certificate in the canon.
unclear: Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.