REVIEW 3 major objections 6 minor 30 references
Evaluating Interval-based Tokenization for Pitch Representation in Symbolic Music Analysis
T0 review · 3 major / 6 minor · reviewed 2026-08-10 · deepseek-v4-flash
Pith's one-line read This paper claims that replacing absolute MIDI pitch tokens with intervals measured from a chosen reference line (melody, skyline, or bottom line) improves era classification, start-of-phrase detection, and chord inversion identification…
desk verdict Useful intervalization framework and a nice interpretability case study, but the 'improves all tasks' claim is post-hoc and statistically unsubstantiated. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The carrying object is the intervalization operator I, defined by a reference subsequence xref chosen from the note sequence x, a method Iref for encoding reference events, and a method Inon-ref for encoding all other events. In the studied variants, reference notes are encoded either absolutely or as horizontal intervals from the previous reference note, and non-reference notes are encoded as vertical intervals from the simultaneous reference pitch. This operator turns any absolute-pitch tokenization into a relative one and is the single mechanism through which the paper obtains both the performance gains and the explainability results.
What would settle it
Train both intervalized and absolute-pitch models on a polyphonic dataset with no single reference line, or on homophonic pieces with the reference chosen at random; if intervalization no longer beats absolute pitches when the reference is random or absent, the claimed improvement depends on having a musically meaningful reference. A more direct check would evaluate the best intervalized and absolute models on the same pieces transposed to many keys; if interval tokens do not make performance more stable across keys, the transposition-invariance intuition is unsupported.
Extended reading notes
Core claim
On the paper's own terms, the central discovery is that intervalization, encoding absolute pitches as intervals relative to a reference subsequence, consistently outperforms absolute pitch encoding in the studied tasks, and the choice of reference is not arbitrary. Models using interval tokens beat their absolute-pitch counterparts across all twelve per-task comparisons, with the largest gain in end-to-end start-of-phrase detection and a modest but consistent gain elsewhere. The paper further shows that the best reference tracks musical structure: melodic reference for phrase boundaries, bottom-line reference for chord inversion identification, and no significant difference for era classification. Finally, inspecting the vertical interval tokens produced by the best chord-inversion model reveals distributions that mirror textbook definitions of inversions, making the tokenization directly readable in musical terms.
Load-bearing premise
The evaluation assumes that every piece has a single monophonic reference line (melody, skyline, or bottom line) that can be identified and that every note can be aligned to it; for music without such a line, the intervalization cannot be built, so the claim is only established for homophonic textures.
Editorial extensions
If this is right
- Intervalized tokenization can be applied to existing absolute-pitch tokenizers and sequence models without architectural changes, so the reported gains are cheap to reproduce.
- Downstream tasks benefit from different references, so practitioners should select the reference based on the musical property being analyzed rather than defaulting to the skyline.
- Because vertical interval tokens encode a note's relation to the reference, inspecting their frequency by predicted class gives a direct, musically interpretable view of model behavior.
- Interval tokens help both end-to-end and pre-trained models, and pre-trained models remain about 1.2 times better on average across the studied tasks.
Reading between the lines
- An untested but plausible corollary is that intervalized models are more invariant under key transposition than absolute-pitch models, since intervals are unchanged by uniform transposition; this could be checked by fine-tuning on one key and evaluating on transposed pieces.
- The formal framework permits references outside the piece itself, such as a tonal-centre sequence, which could extend the gains to harmonic tasks where no single performed line serves as a natural reference.
- Because time tokens are untouched by intervalization, the same reference-based interval encoding could be combined with different time encodings, such as bar-position versus time-shift, to identify the best joint pitch-time representation.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a general framework for interval-based tokenization of symbolic music, in which absolute pitch tokens are replaced by pitch intervals computed relative to a reference monophonic sequence (melody, skyline, or bottom line). Six intervalization strategies built on the REMI tokenization are defined, and a BERT-style encoder is trained with and without pre-training on three tasks: era classification, start-of-phrase detection, and chord inversion identification. The paper reports that intervalization improves performance on all three tasks (Figure 2), that the best reference varies by task (Figure 3), and that analyses of vertical-interval-token frequencies reveal musically interpretable patterns for chord inversions (Figure 4). Datasets, code, and pre-trained models are released.
Significance. If the central empirical claim holds, the paper contributes a simple, parameter-free modification to symbolic-music tokenization that yields consistent performance gains across several analysis tasks and provides a natural path toward explainability. The formalization of intervalization is clean and appears to contain no derivation errors. The choice of publicly available datasets, the release of code and models, and the use of three seeds per experimental condition are strengths. The interpretability analysis for chord inversion is suggestive and well aligned with music-theoretic expectations. However, the main empirical comparison is weakened by post-hoc selection of the best intervalization variant without statistical correction, so the headline 'intervalization improves all tasks' claim is not established as reported.
major comments (3)
- [Results, 'Impact of intervalization', Figure 2] The central claim that 'Intervalization improves the model performance for all the tasks' rests on Figure 2, whose caption states that the intervalized model is based on the reference resulting in the best performance. This is post-hoc selection over six intervalized variants (three references crossed with two interval encodings) against a single absolute baseline. Under the null hypothesis that all tokenizations are equally effective, the maximum of six positively correlated variants will tend to beat the single baseline, so the reported gains are maxima over variants rather than the performance of a fixed, pre-specified tokenization. The problem is exacerbated for era classification, where the gain is described as 'marginal 1.2%' and the text says the reference choice has no significant effect. I ask the authors to report the results for each of the six intervalized variants separately (or use an appropriate multiple-comparison correction), include variance or confidence intervals across the three seeds, and state whether the reference choice was made on a validation set or on the same test results shown in Figure 2.
- [Results, 'Impact of intervalization references', Figure 3] The 'best model' counts in Figure 3 are based on 12 comparisons per task, but the comparisons are not independent (they share the same pre-trained weights and overlapping data splits), and no significance test is applied to the counts. For example, the claim that 'models trained with a melodic reference achieve the best performance in 11 of 12 comparisons' for start-of-phrase detection is presented as evidence of a musically meaningful role of melody, yet a random ordering of reference models could produce such a count with non-negligible probability given only 12 trials. Please provide a statistical test (e.g., sign test or permutation test) for these counts, or temper the interpretation accordingly.
- [Evaluation on downstream tasks, 'Downstream tasks'] The evaluation is restricted to datasets with homophonic texture, for which a monophonic reference (melody, skyline, or bottom line) is explicitly present or approximated. While the paper acknowledges this, the abstract and conclusion state the general claim that intervalization improves model performance, and the formalization is presented as a general framework for polyphonic music. The empirical support for intervalization therefore applies only to homophonic music. I recommend stating this restriction in the abstract and conclusion, and ideally adding at least one polyphonic validation or explicitly positioning the contribution as a homophonic-music result.
minor comments (6)
- [Evaluation on downstream tasks, 'Era classification'] Typo: 'bieng composed' should be 'being composed'.
- [Figure 2] The figure would benefit from error bars or a display of per-seed variation; without them, the reader cannot assess the stability of the reported gains.
- [Table 1 and surrounding text] The relationship between the six intervalized strategies and the two encoding families (REMI-abs.+VPI and REMI-HPI+VPI) is clear in the table, but the text in 'Impact of intervalization references' says 'we compare twice, once for the end-to-end and once for the fine-tuned' for each split, which is confusing because there are two encoding settings per reference. Please rephrase to make the counting transparent (e.g., state explicitly that each of the three references is tested for both an absolute-reference encoding and a horizontal-pitch-interval encoding, yielding six intervalized models).
- [Figure 4] The histograms for second and third inversion use very different scales (counts up to ~1000 for root and first, ~20-40 for second and third). Consider normalizing by class size or using a log scale so that the interval distributions are visually comparable across inversion types.
- [Intervalization, notation] In the definition of S_j, the condition '(p, t) ≠ eref_j' is redundant because the reference event is already included in the union. This is not an error, but the notation could be simplified.
- [References] Several reference entries have formatting issues, e.g., 'InProceedings of' and 'InInternational Society for Music Information Retrieval Conference' where spacing or capitalization is inconsistent. Please check the reference list for final typesetting.
Circularity Check
No circularity: intervalization is defined independently of downstream labels and the empirical comparison is self-contained.
full rationale
The paper's intervalization transform is defined formally from note events and a chosen reference sequence (xref, Iref, Inon-ref) without reference to the downstream labels, so no prediction is equivalent by construction to an input. The improvement claim is an empirical comparison over three external tasks (era classification, start-of-phrase detection, chord inversion identification) with released code and data; the best-reference selection in Figure 2 is a model-selection choice, not a fitted parameter renamed as a prediction. Self-citations to Kermarec, Bigo, and Keller (2022) and Le, Bigo, and Keller (2024) provide prior tokenization and task frameworks, but the central contribution does not reduce to those citations: the framework is formalized independently and the results are measured against external datasets and baselines. The explainability analysis is post-hoc interpretation of model predictions, not a derivation. The paper explicitly limits itself to homophonic music with a single melodic track; this is a scope limitation, not a circular assumption. No circular step can be exhibited from the paper's equations; the only concerns are statistical (post-hoc selection, small seed count), which are correctness risks, not circularity.
Assumptions & free parameters
assumptions (3)
- domain assumption All evaluated music is homophonic with a single identifiable monophonic melody track.
- domain assumption Velocity tokens carry no useful information for the three downstream tasks and can be dropped from REMI.
- domain assumption The reference line can be chosen as the melody, skyline, or bottom line and is representative of the musical content.
Cite this review
Pith. "Pith review of Evaluating Interval-based Tokenization for Pitch Representation in Symbolic Music Analysis." pith.science (2026). https://pith.science/paper/DMFBP7J6
@misc{pith2026250104630,
author = {Pith},
title = {Pith review of: Evaluating Interval-based Tokenization for Pitch Representation in Symbolic Music Analysis},
year = {2026},
howpublished = {\url{https://pith.science/paper/DMFBP7J6}},
note = {Machine review of arXiv:2501.04630}
}
read the original abstract
Symbolic music analysis tasks are often performed by models originally developed for Natural Language Processing, such as Transformers. Such models require the input data to be represented as sequences, which is achieved through a process of tokenization. Tokenization strategies for symbolic music often rely on absolute MIDI values to represent pitch information. However, music research largely promotes the benefit of higher-level representations such as melodic contour and harmonic relations for which pitch intervals turn out to be more expressive than absolute pitches. In this work, we introduce a general framework for building interval-based tokenizations. By evaluating these tokenizations on three music analysis tasks, we show that such interval-based tokenizations improve model performances and facilitate their explainability.
Figures
Reference graph
Works this paper leans on
-
[1]
, " * write output.state after.block = add.period write newline
ENTRY address archivePrefix author booktitle chapter edition editor eid eprint howpublished institution isbn journal key month note number organization pages publisher school series title type volume year label extra.label sort.label short.list INTEGERS output.state before.all mid.sentence after.sentence after.block FUNCTION init.state.consts #0 'before.a...
-
[2]
write newline
" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 global.max substring 't := if while FUNCTION word.in bbl.in capitalize " " * FUNCT...
-
[3]
Benward, B. 2018. Music in theory and practice. McGraw Hill Higher Education
work page 2018
-
[4]
Chou, Y.-H.; Chen, I.-C.; Ching, J.; Chang, C.-J.; and Yang, Y.-H. 2024. MidiBERT-Piano: Large-scale Pre-training for Symbolic Music Classification Tasks. Journal of Creative Music Systems, 8(1)
work page 2024
-
[5]
Conklin, D. 2013. Multiple Viewpoint Systems for Music Classification. Journal of New Music Research, 42(1): 19--26
work page 2013
-
[6]
Devlin, J.; Chang, M.-W.; Lee, K.; and Toutanova, K. 2019. BERT : Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North A merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) , 4171--4186. Minneapolis, Minneso...
2019
-
[7]
Dowling, W. J.; and Fujitani, D. S. 1971. Contour, interval, and pitch recognition in memory for melodies. The Journal of the Acoustical Society of America, 49(2B): 524--531
work page 1971
-
[8]
Fradet, N.; Briot, J.-P.; Chhel, F.; El Fallah-Seghrouchni, A.; and Gutowski, N. 2021. Midi T ok: A P ython package for MIDI file tokenization. In International Society for Music Information Retrieval Conference (ISMIR), Late-Breaking Demo Session
work page 2021
Show all 30 references
-
[9]
Fradet, N.; Gutowski, N.; Chhel, F.; and Briot, J.-P. 2023. Impact of time and note duration tokenizations on deep learning symbolic music modeling. In International Society for Music Information Retrieval Conference ( ISMIR )
2023
-
[10]
N.; and Sailor, M
Gotham, M.; Micchi, G.; López, N. N.; and Sailor, M. 2023 a . When in R ome: A Meta-corpus of Functional Harmony. Transactions of the International Society for Music Information Retrieval
2023
-
[11]
OpenScore String Quartet
Gotham, M.; Redbond, M.; Bower, B.; and Jonas, P. 2023 b . The “OpenScore String Quartet” Corpus. In Proceedings of the 10th International Conference on Digital Libraries for Musicology, DLfM '23, 49–57. New York, NY, USA: Association for Computing Machinery. ISBN 9798400708336
2023
-
[12]
Gotham, M. R. H.; and Jonas, P. 2022. The OpenScore Lieder Corpus . In M \"u nnich, S.; and Rizo, D., eds., Music Encoding Conference Proceedings 2021 , 131--136. Humanities Commons . ISBN 978-84-1302-173-7
2022
-
[13]
Hsiao, W.-Y.; Liu, J.-Y.; Yeh, Y.-C.; and Yang, Y.-H. 2021. Compound word transformer: L earning to compose full-song music over dynamic directed hypergraphs. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, 178--186
2021
-
[14]
A.; Vaswani, A.; Uszkoreit, J.; Simon, I.; Hawthorne, C.; Shazeer, N.; Dai, A
Huang, C.-Z. A.; Vaswani, A.; Uszkoreit, J.; Simon, I.; Hawthorne, C.; Shazeer, N.; Dai, A. M.; Hoffman, M. D.; Dinculescu, M.; and Eck, D. 2019. Music Transformer: Generating Music with Long-Term Structure. In International Conference on Learning Representations ( ICLR )
2019
-
[15]
Huang, Y.-S.; and Yang, Y.-H. 2020. Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions. In Proceedings of the 28th ACM International Conference on Multimedia, MM '20, 1180–1188. New York, NY, USA: Association for Computing Machinery....
2020
-
[16]
Ju, Y.; Margot, S.; McKay, C.; Dahn, L.; and Fujinaga, I. 2020. Automatic Figured Bass Annotation Using the New Bach Chorales Figured Bass Dataset . In Proceedings of the 21th International Society for Music Information Retrieval Conference , 640--646
2020
-
[17]
Kermarec, M.; Bigo, L.; and Keller, M. 2022. Improving Tokenization Expressiveness With Pitch Intervals. In International Society for Music Information Retrieval Conference (ISMIR), Late-Breaking Demo Session
2022
-
[18]
Le, D.-V.-T.; Bigo, L.; and Keller, M. 2024. Analyzing Byte-Pair Encoding on Monophonic and Polyphonic Symbolic Music: A Focus on Musical Phrase Segmentation . In 3rd Workshop on NLP for Music and Audio (NLP4MusA) . San Francisco, United States
2024
-
[19]
Le, D.-V.-T.; Bigo, L.; Keller, M.; and Herremans, D. 2024. Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval: A Survey. arXiv:2402.17467
2024 arXiv
-
[20]
Li, Y.; Li, S.; and Fazekas, G. 2023. Pitch Class and Octave-Based Pitch Embedding Training Strategies for Symbolic Music Generation . In Proceedings of the 16th International Symposium on Computer Music Multidisciplinary Research (CMMR) , 86–97. Tokyo, Japan: Zenodo
2023
-
[21]
Oore, S.; Simon, I.; Dieleman, S.; Eck, D.; and Simonyan, K. 2018. This time with feeling: Learning expressive musical performance. Neural Computing and Applications, 32: 955--967
2018
-
[22]
Park, S.; Choi, E.; Kim, J.; and Nam, J. 2024. Mel2Word: A Text-Based Melody Representation for Symbolic Music Analysis. Music & Science, 7
2024
-
[23]
Peters, J. 2016. Fundamentals of Writing Four-part Harmony. CreateSpace Independent Publishing Platform. ISBN 9781536889239
2016
-
[24]
Sarmento, P.; Kumar, A.; Carr, C.; Zukowski, Z.; Barthet, M.; and Yang, Y.-H. 2021. DadaGP : A dataset of tokenized G uitar P ro songs for sequence models. In International Society for Music Information Retrieval Conference ( ISMIR )
2021
-
[25]
Schaffrath, H. 1995. The E ssen F olksong C ollection. In Center for Computer Assisted Research in the Humanities
1995
-
[26]
Schoenberg, A.; Strang, G.; and Stein, L. 1999. Fundamentals of Musical Composition. Faber & Faber. ISBN 9780571196586
1999
-
[27]
Sennrich, R.; Haddow, B.; and Birch, A. 2016. Neural Machine Translation of Rare Words with Subword Units. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 1715--1725. Berlin, Germany: Association for Computati...
2016
-
[28]
P.; and Wiering, F
Van Kranenburg, P.; de Bruin, M.; Grijp, L. P.; and Wiering, F. 2014. The M eertens tune collections. Meertens Online Reports, 2014(1)
2014
-
[29]
Wang, Z.; Chen, K.; Jiang, J.; Zhang, Y.; Xu, M.; Dai, S.; and Xia, G. 2020. POP909: A pop-song dataset for music arrangement generation . In Proceedings of the 21st International Society for Music Information Retrieval Conference , 38--45. Montreal, Canada: ISMIR
2020
-
[30]
Zhao, J.; and Xia, G. 2021. AccoMontage: Accompaniment Arrangement via Phrase Selection and Style Transfer. In Proceedings of the 22nd International Society for Music Information Retrieval Conference ( ISMIR 2021) , 833--840
2021
Reviewed August 10, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.