Pith. sign in

REVIEW 3 major objections 6 minor 30 references

Evaluating Interval-based Tokenization for Pitch Representation in Symbolic Music Analysis

T0 review · 3 major / 6 minor · reviewed 2026-08-10 · deepseek-v4-flash

Pith's one-line read This paper claims that replacing absolute MIDI pitch tokens with intervals measured from a chosen reference line (melody, skyline, or bottom line) improves era classification, start-of-phrase detection, and chord inversion identification…

desk verdict Useful intervalization framework and a nice interpretability case study, but the 'improves all tasks' claim is post-hoc and statistically unsubstantiated. read the letter →

arxiv 2501.04630 v1 pith:DMFBP7J6 submitted 2025-01-08 cs.IR cs.SDeess.AS

classification cs.IRcs.SDeess.AS
keywords symbolicmusictokenizationpitchintervalsREMIinformationretrievalBERTexplainabilitychordinversionphrasedetection
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Symbolic music models typically tokenize pitch as absolute MIDI numbers, ignoring the relational structure that music theory emphasizes. This paper introduces intervalization, a framework that re-encodes every pitch as an interval away from a chosen monophonic reference line while keeping the rest of the sequence tokens unchanged. Applying intervalization to a REMI-style tokenizer and a BERT-style encoder, the paper reports improved performance on all three tasks it studies, with gains from about 1.2% to 6%. It also finds that the reference line matters in a musically interpretable way: melody works best for phrase detection, and the bass line works best for chord inversion identification.

What carries the argument

The carrying object is the intervalization operator I, defined by a reference subsequence xref chosen from the note sequence x, a method Iref for encoding reference events, and a method Inon-ref for encoding all other events. In the studied variants, reference notes are encoded either absolutely or as horizontal intervals from the previous reference note, and non-reference notes are encoded as vertical intervals from the simultaneous reference pitch. This operator turns any absolute-pitch tokenization into a relative one and is the single mechanism through which the paper obtains both the performance gains and the explainability results.

What would settle it

Train both intervalized and absolute-pitch models on a polyphonic dataset with no single reference line, or on homophonic pieces with the reference chosen at random; if intervalization no longer beats absolute pitches when the reference is random or absent, the claimed improvement depends on having a musically meaningful reference. A more direct check would evaluate the best intervalized and absolute models on the same pieces transposed to many keys; if interval tokens do not make performance more stable across keys, the transposition-invariance intuition is unsupported.

Watch

Extended reading notes

Core claim

On the paper's own terms, the central discovery is that intervalization, encoding absolute pitches as intervals relative to a reference subsequence, consistently outperforms absolute pitch encoding in the studied tasks, and the choice of reference is not arbitrary. Models using interval tokens beat their absolute-pitch counterparts across all twelve per-task comparisons, with the largest gain in end-to-end start-of-phrase detection and a modest but consistent gain elsewhere. The paper further shows that the best reference tracks musical structure: melodic reference for phrase boundaries, bottom-line reference for chord inversion identification, and no significant difference for era classification. Finally, inspecting the vertical interval tokens produced by the best chord-inversion model reveals distributions that mirror textbook definitions of inversions, making the tokenization directly readable in musical terms.

Load-bearing premise

The evaluation assumes that every piece has a single monophonic reference line (melody, skyline, or bottom line) that can be identified and that every note can be aligned to it; for music without such a line, the intervalization cannot be built, so the claim is only established for homophonic textures.

Editorial extensions

If this is right

  • Intervalized tokenization can be applied to existing absolute-pitch tokenizers and sequence models without architectural changes, so the reported gains are cheap to reproduce.
  • Downstream tasks benefit from different references, so practitioners should select the reference based on the musical property being analyzed rather than defaulting to the skyline.
  • Because vertical interval tokens encode a note's relation to the reference, inspecting their frequency by predicted class gives a direct, musically interpretable view of model behavior.
  • Interval tokens help both end-to-end and pre-trained models, and pre-trained models remain about 1.2 times better on average across the studied tasks.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • An untested but plausible corollary is that intervalized models are more invariant under key transposition than absolute-pitch models, since intervals are unchanged by uniform transposition; this could be checked by fine-tuning on one key and evaluating on transposed pieces.
  • The formal framework permits references outside the piece itself, such as a tonal-centre sequence, which could extend the gains to harmonic tasks where no single performed line serves as a natural reference.
  • Because time tokens are untouched by intervalization, the same reference-based interval encoding could be combined with different time encodings, such as bar-position versus time-shift, to identify the best joint pitch-time representation.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 6 minor

Summary. The paper proposes a general framework for interval-based tokenization of symbolic music, in which absolute pitch tokens are replaced by pitch intervals computed relative to a reference monophonic sequence (melody, skyline, or bottom line). Six intervalization strategies built on the REMI tokenization are defined, and a BERT-style encoder is trained with and without pre-training on three tasks: era classification, start-of-phrase detection, and chord inversion identification. The paper reports that intervalization improves performance on all three tasks (Figure 2), that the best reference varies by task (Figure 3), and that analyses of vertical-interval-token frequencies reveal musically interpretable patterns for chord inversions (Figure 4). Datasets, code, and pre-trained models are released.

Significance. If the central empirical claim holds, the paper contributes a simple, parameter-free modification to symbolic-music tokenization that yields consistent performance gains across several analysis tasks and provides a natural path toward explainability. The formalization of intervalization is clean and appears to contain no derivation errors. The choice of publicly available datasets, the release of code and models, and the use of three seeds per experimental condition are strengths. The interpretability analysis for chord inversion is suggestive and well aligned with music-theoretic expectations. However, the main empirical comparison is weakened by post-hoc selection of the best intervalization variant without statistical correction, so the headline 'intervalization improves all tasks' claim is not established as reported.

major comments (3)
  1. [Results, 'Impact of intervalization', Figure 2] The central claim that 'Intervalization improves the model performance for all the tasks' rests on Figure 2, whose caption states that the intervalized model is based on the reference resulting in the best performance. This is post-hoc selection over six intervalized variants (three references crossed with two interval encodings) against a single absolute baseline. Under the null hypothesis that all tokenizations are equally effective, the maximum of six positively correlated variants will tend to beat the single baseline, so the reported gains are maxima over variants rather than the performance of a fixed, pre-specified tokenization. The problem is exacerbated for era classification, where the gain is described as 'marginal 1.2%' and the text says the reference choice has no significant effect. I ask the authors to report the results for each of the six intervalized variants separately (or use an appropriate multiple-comparison correction), include variance or confidence intervals across the three seeds, and state whether the reference choice was made on a validation set or on the same test results shown in Figure 2.
  2. [Results, 'Impact of intervalization references', Figure 3] The 'best model' counts in Figure 3 are based on 12 comparisons per task, but the comparisons are not independent (they share the same pre-trained weights and overlapping data splits), and no significance test is applied to the counts. For example, the claim that 'models trained with a melodic reference achieve the best performance in 11 of 12 comparisons' for start-of-phrase detection is presented as evidence of a musically meaningful role of melody, yet a random ordering of reference models could produce such a count with non-negligible probability given only 12 trials. Please provide a statistical test (e.g., sign test or permutation test) for these counts, or temper the interpretation accordingly.
  3. [Evaluation on downstream tasks, 'Downstream tasks'] The evaluation is restricted to datasets with homophonic texture, for which a monophonic reference (melody, skyline, or bottom line) is explicitly present or approximated. While the paper acknowledges this, the abstract and conclusion state the general claim that intervalization improves model performance, and the formalization is presented as a general framework for polyphonic music. The empirical support for intervalization therefore applies only to homophonic music. I recommend stating this restriction in the abstract and conclusion, and ideally adding at least one polyphonic validation or explicitly positioning the contribution as a homophonic-music result.
minor comments (6)
  1. [Evaluation on downstream tasks, 'Era classification'] Typo: 'bieng composed' should be 'being composed'.
  2. [Figure 2] The figure would benefit from error bars or a display of per-seed variation; without them, the reader cannot assess the stability of the reported gains.
  3. [Table 1 and surrounding text] The relationship between the six intervalized strategies and the two encoding families (REMI-abs.+VPI and REMI-HPI+VPI) is clear in the table, but the text in 'Impact of intervalization references' says 'we compare twice, once for the end-to-end and once for the fine-tuned' for each split, which is confusing because there are two encoding settings per reference. Please rephrase to make the counting transparent (e.g., state explicitly that each of the three references is tested for both an absolute-reference encoding and a horizontal-pitch-interval encoding, yielding six intervalized models).
  4. [Figure 4] The histograms for second and third inversion use very different scales (counts up to ~1000 for root and first, ~20-40 for second and third). Consider normalizing by class size or using a log scale so that the interval distributions are visually comparable across inversion types.
  5. [Intervalization, notation] In the definition of S_j, the condition '(p, t) ≠ eref_j' is redundant because the reference event is already included in the union. This is not an error, but the notation could be simplified.
  6. [References] Several reference entries have formatting issues, e.g., 'InProceedings of' and 'InInternational Society for Music Information Retrieval Conference' where spacing or capitalization is inconsistent. Please check the reference list for final typesetting.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: intervalization is defined independently of downstream labels and the empirical comparison is self-contained.

full rationale

The paper's intervalization transform is defined formally from note events and a chosen reference sequence (xref, Iref, Inon-ref) without reference to the downstream labels, so no prediction is equivalent by construction to an input. The improvement claim is an empirical comparison over three external tasks (era classification, start-of-phrase detection, chord inversion identification) with released code and data; the best-reference selection in Figure 2 is a model-selection choice, not a fitted parameter renamed as a prediction. Self-citations to Kermarec, Bigo, and Keller (2022) and Le, Bigo, and Keller (2024) provide prior tokenization and task frameworks, but the central contribution does not reduce to those citations: the framework is formalized independently and the results are measured against external datasets and baselines. The explainability analysis is post-hoc interpretation of model predictions, not a derivation. The paper explicitly limits itself to homophonic music with a single melodic track; this is a scope limitation, not a circular assumption. No circular step can be exhibited from the paper's equations; the only concerns are statistical (post-hoc selection, small seed count), which are correctness risks, not circularity.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

The central claim rests on domain assumptions about music texture and reference availability rather than on fitted parameters or invented entities. The main mathematical content is a definitional framework, and the empirical conclusions depend on the homophonic, Western tonal corpus used.

assumptions (3)
  • domain assumption All evaluated music is homophonic with a single identifiable monophonic melody track.
    The intervalization construction requires a monophonic reference sequence xref; the authors restrict all datasets to homophonic textures and state they chose datasets where the melody is played by a single track.
  • domain assumption Velocity tokens carry no useful information for the three downstream tasks and can be dropped from REMI.
    The paper drops <Velocity> tokens because datasets are scores or generated data, asserting velocities have limited impact on the analysis tasks without an ablation.
  • domain assumption The reference line can be chosen as the melody, skyline, or bottom line and is representative of the musical content.
    The framework allows arbitrary reference choices, but the experiments only test these three heuristics and assume they capture the relevant musical structure for each task.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Evaluating Interval-based Tokenization for Pitch Representation in Symbolic Music Analysis." pith.science (2026). https://pith.science/paper/DMFBP7J6

@misc{pith2026250104630,
  author       = {Pith},
  title        = {Pith review of: Evaluating Interval-based Tokenization for Pitch Representation in Symbolic Music Analysis},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/DMFBP7J6}},
  note         = {Machine review of arXiv:2501.04630}
}
read the original abstract

Symbolic music analysis tasks are often performed by models originally developed for Natural Language Processing, such as Transformers. Such models require the input data to be represented as sequences, which is achieved through a process of tokenization. Tokenization strategies for symbolic music often rely on absolute MIDI values to represent pitch information. However, music research largely promotes the benefit of higher-level representations such as melodic contour and harmonic relations for which pitch intervals turn out to be more expressive than absolute pitches. In this work, we introduce a general framework for building interval-based tokenizations. By evaluating these tokenizations on three music analysis tasks, we show that such interval-based tokenizations improve model performances and facilitate their explainability.

Figures

Figures reproduced from arXiv: 2501.04630 by the authors.

Figure 1
Figure 1. Representations of the sheet music based on ab [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Performance comparison between absolute and in [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 4
Figure 4. Histograms of vertical pitch interval tokens pre [PITH_FULL_IMAGE:figures/full_fig_p005_4.png] view at source ↗
Figures from the paper (1 more)
Figure 5
Figure 5. Figure 5: Examples of intervalized tokenizations based on [PITH_FULL_IMAGE:figures/full_fig_p006_5.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

30 extracted references · 26 canonical work pages

  1. [1]

    , " * write output.state after.block = add.period write newline

    ENTRY address archivePrefix author booktitle chapter edition editor eid eprint howpublished institution isbn journal key month note number organization pages publisher school series title type volume year label extra.label sort.label short.list INTEGERS output.state before.all mid.sentence after.sentence after.block FUNCTION init.state.consts #0 'before.a...

  2. [2]

    write newline

    " write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 global.max substring 't := if while FUNCTION word.in bbl.in capitalize " " * FUNCT...

  3. [3]

    Benward, B. 2018. Music in theory and practice. McGraw Hill Higher Education

  4. [4]

    Chou, Y.-H.; Chen, I.-C.; Ching, J.; Chang, C.-J.; and Yang, Y.-H. 2024. MidiBERT-Piano: Large-scale Pre-training for Symbolic Music Classification Tasks. Journal of Creative Music Systems, 8(1)

  5. [5]

    Conklin, D. 2013. Multiple Viewpoint Systems for Music Classification. Journal of New Music Research, 42(1): 19--26

  6. [6]

    Devlin, J.; Chang, M.-W.; Lee, K.; and Toutanova, K. 2019. BERT : Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North A merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) , 4171--4186. Minneapolis, Minneso...

  7. [7]

    J.; and Fujitani, D

    Dowling, W. J.; and Fujitani, D. S. 1971. Contour, interval, and pitch recognition in memory for melodies. The Journal of the Acoustical Society of America, 49(2B): 524--531

  8. [8]

    Fradet, N.; Briot, J.-P.; Chhel, F.; El Fallah-Seghrouchni, A.; and Gutowski, N. 2021. Midi T ok: A P ython package for MIDI file tokenization. In International Society for Music Information Retrieval Conference (ISMIR), Late-Breaking Demo Session

Show all 30 references
  1. [9]

    Fradet, N.; Gutowski, N.; Chhel, F.; and Briot, J.-P. 2023. Impact of time and note duration tokenizations on deep learning symbolic music modeling. In International Society for Music Information Retrieval Conference ( ISMIR )

  2. [10]

    N.; and Sailor, M

    Gotham, M.; Micchi, G.; López, N. N.; and Sailor, M. 2023 a . When in R ome: A Meta-corpus of Functional Harmony. Transactions of the International Society for Music Information Retrieval

  3. [11]

    OpenScore String Quartet

    Gotham, M.; Redbond, M.; Bower, B.; and Jonas, P. 2023 b . The “OpenScore String Quartet” Corpus. In Proceedings of the 10th International Conference on Digital Libraries for Musicology, DLfM '23, 49–57. New York, NY, USA: Association for Computing Machinery. ISBN 9798400708336

  4. [12]

    Gotham, M. R. H.; and Jonas, P. 2022. The OpenScore Lieder Corpus . In M \"u nnich, S.; and Rizo, D., eds., Music Encoding Conference Proceedings 2021 , 131--136. Humanities Commons . ISBN 978-84-1302-173-7

  5. [13]

    Hsiao, W.-Y.; Liu, J.-Y.; Yeh, Y.-C.; and Yang, Y.-H. 2021. Compound word transformer: L earning to compose full-song music over dynamic directed hypergraphs. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, 178--186

  6. [14]

    A.; Vaswani, A.; Uszkoreit, J.; Simon, I.; Hawthorne, C.; Shazeer, N.; Dai, A

    Huang, C.-Z. A.; Vaswani, A.; Uszkoreit, J.; Simon, I.; Hawthorne, C.; Shazeer, N.; Dai, A. M.; Hoffman, M. D.; Dinculescu, M.; and Eck, D. 2019. Music Transformer: Generating Music with Long-Term Structure. In International Conference on Learning Representations ( ICLR )

  7. [15]

    Huang, Y.-S.; and Yang, Y.-H. 2020. Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions. In Proceedings of the 28th ACM International Conference on Multimedia, MM '20, 1180–1188. New York, NY, USA: Association for Computing Machinery....

  8. [16]

    Ju, Y.; Margot, S.; McKay, C.; Dahn, L.; and Fujinaga, I. 2020. Automatic Figured Bass Annotation Using the New Bach Chorales Figured Bass Dataset . In Proceedings of the 21th International Society for Music Information Retrieval Conference , 640--646

  9. [17]

    Kermarec, M.; Bigo, L.; and Keller, M. 2022. Improving Tokenization Expressiveness With Pitch Intervals. In International Society for Music Information Retrieval Conference (ISMIR), Late-Breaking Demo Session

  10. [18]

    Le, D.-V.-T.; Bigo, L.; and Keller, M. 2024. Analyzing Byte-Pair Encoding on Monophonic and Polyphonic Symbolic Music: A Focus on Musical Phrase Segmentation . In 3rd Workshop on NLP for Music and Audio (NLP4MusA) . San Francisco, United States

  11. [19]

    Le, D.-V.-T.; Bigo, L.; Keller, M.; and Herremans, D. 2024. Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval: A Survey. arXiv:2402.17467

  12. [20]

    Li, Y.; Li, S.; and Fazekas, G. 2023. Pitch Class and Octave-Based Pitch Embedding Training Strategies for Symbolic Music Generation . In Proceedings of the 16th International Symposium on Computer Music Multidisciplinary Research (CMMR) , 86–97. Tokyo, Japan: Zenodo

  13. [21]

    Oore, S.; Simon, I.; Dieleman, S.; Eck, D.; and Simonyan, K. 2018. This time with feeling: Learning expressive musical performance. Neural Computing and Applications, 32: 955--967

  14. [22]

    Park, S.; Choi, E.; Kim, J.; and Nam, J. 2024. Mel2Word: A Text-Based Melody Representation for Symbolic Music Analysis. Music & Science, 7

  15. [23]

    Peters, J. 2016. Fundamentals of Writing Four-part Harmony. CreateSpace Independent Publishing Platform. ISBN 9781536889239

  16. [24]

    Sarmento, P.; Kumar, A.; Carr, C.; Zukowski, Z.; Barthet, M.; and Yang, Y.-H. 2021. DadaGP : A dataset of tokenized G uitar P ro songs for sequence models. In International Society for Music Information Retrieval Conference ( ISMIR )

  17. [25]

    Schaffrath, H. 1995. The E ssen F olksong C ollection. In Center for Computer Assisted Research in the Humanities

  18. [26]

    Schoenberg, A.; Strang, G.; and Stein, L. 1999. Fundamentals of Musical Composition. Faber & Faber. ISBN 9780571196586

  19. [27]

    Sennrich, R.; Haddow, B.; and Birch, A. 2016. Neural Machine Translation of Rare Words with Subword Units. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 1715--1725. Berlin, Germany: Association for Computati...

  20. [28]

    P.; and Wiering, F

    Van Kranenburg, P.; de Bruin, M.; Grijp, L. P.; and Wiering, F. 2014. The M eertens tune collections. Meertens Online Reports, 2014(1)

  21. [29]

    Wang, Z.; Chen, K.; Jiang, J.; Zhang, Y.; Xu, M.; Dai, S.; and Xia, G. 2020. POP909: A pop-song dataset for music arrangement generation . In Proceedings of the 21st International Society for Music Information Retrieval Conference , 38--45. Montreal, Canada: ISMIR

  22. [30]

    Zhao, J.; and Xia, G. 2021. AccoMontage: Accompaniment Arrangement via Phrase Selection and Style Transfer. In Proceedings of the 22nd International Society for Music Information Retrieval Conference ( ISMIR 2021) , 833--840

Pith tools

Reviewed August 10, 2026 · model on record in the stance chip above.