Pith. sign in

REVIEW 3 major objections 5 minor 34 references

Musical Rhythm Transcription Based on Bayesian Piece-Specific Score Models Capturing Repetitions

T0 review · 3 major / 5 minor · reviewed 2026-08-14 · deepseek-v4-flash

Pith's one-line read Rhythm transcription improves when the score model is inferred per piece from the performance itself, and the best tested model is the second-order Bayesian metrical Markov model.

desk verdict Useful, reproducible extension of the authors' DP score-model line, but the headline claim about repetitions is confounded with test-time adaptation and needs a non-sparse adapted control. read the letter →

arxiv 1908.06969 v2 pith:NTJNJACZ submitted 2019-08-18 cs.SD cs.AIcs.LGeess.AS

classification cs.SDcs.AIcs.LGeess.AS
keywords musictranscriptionrhythmBayesianscoremodelsDirichletprocessMarkovrepetitivestructureMIDIperformancemetricalmodel
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper claims that rhythm transcription improves when the statistical score model is tailored to the piece being transcribed rather than fixed across all music. The authors formulate Bayesian Markov models whose transition probabilities are drawn from a Dirichlet process with a generic base distribution and a small concentration parameter, so each piece receives a sparse distribution of rhythmic units and repetition emerges naturally. On vocal melodies from popular music, the Bayesian versions outperform their non-Bayesian counterparts for most model types, and the second-order Bayesian metrical Markov model gives the lowest error rate, about 2% on real performances. If the claim holds, the repetitive structure present in a performance is itself a reliable guide for transcription.

What carries the argument

The load-bearing object is the Dirichlet process prior placed on the parameters of a Markov score model: for each piece, the initial and transition distributions (over note values, metrical positions, or note patterns) are drawn from $\mathrm{DP}(\alpha, \bar{\pi})$ with a small concentration parameter $\alpha$, making the per-piece distribution sparse and thereby encoding repetition without an explicit repeated-structure grammar. Inference couples Gibbs sampling, which estimates the piece-specific parameters from the input MIDI, with a Viterbi (or beam-searched Viterbi) step that decodes the most probable note values or metrical positions. Two note-modification operations, onset shifts and note divisions, are added as hidden variables to represent approximate repetitions.

What would settle it

Run the best model, MetMM2B, on a test corpus that includes triplet rhythms, rests, tempo changes, or rubato; if the repetition-driven Bayesian model no longer beats a generic non-Bayesian baseline, or if the error rate rises well above the roughly 2% reported for simplified data, the piece-specific repetition mechanism is not doing the work in realistic settings.

Watch

Extended reading notes

Core claim

On its own terms, the paper establishes that a piece-specific score model inferred from the performed MIDI data, rather than a generic score model trained on other pieces, captures the repetitions that dominate real rhythms. The sparseness of these piece-specific distributions is quantitatively visible: their entropies are far lower than those of finite samples from the generic model, and the Dirichlet process with a small concentration parameter reproduces the observed entropy range. The central experimental result is that Bayesian extensions of the note-value, metrical, and note-pattern Markov models significantly reduce transcription error rates on both synthetic and human-performed MIDI, with MetMM2B the most accurate at roughly 2% error on real data. The paper also shows that explicitly modeling approximate repetitions through onset shifts and note divisions yields modest accuracy gains that do not justify their large computational cost for the model types tested.

Load-bearing premise

The evaluation assumes a simplified score world—2/4 time on a 16th-note grid, no rests, no triplets, no segments without onsets, and a constant known tempo with Gaussian onset deviations—and if the real rhythmic phenomena excluded here matter, the measured improvements may not transfer to practical transcription.

Editorial extensions

If this is right

  • Bayesian piece-specific score models lower rhythm transcription error for most model types, often by more than raising the Markov order of a generic model.
  • MetMM2B gives the best accuracy-computation trade-off and is the recommended practical model; note-pattern models are most accurate only at prohibitive cost.
  • Explicitly modeling onset shifts and note divisions captures approximate repetitions but yields only small accuracy gains, so simpler Bayesian models without modifications are attractive.
  • The approach extends to finer beat grids and longer note values for metrical MMs, since their cost grows polynomially in bar length, not exponentially as with note-pattern MMs.
  • The same piece-specific Bayesian construction can be applied to other musical elements, such as pitches, chords, or polyphonic voices, where repetitions also guide recognition (stated as future work in the paper).

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A direct extension would test whether per-piece concentration parameters, learned from the input rather than fixed, push the error rate below the observed ~2% floor on real performances.
  • The same Dirichlet-process piece-specific mechanism could be applied to pitch or chord sequences, where repetition is also common; if the rhythm results transfer, score models for full polyphonic transcription could be built the same way.
  • Because the paper's simplification drops rests and triplets, a 'simplified score world' bias may inflate the benefit of repetition; a falsifying test is to add such rhythms and see whether the generic baseline catches up.
  • One could measure the learned piece-specific distributions directly: if the sparse-transition mechanism is truly active, the inferred concentration parameters for pieces with little repetition should approach the generic case, which would be a checkable signature.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper develops Bayesian extensions of three families of Markov score models (note-value, metrical, and note-pattern MMs) for rhythm transcription from MIDI. The Bayesian formulation uses Dirichlet-process priors on piece-specific transition/unigram probabilities to induce sparsity, thereby capturing repetitive structure, and optionally models approximate repetitions through onset-shift and note-division processes. The authors derive Gibbs-sampling inference and Viterbi transcription algorithms, and evaluate the models on vocal-melody data from RWC, Beatles, and J-pop corpora using both synthetic and real performed MIDI. The main reported findings are that Bayesian piece-specific models improve transcription accuracy over non-Bayesian generic models for most model types, that the second-order Bayesian metrical Markov model (MetMM2B) is the most accurate, and that modification processes give only small accuracy gains at large computational cost.

Significance. If the central attribution claim holds, this is a useful contribution: it shows that a performance-adaptive, repetition-sensitive score prior can improve rhythm quantization, and it provides a systematic comparison of model families that practitioners could use to choose a tractable model. The paper's strengths include complete formal derivations for the generative models and inference algorithms, an entropy-based analysis connecting repetitive structure to sparsity, and publicly released data and source code. The experimental study is careful in distinguishing synthetic and real data and in reporting standard deviations. However, the headline comparison conflates test-time adaptation with the sparsity/repetition mechanism, and the real-data ranking rests on differences that are partly within statistical fluctuation and on hyperparameters that are partly tuned on the test data. These issues are fixable with additional controls and statistical reporting, but they currently limit the strength of the central claim.

major comments (3)
  1. [Secs. 4.2, 5.3, Fig. 7] The main comparison is confounded. For non-Bayesian models, the parameters are 'pretrained or preset and are fixed during the transcription step' (Sec. 4.2), whereas for Bayesian models the piece-specific parameters are estimated from the input performance by Gibbs sampling (Sec. 4.2 and Appendix A.2). The comparison therefore varies two factors at once: test-time adaptation of the score model and the sparsity-inducing Dirichlet-process prior that is claimed to capture repetitions. The entropy analysis in Sec. 2.3 shows that real piece-specific distributions are sparse, but that is a descriptive property of the corpus, not evidence that the sparse prior causes the transcription improvement. To support the claim that 'Bayesian score models capturing repetitions' are effective (Sec. 6), the paper needs a non-sparse adapted control, e.g., the same Bayesian inference with a large concentration parameter, a flat or weak Dirichlet prior, or an adapted non-Bayesian model trained by EM. Without such a baseline, the reported gains could be attributed to adaptation or regularization rather than to the repetition mechanism.
  2. [Secs. 5.1, 5.3, 5.4, Fig. 9] Several evaluation choices make the quantitative claims weaker than the text suggests. The real-data value sigma_t = 0.035 sec is 'roughly optimized' on the real test data (Sec. 5.3 and Fig. 9(c)), and all concentration parameters are fixed to 10 even though Fig. 9(a) shows model-dependent optima; the manuscript states that the differences from the fixed value are within one standard deviation, but the main result should be shown to be stable under the same variation for the other model families. More importantly, no significance tests are reported, and Sec. 5.3 itself concedes that many real-data differences are within statistical fluctuation and that error rates saturate around 2%. Statements such as 'most Bayesian models again significantly outperformed' (Sec. 5.3) and the selection of MetMM2B as 'the best' require pairwise confidence intervals or significance tests, especially because the best model is chosen on the same test set used for hyperparameter tuning.
  3. [Secs. 2.1, 5.5, Abstract] The scope of the empirical claim should be stated more carefully. The evaluation restricts pieces to 2/4 time on a 16th-note grid, discards rests, onsets finer than a 16th note, segments without onsets, and durations longer than a half note, and assumes a constant, known tempo with Gaussian onset deviations (Secs. 2.1 and 4.1). These restrictions are acknowledged in Sec. 5.5 as a limitation for practical applications, but the abstract's phrase 'universal efficacy of the proposed approach' goes beyond the evidence, which covers monophonic vocal melodies under a simplified score representation. I recommend softening the abstract and conclusion to state that the demonstrated gains hold for the tested representation and corpus, with extension to more general settings left as future work.
minor comments (5)
  1. [Sec. 5.3 vs. Table 4] The beam width for PatMM1DB and PatMM1SDB is reported as W = 200 in Sec. 5.3, but Table 4's caption states W = 1000 for the same models; please reconcile this discrepancy.
  2. [Supplemental Material, Sec. 4.2.2] There is a typo in the definition of the latent variables: 'zn = (kn.in,sn)' should read 'zn = (kn,in,sn)'.
  3. [Sec. 5.4, Fig. 9(a)] The figure compares the 'theoretically optimal' concentration parameters from entropy matching with the empirically optimal values, but no explanation is given for why the entropy-matched values are not expected to coincide with transcription-optimal values; a sentence describing this mismatch would help the reader interpret the plot.
  4. [Sec. 4.2] The modification hyperparameters are preset to ¯ξ0 = ¯ζ0 = 0.9 with no sensitivity analysis; since modification models are a central modeling component, reporting the effect of varying these values would strengthen the paper, even if only for one model family.
  5. [Fig. 8] The example in Fig. 8 is informative, but the selection criterion ('only bars with repeated rhythms') should be stated explicitly, and the transcription error markers should be described in the caption for clarity.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: piece-specific parameters are inferred from unlabeled performance data and decoded with a distinct Viterbi step; the main self-citation is background, not load-bearing.

full rationale

The paper's derivation chain is self-contained. The piece-specific model parameters (Theta) are inferred from the observed performance durations X = d_{1:N} by Gibbs sampling from P(Z, Theta | X, Xi) (Sec. 4.2, Eq. 31), and the transcribed note values are then decoded by maximizing P(b_{0:N} | d_{1:N}) with the Viterbi algorithm (Appendix A.3, Eqs. A.15-A.19). The ground-truth score never enters the inference; the fitted quantity (Theta) and the predicted quantity (score note values) are distinct, so no prediction reduces to a fitted value by construction. The prior base distributions are estimated from a disjoint training split (Sec. 2.1) and the test pieces are held out, so the central comparison is not forced by the training data. The entropy analyses (Sec. 2.3, Figs. 3-5) are descriptive fits of a Dirichlet-process prior to training-data sparsity and are not used as the transcription evaluation. The only notable self-citation ([18]) is background: the paper explicitly re-evaluates and extends the earlier model with new model classes and its own held-out experiments; no load-bearing claim rests solely on [18]. The Bayesian-versus-non-Bayesian comparison does conflate test-time adaptation with the sparsity prior (a non-sparse adapted control is absent), but that is a validity or confound concern, not circularity: no equation equates a predicted transcription to a fitted input.

Assumptions & free parameters 5 free parameters · 5 assumptions · 0 invented entities

The central claim rests on standard Bayesian machinery plus hand-set hyperparameters; no new physical entities are introduced. The main added value is the model architecture and its evaluation, not a derivation from first principles.

free parameters (5)
  • Concentration parameter alpha = 10 for all DP priors
    Set to 10 in Sec. 5.3; Sec. 5.4 shows optimal values differ by model and do not match entropy-matched values.
  • Performance noise sigma_t = 0.035 sec for real data, 0.04 sec for synthetic data
    Sec. 5.3: sigma_t for real data was roughly optimized in preliminary experiments; Sec. 5.4 shows model-dependent optima.
  • Modification prior probabilities = xi_0 = zeta_0 = 0.9, uniform elsewhere
    Sec. 4.2 and Sec. 5.3: hand-set to reflect the belief that modifications are rare.
  • Beam width W = 200, with 1000 used in Table 4
    Sec. 5.3: practical upper limit for PatMM1DB and PatMM1SDB; affects search optimality.
  • Smoothing constant and interpolation weight = 0.1; 0.8 unigram plus 0.2 transition
    Sec. 5.1: additive smoothing for all models and linear interpolation for PatMM1 transitions, roughly optimized.
assumptions (5)
  • domain assumption Scores are generated by low-order Markov models over note values, metrical positions, or note patterns, with piece-specific transition probabilities drawn from Dirichlet processes.
    Core generative assumption stated in Secs. 2.2 and 3.3; if real scores are not generated this way, the posterior inference may be misspecified.
  • domain assumption Timing deviations are independent Gaussian with a single constant tempo and fixed variance sigma_t^2.
    Performance model in Sec. 4.1 and Appendix A; excludes tempo variation and correlated expressive timing.
  • domain assumption Approximate repetitions are produced only by onset shifts and note divisions into at most two notes, with rare modifications.
    Sec. 3.2; other modification types such as ornaments or longer divisions are not modeled.
  • domain assumption The simplified score representation uses 2/4 meter, Nb=8 16th-note positions, no rests, no onsets finer than 16th notes, and a maximum half-note length.
    Sec. 2.1; needed for tractability but limits the scope of the claim.
  • standard math Gibbs sampling and Viterbi decoding converge adequately with the chosen number of iterations and beam width.
    Secs. 4.3 and 5.3; no convergence diagnostics are reported, and the hyperparameter study only partially addresses this.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Musical Rhythm Transcription Based on Bayesian Piece-Specific Score Models Capturing Repetitions." pith.science (2026). https://pith.science/paper/NTJNJACZ

@misc{pith2026190806969,
  author       = {Pith},
  title        = {Pith review of: Musical Rhythm Transcription Based on Bayesian Piece-Specific Score Models Capturing Repetitions},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/NTJNJACZ}},
  note         = {Machine review of arXiv:1908.06969}
}
read the original abstract

Most work on musical score models (a.k.a. musical language models) for music transcription has focused on describing the local sequential dependence of notes in musical scores and failed to capture their global repetitive structure, which can be a useful guide for transcribing music. Focusing on rhythm, we formulate several classes of Bayesian Markov models of musical scores that describe repetitions indirectly using the sparse transition probabilities of notes or note patterns. This enables us to construct piece-specific models for unseen scores with an unfixed repetitive structure and to derive tractable inference algorithms. Moreover, to describe approximate repetitions, we explicitly incorporate a process for modifying the repeated notes/note patterns. We apply these models as prior musical score models for rhythm transcription, where piece-specific score models are inferred from performed MIDI data by Bayesian learning, in contrast to the conventional supervised construction of score models. Evaluations using the vocal melodies of popular music showed that the Bayesian models improved the transcription accuracy for most of the tested model types, indicating the universal efficacy of the proposed approach. Moreover, we found an effective data representation for modelling rhythms that maximizes the transcription accuracy and computational efficiency.

Figures

Figures reproduced from arXiv: 1908.06969 by the authors.

Figure 1
Figure 1. Schematic illustrations of (a) a conventional score model [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. Representations of musical rhythms. (a) A one-bar exam [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. A generic distribution of note patterns obtained from the [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (6 more)
Figure 4
Figure 4. Figure 4: Distribution of the entropies of piece-specific distributions [PITH_FULL_IMAGE:figures/full_fig_p004_4.png]
Figure 5
Figure 5. Figure 5: Distributions of the entropies of the piece-specific transi [PITH_FULL_IMAGE:figures/full_fig_p005_5.png]
Figure 6
Figure 6. Figure 6: The note division operation (left) and the onset shift op [PITH_FULL_IMAGE:figures/full_fig_p005_6.png]
Figure 7
Figure 7. Figure 7: Transcription error rates for (a) the synthetic MIDI data [PITH_FULL_IMAGE:figures/full_fig_p009_7.png]
Figure 8
Figure 8. Figure 8: Examples of transcription results (RWC No. 89). Only bars [PITH_FULL_IMAGE:figures/full_fig_p010_8.png]
Figure 9
Figure 9. Figure 9: Transcription error rates for varying (a) the concentration [PITH_FULL_IMAGE:figures/full_fig_p010_9.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

34 extracted references · 33 canonical work pages

  1. [1]

    Benetos, E., Dixon, S., Duan, Z., and Ewert, S. (2019). Auto- matic music transcription: An overview. IEEE Signal Processing Magazine, 36(1):20–30

  2. [2]

    Benetos, E., Dixon, S., Giannoulis, D., Kirchhoff, H., and Kla- puri, A. (2013). Automatic music transcription: Challenges and future directions. J. Intelligent Information Systems , 41(3):407– 434

  3. [3]

    and Weyde, T

    Benetos, E. and Weyde, T. (2015). An efficient temporally- constrained probabilistic model for multiple-instrument music transcription. In Proc. ISMIR, pages 701–707. 13

  4. [4]

    Bishop, C. M. (2006). Pattern Recognition and Machine Learn- ing. Springer

  5. [5]

    M., Ng, A

    Blei, D. M., Ng, A. Y., and Jordan, M. I. (2003). Latent Dirichlet allocation. J. Machine Learning Res. , 3:993–1022

  6. [6]

    T., Desain, P., and Kappen, B

    Cemgil, A. T., Desain, P., and Kappen, B. (2000). Rhythm quantization for transcription. Comp. Mus. J. , 24(2):60–76

  7. [7]

    and Honing, H

    Desain, P. and Honing, H. (1989). The quantization of musical time: A connectionist approach. Comp. Mus. J. , 13(3):56–66

  8. [8]

    Fine, S., Singer, Y., and Tishby, N. (1998). The hierarchical hid- den Markov model: Analysis and applications. Machine Learning, 32(1):41–62

Show all 34 references
  1. [9]

    Goto, M., Hashiguchi, H., Nishimura, T., and Oka, R. (2002). RWC music database: Popular, classical and jazz music databases. In Proc. ISMIR, pages 287–288

  2. [10]

    Hamanaka, M., Goto, M., Asoh, H., and Otsu, N. (2003). A learning-based quantization: Unsupervised estimation of the model parameters. In Proc. ICMC, pages 369–372

  3. [11]

    Hawthorne, C., Elsen, E., Song, J., Roberts, A., Simon, I., Raf- fel, C., Engel, J., Oore, S., and Eck, D. (2018). Onsets and frames: Dual-objective piano transcription. In Proc. ISMIR, pages 50–57

  4. [12]

    Huron, D. (2006). Sweet Anticipation: Music and the Psychol- ogy of Expectation. The MIT Press

  5. [13]

    and McDermott, J

    Jacoby, N. and McDermott, J. H. (2017). Integer ratio priors on musical rhythm revealed cross-culturally by iterated reproduction. Current Biology, 27(3):359–370

  6. [14]

    Jordan, M. I. (2005). Dirichlet processes, Chinese restaurant processes and all that. In Tutorial Presentation at the NIPS Con- ference

  7. [15]

    Longuet-Higgins, H. (1987). Mental Processes: Studies in Cog- nitive Science. MIT Press

  8. [16]

    Mari, J.-F., Haton, J.-P., and Kriouile, A. (1997). Automatic word recognition based on second-order hidden Markov models. IEEE Transactions on speech and Audio Processing , 5(1):22–25

  9. [17]

    Nakamura, E., Benetos, E., Yoshii, K., and Dixon, S. (2018). Towards complete polyphonic music transcription: Integrating multi-pitch detection and rhythm quantization. In Proc. ICASSP, pages 101–105

  10. [18]

    Nakamura, E., Itoyama, K., and Yoshii, K. (2016). Rhythm transcription of MIDI performances based on hierarchical Bayesian modelling of repetition and modification of musical note pattern. In Proc. EUSIPCO, pages 1946–1950

  11. [19]

    Nakamura, E., Yoshii, K., and Sagayama, S. (2017). Rhythm transcription of polyphonic piano music based on merged-output HMM for multiple voices. IEEE/ACM TASLP, 25(4):794–806

  12. [20]

    Nishikimi, R., Nakamura, E., Itoyama, K., and Yoshii, K. (2016). Musical note estimation for F0 trajectories of singing voices based on a Bayesian semi-beat-synchronous HMM. InProc. ISMIR, pages 461–467

  13. [21]

    Rabiner, L. R. (1989). A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2):257–286

  14. [22]

    Raczynski, S., Vincent, E., and Sagayama, S. (2013). Dy- namic Bayesian networks for symbolic polyphonic pitch modeling. IEEE/ACM TASLP, 21(9):1830–1840

  15. [23]

    Raphael, C. (2002). A hybrid graphical model for rhythmic parsing. Artificial Intelligence, 137:217–238

  16. [24]

    Raphael, C. (2005). A graphical model for recognizing sung melodies. In Proc. ISMIR, pages 658–663

  17. [25]

    Ravignani, A., Thompson, B., Grossi, T., Delgado, T., and Kirby, S. (2018). Evolving building blocks of rhythm: how hu- man cognition creates music via cultural transmission. Annals of the New York Academy of Sciences , 1423:176–187

  18. [26]

    E., Brown, S., Sakai, E., and Currie, T

    Savage, P. E., Brown, S., Sakai, E., and Currie, T. E. (2015). Statistical universals reveal the structures and functions of human music. PNAS, 112(29):8987–8992

  19. [27]

    Schramm, R., McLeod, A., Steedman, M., and Benetos, E. (2017). Multi-pitch detection and voice assignment for a Cappella recordings of multiple singers. In Proc. ISMIR, pages 552–559

  20. [28]

    Sigtia, S., Benetos, E., and Dixon, S. (2016). An end-to-end neu- ral network for polyphonic piano music transcription.IEEE/ACM TASLP, 24(5):927–939

  21. [29]

    Siorosa, G., Davies, M. E. P., and Guedes, C. (2018). A gener- ative model for the characterization of musical rhythms. J. New Music Res., 47(2):114–128

  22. [30]

    Smith, L. M. and Honing, H. (2008). Time-frequency repre- sentation of musical rhythm by continuous wavelets. Journal of Mathematics and Music , 2(2):81–97

  23. [31]

    Takeda, H., Otsuki, T., Saito, N., Nakai, M., Shimodaira, H., and Sagayama, S. (2002). Hidden Markov model for automatic transcription of MIDI signals. In Proc. MMSP, pages 428–431

  24. [32]

    and Sleator, D

    Temperley, D. and Sleator, D. (1999). Modeling meter and harmony: A preference-rule approach. Comp. Mus. J. , 23(1):10– 27

  25. [33]

    Wu, Y.-T., Chen, B., and Su, L. (2019). Polyphonic music tran- scription with semantic segmentation. In Proc. ICASSP, pages 166–170

  26. [34]

    Music Transcription Based on Bayesian Piece-Specific Score Models Capturing Repetitions

    Ycart, A. and Benetos, E. (2017). A study on LSTM networks for polyphonic music sequence modelling. In Proc. ISMIR, pages 421–427. 14 Supplemental Material for “Music Transcription Based on Bayesian Piece-Specific Score Models Capturing Repetitions” Eita Nakamura1,2∗ and Kazuyo...

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.