Pith. sign in

REVIEW 3 major objections 6 minor 25 references

Low-Data Classification of Historical Music Manuscripts: A Few-Shot Learning Approach

T0 review · 3 major / 6 minor · reviewed 2026-08-12 · deepseek-v4-flash

Pith's one-line read A five-layer MLP on VICReg self-supervised features achieves 87.66% accuracy in few-shot classification of historical music symbols, surpassing the kNN baseline by 5.66 points.

desk verdict A modest, honest extension of Alfaro-Contreras et al. that swaps in new classifiers and tunes augmentations, but the headline comparison to the published baseline is not clean and the result lacks error bars. read the letter →

arxiv 2411.16408 v1 pith:K7YXNOBJ submitted 2024-11-25 cs.IR cs.AIcs.CV

classification cs.IRcs.AIcs.CV
keywords opticalmusicrecognitionfew-shotlearningself-supervisedVICReghistoricalmanuscriptssymbolclassificationmultilayerperceptron
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper claims that a simple five-layer multilayer perceptron, trained on features extracted by a VICReg self-supervised convolutional network, classifies musical symbols in historical manuscripts at 87.66% accuracy when only five labeled examples per class are available. This would improve on the kNN baseline from the prior pipeline by 5.66 percentage points. The work is motivated by the scarcity of labeled data in historical music documents, where manual annotation is costly. If the claim holds, it suggests that self-supervised feature extraction plus a lightweight classifier is a practical route for few-shot optical music recognition.

What carries the argument

The key machinery is a two-stage pipeline. First, a convolutional neural network is trained with VICReg, a self-supervised method that distorts each crop twice and enforces variance, invariance, and covariance regularization so the distortions map to a shared feature-space point; this yields a 1600-dimensional feature vector per crop without using labels. Second, a five-layer MLP with batch normalization and dropout maps those features to the output classes. Around the pipeline sit crop preprocessing steps (Sauvola adaptive binarization, sliding-window extraction, entropy filtering) and a curated set of data augmentations that simulate historical degradation.

What would settle it

Run the MLP classifier under the exact evaluation protocol of the baseline study—same crops, same train/test splits, same augmentation settings—and compare its accuracy to the baseline's 82.0% kNN result, and to the paper's own reproduced kNN accuracy of 79.8% at K=5; if the margins shrink or reverse, the claimed improvement is an artifact of protocol differences.

Watch

Extended reading notes

Core claim

The paper's central claim is that a five-layer MLP trained on VICReg self-supervised features classifies musical symbols in the Capitan dataset at 87.66% mean accuracy with five samples per class, beating the 82.0% kNN baseline it compares against. The authors also report that moderate augmentation at the classification stage helps, and that the MLP scales better than prototypical networks as the number of samples per class grows.

Load-bearing premise

The comparison assumes that the way crops were extracted, features were trained, and test data were split in this study matches the baseline study's protocol well enough that the 5.66-point accuracy difference is caused by the classifier choice.

Editorial extensions

If this is right

  • A lightweight classifier on self-supervised features can serve as a strong baseline for few-shot optical music recognition, reducing the need for large annotated corpora.
  • The reported accuracy gap suggests that non-linear classifiers are preferable to kNN in the high-dimensional feature spaces produced by VICReg.
  • The reduced augmentation set during classification offers a practical recipe: use degradation-simulating transformations for self-supervised pretraining, but a smaller set when training the head to avoid overfitting.
  • The approach could be transferred to other historical document recognition tasks with scarce labels, such as ciphered manuscripts or early printed scores.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A like-for-like comparison using the paper's own reproduced kNN values (79.8% at K=5) would show a larger margin for the MLP than the 5.66 points claimed against the cited baseline, suggesting the classifier's advantage may be understated rather than overstated.
  • The persistent confusion among beamed notes hints that the feature extractor captures global shape but may miss fine structural cues; augmentations that specifically perturb beam connections could test whether the bottleneck is the features or the classifier.
  • The reduced augmentation set for classification (random resized crop, colour jitter, Gaussian blur) offers a transferable heuristic: pretrain with heavy degradation simulation, but fine-tune the head with mild augmentations to avoid overfitting.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 6 minor

Summary. The paper proposes a three-stage pipeline for few-shot classification of musical symbols in historical manuscripts: sliding-window crop extraction with binarization and entropy filtering, a VICReg self-supervised CNN feature extractor trained on unlabeled crops, and a downstream classifier (kNN, SVM, MLP, or prototypical network). Using the Capitan dataset with 28 symbol classes, the authors evaluate accuracy for 1, 3, 5, and 10 samples per class and augmentation counts from 0 to 20. The headline result is an MLP accuracy of 87.66% at five samples per class, claimed to surpass the kNN baseline of Alfaro-Contreras et al. [15] by 5.66 percentage points. The paper also reports preprocessing choices and confusion-matrix analyses of difficult symbol classes.

Significance. If the headline comparison were clean, the result would be a useful applied contribution: it would show that a simple MLP trained on self-supervised VICReg features outperforms a nearest-neighbor baseline for low-data historical music symbol classification, with practical implications for digitizing cultural heritage. The paper's strengths are its use of an established historical-music benchmark (Capitan), its systematic sweep over classifiers and augmentation levels, and its inclusion of class-level diagnostics. The contribution is incremental rather than conceptual, and the current evidence is not yet sufficient to establish the claimed improvement because the baseline comparison is uncontrolled and no uncertainty quantification is provided.

major comments (3)
  1. [§V, Table I(a)] The central claim that the MLP surpasses the Alfaro-Contreras et al. baseline by 5.66% is not supported as stated, because the comparison does not isolate the classifier. Table I(a) reports the authors' own kNN reproduction at K=5 with no augmentation as 79.8%, whereas the baseline column cites 82.0% from [15]; similar gaps appear at K=1 (60.7 vs 67.2) and K=10 (86.1 vs 86.9). These gaps are of the same magnitude as many classifier differences in Table I, so the advertised 5.66% improvement may reflect differences in crop extraction, feature training, evaluation splits, or other pipeline details rather than the MLP. The authors should reproduce the [15] baseline in their own pipeline or compare the MLP against their own kNN under identical conditions, and they should report the number of classes N in the N-way-K-shot evaluation and the support/query construction used for kNN, SVM, and MLP.
  2. [Table I, §V] All accuracy numbers are reported only as means, with no standard deviation, number of runs or seeds, or statistical tests. In a few-shot benchmark the support set is usually resampled, and Figure 4 indicates that bootstrapping was used at least for the confusion matrix; without uncertainty estimates the reader cannot judge whether the differences between MLP values (e.g., 86.79 at A=0 vs 87.66 at A=10 for K=5) or between MLP and SVM are real. Please report mean ± std over multiple seeds or resampled support/query splits, and provide a paired test or interval for the main comparisons.
  3. [§IV-B, Table I(c)] The augmentation policy and the best augmentation count are selected using test-set information. Section IV-B states that the authors observed during testing that the full transformation set 'led to overfitting' and therefore switched to a reduced set, and the headline result of 87.66% is the best A=10 entry in Table I(c). Selecting the augmentation type and count on the test set makes the reported accuracy an optimistic selection result. The authors should make these choices on a validation split derived from the labelled training data, or present the full grid of results without designating the best test entry as the expected performance.
minor comments (6)
  1. [§IV-A, Table I] The text says K values of 1, 2, 5, and 10 were used, but Table I and Figure 3 show rows for 1, 3, 5, and 10; please correct the text or the table.
  2. [§III-C, Fig. 2] Section III-C states that horizontal flipping was excluded, but Figure 2 lists 'Random horizontal flip' among the transformations used prior to training; clarify which transformations were used in self-supervised pretraining and which in classification-stage augmentation.
  3. [References] References [16] and [17] are the same paper; [1], [3], [4], [5], [7], [10], [11], [13], and [14] are not cited in the text; and Section II's discussion of Reptile cites [6] (MAML) rather than [7] (Nichol et al.).
  4. [§V] The notation for the number of samples per class switches between K (Table I, Figure 3) and L (Section V, 'L > 3'); please use one symbol throughout.
  5. [Table I, Fig. 4] Figure 4 reports an average over five bootstraps, but Table I's means are not described as bootstrapped; state the averaging procedure for all results.
  6. [§III-B, §IV-A] The CNN architecture and training details for VICReg (depth, width, epochs, batch size, optimizer, learning rate) and the MLP hyperparameters (optimizer, learning rate, dropout rate) are not specified; add these for reproducibility.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: the central result is an external empirical benchmark comparison, not a derivation from fitted premises.

full rationale

The paper's central claim is an evaluated accuracy (87.66% MLP vs 82.0% kNN from Alfaro-Contreras et al. [15]) on the external Capitan dataset. The pipeline is inherited from [15], not from the authors' own prior results; the self-supervised VICReg extractor and its regularisation parameters cite external work [21] (with [16] apparently mis-cited, though that does not supply a load-bearing premise). The authors' self-citations [19], [22], [23] are background/survey or related OMR datasets/segmentation work, and none is used to justify the classification result. The legitimate concern—that the authors' own kNN reproduction (79.8%) differs from the published [15] baseline (82.0%), and that augmentation level A=10 appears selected from the tested grid—is a soundness/external-validity issue about whether the 5.66% margin is caused by the MLP rather than by pipeline differences; it is not a circularity in which an output is equivalent by construction to an input. No equation, fitted parameter, or renamed quantity is presented as a prediction, so no circular step is identifiable.

Assumptions & free parameters 6 free parameters · 5 assumptions · 0 invented entities

The paper introduces no new mathematical entities. Its central claim rests on domain assumptions about the crop content, the transferability of VICReg features, and the comparability of the evaluation to the baseline in [15]. Several hyperparameters, including the augmentation recipe and the choice of MLP, were selected post hoc based on test-set performance.

free parameters (6)
  • Augmentation set reduction = random resized crop, colour jitter, Gaussian blur
    The final set of transformations used during classification was chosen after observing that the full self-supervised augmentation set caused overfitting (Section IV.B). This is a post-hoc selection based on test accuracy.
  • Augmentation count A = 5 for the best MLP result (87.66%)
    A grid over A=[0,1,2,5,10,20] was run and the best accuracy was highlighted; A=5 is a free choice selected from the reported results.
  • Classifier choice = MLP
    MLP was selected as the best classifier after comparing against SVM, kNN, and prototypical networks on the test set.
  • VICReg hyperparameters lambda, mu, phi = 10, 10, 1
    Adopted from prior work [16] and not fitted here; listed for completeness because they shape the feature extractor.
  • MLP architecture = five layers, 1600 to 128
    Chosen by the authors; layer dimensions are given but no search or rationale is reported.
  • Entropy threshold and sliding-window size = 0.8, 64 pixels
    Set to ensure consistency with prior work; these constants determine which crops are used for training and evaluation.
assumptions (5)
  • domain assumption Sliding-window crops mostly contain a single music symbol after entropy filtering and Sauvola binarisation.
    Pipeline Section III.A asserts crops 'ideally containing a single symbol', but no verification of this assumption is reported.
  • domain assumption VICReg self-supervised pretraining on unlabeled crops yields features that transfer to symbol classification.
    The entire method depends on this; no ablation compares against supervised features or random features.
  • domain assumption The evaluation protocol is comparable to that of Alfaro-Contreras et al. [15].
    The claimed improvement over the baseline assumes identical crops, splits, and feature training; the paper's own kNN reproduction at A=0 differs from the baseline (79.8 vs 82.0 at K=5), casting doubt on this assumption.
  • domain assumption The Capitan dataset labels are correct and the 28 classes are balanced enough for mean accuracy to be meaningful.
    No class-balanced reporting or per-class error bars are given, and the confusion matrices indicate significant misclassification of beamed notes.
  • standard math Standard results for VICReg, SVM, MLP, and prototypical networks are assumed.
    These methods are cited rather than derived; this is appropriate for an empirical paper.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Low-Data Classification of Historical Music Manuscripts: A Few-Shot Learning Approach." pith.science (2026). https://pith.science/paper/K7YXNOBJ

@misc{pith2026241116408,
  author       = {Pith},
  title        = {Pith review of: Low-Data Classification of Historical Music Manuscripts: A Few-Shot Learning Approach},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/K7YXNOBJ}},
  note         = {Machine review of arXiv:2411.16408}
}
read the original abstract

In this paper, we explore the intersection of technology and cultural preservation by developing a self-supervised learning framework for the classification of musical symbols in historical manuscripts. Optical Music Recognition (OMR) plays a vital role in digitising and preserving musical heritage, but historical documents often lack the labelled data required by traditional methods. We overcome this challenge by training a neural-based feature extractor on unlabelled data, enabling effective classification with minimal samples. Key contributions include optimising crop preprocessing for a self-supervised Convolutional Neural Network and evaluating classification methods, including SVM, multilayer perceptrons, and prototypical networks. Our experiments yield an accuracy of 87.66\%, showcasing the potential of AI-driven methods to ensure the survival of historical music for future generations through advanced digital archiving techniques.

Figures

Figures reproduced from arXiv: 2411.16408 by the authors.

Figure 1
Figure 1. A depiction of the musical symbol classification pipeline based on the pipeline by [15]. [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. Examples of the transformations utilised prior to [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. Effect of Augmentations on Classification Accuracy [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (2 more)
Figure 4
Figure 4. Figure 4: Confusion matrix showing the classification of a subset of classes which were significantly misclassified for all classifiers. [PITH_FULL_IMAGE:figures/full_fig_p005_4.png]
Figure 5
Figure 5. Figure 5: Confusion matrices for (a) Multilayer Perceptron [PITH_FULL_IMAGE:figures/full_fig_p006_5.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

25 extracted references · 19 canonical work pages

  1. [15]

    Few-shot symbol classification via self-supervised learning and nearest neighbor

    Alfaro-Contreras M, R ´ıos-Vila A, Valero-Mas JJ, Calvo-Zaragoza J. Few-shot symbol classification via self-supervised learning and nearest neighbor. Pattern Recognition Letters. 2023 Mar 1;167:1-8

  2. [1]

    The Challenge of Optical Music Recogni- tion,

    D. Bainbridge and T. Bell, “The Challenge of Optical Music Recogni- tion,” Computers and the Humanities, vol. 35, no. 2, pp. 95–121, May

  3. [2]

    A Preliminary Study of Few- shot Learning for Layout Analysis of Music Scores

    Castellanos FJ, Gallego AJ, Fujinaga I. A Preliminary Study of Few- shot Learning for Layout Analysis of Music Scores. In5 th International Workshop on Reading Music Systems 2023 Nov (p. 44)

  4. [3]

    Two (Note) Heads Are Bet- ter Than One: Pen-Based Multimodal Interaction with Music Scores

    Calvo-Zaragoza J, Rizo D, Quereda JM. Two (Note) Heads Are Bet- ter Than One: Pen-Based Multimodal Interaction with Music Scores. InISMIR 2016 Aug 7 (pp. 509-514)

  5. [4]

    nearest neighbor

    Beyer K, Goldstein J, Ramakrishnan R, Shaft U. When is “nearest neighbor” meaningful?. InDatabase Theory—ICDT’99: 7th International Conference Jerusalem, Israel, January 10–12, 1999 Proceedings 7 1999 (pp. 217-235). Springer Berlin Heidelberg. (a) MLP with K = 10, A = 2 (b) Prototypical classifier with S = 6, Q = 4, A = 2 Fig. 5: Confusion matrices for (a...

  6. [5]

    Intelligent optimization methods for high-dimensional data classification for support vector machines

    Ding S, Chen L. Intelligent optimization methods for high-dimensional data classification for support vector machines

  7. [6]

    Model-agnostic meta-learning for fast adap- tation of deep networks

    Finn C, Abbeel P, Levine S. Model-agnostic meta-learning for fast adap- tation of deep networks. International conference on machine learning 2017 Jul 17 (pp. 1126-1135). PMLR

  8. [7]

    On first-order meta-learning algo- rithms

    Nichol A, Achiam J, Schulman J. On first-order meta-learning algo- rithms. arXiv preprint arXiv:1803.02999. 2018 Mar 8

Show all 25 references
  1. [8]

    Meta-learning in neural networks: A survey

    Hospedales T, Antoniou A, Micaelli P, Storkey A. Meta-learning in neural networks: A survey. IEEE transactions on pattern analysis and machine intelligence. 2021 May 11;44(9):5149-69

  2. [9]

    Prototypical networks for few-shot learning

    Snell J, Swersky K, Zemel R. Prototypical networks for few-shot learning. Advances in neural information processing systems. 2017;30

  3. [10]

    SSL-ProtoNet: Self-supervised Learning Prototypical Networks for few-shot learning

    Lim JY , Lim KM, Lee CP, Tan YX. SSL-ProtoNet: Self-supervised Learning Prototypical Networks for few-shot learning. Expert Systems with Applications. 2024 Mar 15;238:122173

  4. [11]

    A baseline for few-shot image classification

    Dhillon GS, Chaudhari P, Ravichandran A, Soatto S. A baseline for few-shot image classification. arXiv preprint arXiv:1909.02729. 2019 Sep 6

  5. [12]

    A survey on image data augmentation for deep learning

    Shorten C, Khoshgoftaar TM. A survey on image data augmentation for deep learning. Journal of big data. 2019 Dec;6(1):1-48

  6. [13]

    Few-shot image clas- sification: Just use a library of pre-trained feature extractors and a simple classifier

    Chowdhury A, Jiang M, Chaudhuri S, Jermaine C. Few-shot image clas- sification: Just use a library of pre-trained feature extractors and a simple classifier. InProceedings of the IEEE/CVF International Conference on Computer Vision 2021 (pp. 9445-9454)

  7. [14]

    A few-shot learning approach for historical ciphered manuscript recognition

    Souibgui MA, Forn ´es A, Kessentini Y , Tudor C. A few-shot learning approach for historical ciphered manuscript recognition. In2020 25th International Conference on Pattern Recognition (ICPR) 2021 Jan 10 (pp. 5413-5420). IEEE

  8. [17]

    Glyph and position classification of music symbols in early music manuscripts

    Nu ˜nez-Alcover A, de Le ´on PJ, Calvo-Zaragoza J. Glyph and position classification of music symbols in early music manuscripts. InPattern Recognition and Image Analysis: 9th Iberian Conference, IbPRIA 2019, Madrid, Spain, July 1–4, 2019, Proceedings, Part II 9 2019 (pp. 159-...

  9. [18]

    A comprehensive survey of few-shot learning: Evolution, applications, challenges, and opportunities

    Song Y , Wang T, Cai P, Mondal SK, Sahoo JP. A comprehensive survey of few-shot learning: Evolution, applications, challenges, and opportunities. ACM Computing Surveys. 2023 Jul 13;55(13s):1-40

  10. [19]

    Optical music recognition: State of the art and major challenges

    Shatri E, Fazekas G. Optical music recognition: State of the art and major challenges. TENOR Conference 2020, Hamburg, Germany. arXiv preprint arXiv:2006.07885. 2020 Jun 14

  11. [20]

    Adaptive docu- ment binarization

    Sauvola J, Seppanen T, Haapakoski S, Pietikainen M. Adaptive docu- ment binarization. In Proceedings of the fourth international conference on document analysis and recognition 1997 Aug 18 (V ol. 1, pp. 147- 152). IEEE

  12. [21]

    Vicreg: Variance-invariance- covariance regularization for self-supervised learning

    Bardes A, Ponce J, LeCun Y . Vicreg: Variance-invariance- covariance regularization for self-supervised learning. arXiv preprint arXiv:2105.04906. 2021 May 11

  13. [22]

    DoReMi: First glance at a universal OMR dataset

    Shatri E, Fazekas G. DoReMi: First glance at a universal OMR dataset. arXiv preprint arXiv:2107.07786. 2021 Jul 16

  14. [23]

    Shatri, E., Fazekas, G. (2024). Knowledge Discovery in Optical Music Recognition: Enhancing Information Retrieval with Instance Segmen- tation. In 2024 International Conference in Knowledge Discovery and Information Retrieval (KDIR)

  15. [24]

    Handwritten music recognition for mensural notation with convolutional recurrent neural networks

    Calvo-Zaragoza J, Toselli AH, Vidal E. Handwritten music recognition for mensural notation with convolutional recurrent neural networks. Pattern Recognition Letters. 2019 Dec 1;128:115-21

  16. [25]

    (2024, August)

    R ´ıos-Vila, A., Calvo-Zaragoza, J., Paquet, T. (2024, August). Sheet music transformer: End-to-end optical music recognition beyond mono- phonic transcription. In International Conference on Document Analysis and Recognition (pp. 20-37). Cham: Springer Nature Switzerland

  17. [2001]

    Available: https://doi.org/10.1023/A:1002485918032

    [Online]. Available: https://doi.org/10.1023/A:1002485918032

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.