Pith. sign in

REVIEW 3 major objections 5 minor 1 cited by

Multi-Label Plant Species Prediction with Metadata-Enhanced Multi-Head Vision Transformers

T0 review · 3 major / 5 minor · reviewed 2026-08-05 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read A frozen DINOv2 backbone with species, genus, and family heads fusing probabilities reaches third place in PlantCLEF 2025 with macro-F1 0.33655.

desk verdict Candid competition note with an externally real 3rd-place score, but the paper contradicts itself on whether ViT-L was used, and the reported winning score isn't their own best selected submission. read the letter →

arxiv 2508.10457 v1 pith:W3LVWXYT submitted 2025-08-14 cs.CV cs.IRcs.LG

Hanna Herasimchyk , Robin Labryga , Tomislav Prusina This is my paper · ORCID
classification cs.CVcs.IRcs.LG
keywords multi-labelclassificationplantspeciesidentificationDINOv2visiontransformertaxonomichierarchymulti-scaletilingvegetationplotimagesCLEF2025
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper attempts to show that multi-label plant-species recognition in dense vegetation-plot images can be handled without training a new visual backbone. It uses a frozen DINOv2 ViT-B/14 encoder pretrained on single-species images, with separate classification heads for species, genus, and family whose probabilities are multiplied so only taxonomically valid combinations survive. On the PlantCLEF 2025 private leaderboard this pipeline reaches macro-F1 0.33655, ranking third, and the authors identify multi-scale tiling and dynamic thresholding as the key inference ingredients. The result matters because vegetation-plot inventories are slow expert work, and a pipeline built from a frozen backbone plus lightweight heads is far cheaper to deploy than a fully trained multi-species model. At the same time, every submitted model scored lower on the private than on the public set, so the paper's own evidence shows the single-to-multi-species domain shift is only partially bridged.

What carries the argument

Multi-head taxonomic fusion over a frozen DINOv2 ViT-B/14 backbone. The frozen encoder produces one embedding; separate lightweight heads predict species, genus, and family; the probabilities are multiplied and impossible taxonomic combinations are masked out. Multi-scale tiling (splitting each quadrat into non-overlapping grids of size 4 and 5) lets the same encoder see plants at different scales, while a bisection search sets a global logit threshold so each image gets about four species predictions.

What would settle it

Train the same multi-head, tiling, and thresholding pipeline on a backbone that has been continually pre-trained on the LUCAS quadrat-like images, and compare its private macro-F1 to the frozen backbone's 0.33655; if the adapted backbone does not beat the frozen one, the score is carried by the taxonomic heads and thresholds, not by transfer of the frozen embeddings.

Watch

Extended reading notes

Core claim

The central claim is that taxonomic hierarchy can be injected into a frozen self-supervised vision transformer to turn a single-species classifier into a competitive multi-species presence predictor. From one DINOv2 embedding, the model predicts species, genus, and family, multiplies the three probability vectors, and discards combinations absent from the training metadata; this fusion moves it past the single-head baseline. With multi-scale tiling, dynamic logit thresholds (about four species per image), and bagged/Hydra ensembles, the method reports private macro-F1 0.33655, third place. The paper also documents a consistent public-to-private score drop, which it reads as domain-shift sens

Load-bearing premise

The load-bearing premise is that a frozen DINOv2 backbone trained on single-species images produces embeddings from dense multi-species quadrat images that are informative enough for linear heads trained on single-species crops to recognize the species present.

Editorial extensions

If this is right

  • Vegetation-plot inventories could be partially automated without training a new backbone; a frozen encoder plus lightweight taxonomic heads is the deployable unit.
  • Taxonomic probability multiplication is a transferable post-processing layer: any single-species classifier with genus and family outputs can be adapted to multi-label presence prediction.
  • Public-leaderboard tuning is risky: all five selected submissions scored lower on the private set, so competition-style model selection needs validation data drawn from the quadrat distribution.
  • Strategies like plant/non-plant filtering, metadata merging, and kernel smoothing were tried and did not help under this pipeline, so future systems can focus effort on tiling and thresholding.
  • Multi-scale tiling appears to absorb the benefit of kernel-based smoothing, since plants spanning tile boundaries are already seen at multiple resolutions.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the frozen-backbone transfer is the real driver, continually pre-training the same ViT on the LUCAS quadrat-like images would be a direct test: a backbone adapted to plot imagery should beat the frozen one on the private split, and failing to do so would indicate the heads and thresholds, not the backbone, carry the method.
  • The probability-multiplication trick is a form of hierarchical constraint decoding that should transfer to other strongly hierarchical domains, such as fungi or insect identification, where single-species training sets and multi-species field images coexist.
  • A cheap local validation set built from LUCAS images with pseudo-labels would let future teams do model selection without public-leaderboard overfitting, directly addressing the public-to-private drop the authors observed.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper describes a multi-label plant species prediction pipeline for the PlantCLEF 2025 challenge. The authors use a frozen DINOv2 ViT-B/14 backbone provided by the organizers, equipped with separate MLP heads for species, genus, and family prediction. Taxonomic probabilities are multiplied and invalid triples are discarded. Inference combines multi-scale tiling, top-n/max-length constraints, dynamic logit thresholding, and ensemble strategies (Hydra and bagging). The system is reported to have achieved macro-F1 0.33655 on the private leaderboard, placing third, and 0.37555 on the public leaderboard, placing second. The paper includes a detailed description of the data, preprocessing, training setup, and inference heuristics, as well as a critical discussion of methods that did not work (e.g., LUCAS pre-training, plant/non-plant filtering, kernel smoothing).

Significance. If the reported leaderboard results are accurate, the paper demonstrates a competitive, externally validated pipeline for a difficult domain-shift task: training on single-species images while testing on multi-species vegetation plots. The result is directly supported by public leaderboard records, and the authors provide a public code repository. The paper is honest about negative results and does not overclaim local validation. However, the technical novelty is modest; the main contributions are a combination of known components (multi-head taxonomic classification, tiling, thresholding, ensembling) rather than a new architecture or algorithm. The value of the paper lies primarily in its reproducible engineering and in the detailed reporting of what did and did not work in a constrained competition setting.

major comments (3)
  1. [§3.3 and Table 2] There is a direct contradiction in the description of the submitted pipeline. §3.3 states that training a DINOv2 ViT-L/14 model requires approximately 30 h per iteration and more than 1,500 h total, 'rendering this approach infeasible within the project's resource constraints.' Yet Table 2 lists a selected submission containing 'Vitlarge' as one of the five chosen submissions, and this is the submission with private score 0.33655 reported as the 3rd-place result. The paper gives no explanation of how the ViT-L model was trained, whether it was a pretrained backbone with only the heads trained, or whether the label in the table denotes something else. This is load-bearing: the central reproduction claim requires the exact composition of the submitted ensemble to be unambiguous. Please either provide the missing training details for ViT-L or correct Table 2 and the surrounding text.
  2. [§4, Table 2] The paper states, 'Our primary multi-head classification approach achieved a substantial improvement over the baseline, which relied on simple single-head plant species classification,' and claims that Table 2 highlights this improvement. However, Table 2 contains no single-head baseline row at all; every listed submission uses multi-head species/genus/family prediction. Without a single-head control under otherwise matched configurations, the paper's central component claim about multi-head taxonomic fusion is not supported by any reported evidence. This is not a request for exhaustive ablations, but a baseline for the headline claim is essential in a methods paper.
  3. [§3.2, §3.4, §4] Most component-level claims (cropping percentage, tiling scales, top-n filtering, dynamic thresholding, bagging) are supported only by comparing full submissions on the public and private leaderboards, and the paper itself acknowledges that the public/private sets are imbalanced and that leaderboard-driven optimization likely led to public-set overfitting. For example, §3.2 says 10% cropping was best on public and 5% best on private, but Table 2 does not provide a controlled comparison between these two variants. The contribution list in the abstract thus rests on observations that are partly self-confirmatory: the same public scores used to select hyperparameters are later cited as evidence of their value. Given the small differences among private scores (e.g., 0.34575 vs. 0.33655) and the absence of error bars, the paper should temper its causal language and clearly separate 'what work
minor comments (5)
  1. [Equation (1)] The transect-averaged macro-F1 formula is not displayed cleanly in the text. Please ensure it renders correctly and define all subscripts explicitly (N, T_i) in the caption or surrounding text.
  2. [Table 2] The table formatting is difficult to parse: the model column contains multi-line entries such as 'Hydra 5h1l Vitlarge', and the columns 'min', 'mean', 'max', 'crop %' are not clearly explained in the caption. In particular, 'crop %' values like '8,10,12' and '1,2,4,5' need a precise definition (does 8,10,12 denote three separate crop experiments?).
  3. [§3.2] The sentence 'The 10% cropping strategy yielded the best results on the public leaderboard, while the 5% strategy was more effective on the private one' is stated as a conclusion, but Table 2 does not provide a direct 10% vs. 5% comparison under the same model. Consider presenting such a comparison explicitly, or state that this is an informal observation.
  4. [References] Reference [4] appears to be the ViT paper 'An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale', but the author list is incorrectly ordered/incomplete (Kolesnikov is listed first, and the actual citation style is non-standard for ICLR). Please correct the citation.
  5. [Abstract] The abstract emphasizes 'metadata-enhanced' and 'metadata' in the title, but the metadata merging method described in §3.4 was not used in the final pipeline. Clarify that the 'metadata' used is the taxonomic labels (species/genus/family) at training time, not additional test-time metadata, to avoid misleading readers.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity identified: the central claim is an externally measured private-leaderboard score, and no derivation reduces to its inputs.

full rationale

This is an empirical competition paper, not a derivation, and its load-bearing claim is a score/rank on the PlantCLEF 2025 private leaderboard. That score is an externally computed benchmark that was not used for the paper's model-selection decisions; Table 2 explicitly separates public and private scores and notes that public-optimized submissions dropped on the private set, so the private result is not forced by construction. The methodological components (multi-head taxonomic fusion, multi-scale tiling, dynamic thresholding, bagging) are engineering choices evaluated against that external metric. Tuning thresholds and top-n filters on the public leaderboard is standard model selection and does not make the private score self-confirmatory. There are no load-bearing self-citations: the cited DINOv2 models and PlantCLEF overviews are by the challenge organizers, not by the present authors, and the pretrained backbone is an externally provided artifact. The internal inconsistency between the claimed infeasibility of ViT-L training (§3.3: 'total training time would exceed 1,500 hours ... rendering this approach infeasible') and the appearance of 'Vitlarge' in the final selected submission (Table 2) is a reproducibility/correctness problem, not a circularity, and is therefore not scored here.

Assumptions & free parameters 5 free parameters · 3 assumptions · 0 invented entities

The central claim rests on a handful of leaderboard-fitted hyperparameters and three domain assumptions: transfer of frozen features, validity of public-leaderboard model selection, and the usefulness of independent taxonomic probability multiplication. No new physical or conceptual entities are introduced.

free parameters (5)
  • image crop percentage = 10% public best, 5% private best
    Centrally cropping 5-15% from each side; 10% was selected on the public leaderboard, while 5% did better on private (Section 3.2, Table 2).
  • mean prediction length / logit threshold = 4.0 species per image, with values 3.9-4.2 evaluated
    Dynamic threshold optimized by bisection to hit a target mean number of species per image; target chosen using public leaderboard performance (Section 3.4, Table 2).
  • top-n species upper bound = 9 or unlimited, sometimes 10
    Maximum number of species predicted per image was tuned on the public leaderboard and generally hurt private score (Section 3.4, Table 2).
  • tile scales = grid sizes 4 and 5, non-overlapping
    Multi-scale tiling grids were selected empirically; overlap and other scales yielded no improvement (Sections 3.2 and 4).
  • classification head depths = one-layer species head, two-layer genus and family heads
    Hydra heads with varying depths were trained and the best configuration was selected (Section 3.3).
assumptions (3)
  • domain assumption The public leaderboard is a reliable enough signal for model and hyperparameter selection despite public/private imbalance.
    No local validation was possible because of domain shift, so all decisions were made on public leaderboard scores (Section 3.4); the paper later states this led to overfitting (Section 4).
  • domain assumption Frozen DINOv2 features pretrained on single-species images transfer to multi-species quadrat images.
    The backbone is used without fine-tuning and heads are trained only on single-species data (Sections 2.3 and 3.3).
  • ad hoc to paper Multiplying independently predicted species, genus, and family probabilities and zeroing invalid taxonomic triples produces a valid ranking of species presence.
    This taxonomic fusion is the paper's main methodological idea; it assumes the head outputs are independent enough for multiplication to rank correctly, which is not tested (Section 3.3).

how reviews work

0 comments
Cite this review

Pith. "Pith review of Multi-Label Plant Species Prediction with Metadata-Enhanced Multi-Head Vision Transformers." pith.science (2026). https://pith.science/paper/W3LVWXYT

@misc{pith2026250810457,
  author       = {Pith},
  title        = {Pith review of: Multi-Label Plant Species Prediction with Metadata-Enhanced Multi-Head Vision Transformers},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/W3LVWXYT}},
  note         = {Machine review of arXiv:2508.10457}
}
read the original abstract

We present a multi-head vision transformer approach for multi-label plant species prediction in vegetation plot images, addressing the PlantCLEF 2025 challenge. The task involves training models on single-species plant images while testing on multi-species quadrat images, creating a drastic domain shift. Our methodology leverages a pre-trained DINOv2 Vision Transformer Base (ViT-B/14) backbone with multiple classification heads for species, genus, and family prediction, utilizing taxonomic hierarchies. Key contributions include multi-scale tiling to capture plants at different scales, dynamic threshold optimization based on mean prediction length, and ensemble strategies through bagging and Hydra model architectures. The approach incorporates various inference techniques including image cropping to remove non-plant artifacts, top-n filtering for prediction constraints, and logit thresholding strategies. Experiments were conducted on approximately 1.4 million training images covering 7,806 plant species. Results demonstrate strong performance, making our submission 3rd best on the private leaderboard. Our code is available at https://github.com/geranium12/plant-clef-2025/tree/v1.0.0.

Figures

Figures reproduced from arXiv: 2508.10457 by the authors.

Figure 1
Figure 1. Examples of training images. The distribution of images across species is shown in [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. Distribution of images per species. Half of all images belong to the 1,787 most common species, while 90% of images are from the 4,336 most common species, indicating a bias in species representation. 0 500 1,000 1,500 0 50 100 150 Genus rank (sorted by species count) Species count 0 50 100 150 0 500 1,000 Family rank (sorted by species count) [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. Distribution of species in genus and family respectively. 50% of all species are found within the 113 largest genera, and 90% are contained within the 728 largest genera. Similarly, 50% of species belong to just 9 of the largest families, while 90% are included in the 49 largest families. Similarly to [PITH_FULL_IMAGE:figures/full_fig_p003_3.png] view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: Examples of test vegetation plots. where: • 𝑁 is the total number of transects, • 𝑇𝑖 is the number of quadrats in transect 𝑖, • 1 𝑇𝑖 ∑︀𝑇𝑖 𝑗=1 F1𝑖𝑗 is the macro-averaged F1-score for quadrat 𝑗 in transect 𝑖. 2.3. DINOv2 Model We used a DINOv2 model [5, 8] provided by th…

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Multi-Scale ViT Inference with Habitat-Fit Priors and kNN Retrieval for Multi-Species Plant Identification

    cs.CV 2026-07 conditional novelty 4.0 of 10

    A multi-scale DINOv2 tile classifier with habitat-fit geographic/altitude priors and kNN retrieval scored 0.439 macro-F1 (third place) on PlantCLEF 2026.

Reference graph

Works this paper leans on

22 extracted references · 21 canonical work pages · cited by 1 Pith paper

  1. [1]

    Goëau, G

    H. Goëau, G. Martellucci, P. Bonnet, F. Vinatier, A. Joly, PlantCLEF2025 @ LifeCLEF & CVPR-FGVC, https://kaggle.com/competitions/plantclef-2025, 2025. Kaggle

    work page 2025

  2. [2]

    Picek, S

    L. Picek, S. Kahl, H. Goëau, L. Adam, T. Larcher, C. Leblanc, M. Servajean, K. Janoušková, J. Matas, V. Čermák, K. Papafitsoros, R. Planqué, W.-P. Vellinga, H. Klinck, T. Denton, J. S. Cañas, G. Martel- lucci, F. Vinatier, P. Bonnet, A. Joly, Overview of lifeclef 2025: Challenges on species presence prediction and identification, and individual animal ide...

    work page 2025

  3. [3]

    Janouskova, J

    K. Janouskova, J. Matas, L. Picek, Overview of FungiCLEF 2025: Few-shot classification with rare fungi species, in: Working Notes of CLEF 2025 - Conference and Labs of the Evaluation Forum, 2025

    work page 2025

  4. [4]

    Kolesnikov, A

    A. Kolesnikov, A. Dosovitskiy, D. Weissenborn, G. Heigold, J. Uszkoreit, L. Beyer, M. Minderer, M. Dehghani, N. Houlsby, S. Gelly, T. Unterthiner, X. Zhai, An image is worth 16x16 words: Transformers for image recognition at scale, International Conference on Learning Representations (2021)

    work page 2021

  5. [5]

    Oquab, T

    M. Oquab, T. Darcet, T. Moutakanni, H. Vo, M. Szafraniec, V. Khalidov, P. Fernandez, D. Haziza, F. Massa, A. El-Nouby, M. Assran, N. Ballas, W. Galuba, R. Howes, P.-Y. Huang, S.-W. Li, I. Misra, M. Rabbat, V. Sharma, G. Synnaeve, H. Xu, H. Jegou, J. Mairal, P. Labatut, A. Joulin, P. Bojanowski, Dinov2: Learning robust visual features without supervision, ...

    work page 2024

  6. [6]

    Goëau, V

    H. Goëau, V. Espitalier, P. Bonnet, A. Joly, Overview of PlantCLEF 2024: multi-species plant identification in vegetation plot images, Conference and Labs of the Evaluation Forum (2024)

    work page 2024

  7. [7]

    A. Joly, L. Picek, S. Kahl, H. Goëau, V. Espitalier, C. Botella, D. Marcos, J. Estopinan, C. Leblanc, T. Larcher, M. Šulc, M. Hrúz, M. Servajean, H. Glotin, R. Planqué, W.-P. Vellinga, H. Klinck, T. Denton, I. Eggel, P. Bonnet, H. Müller, Overview of lifeclef 2024: Challenges on species distribution prediction and identification, Conference and Labs of th...

    work page 2024

  8. [8]

    Goëau, J

    H. Goëau, J. Lombardo, A. Affouard, V. Espitalier, P. Bonnet, A. Joly, PlantCLEF 2024 pretrained models on the flora of the south western Europe based on a subset of Pl@ntNet collaborative images and a ViT base patch 14 dinoV2, 2024

    work page 2024

Show all 22 references
  1. [9]

    Darcet, M

    T. Darcet, M. Oquab, J. Mairal, P. Bojanowski, Vision Transformers Need Registers, International Conference on Learning Representations (2024)

    2024

  2. [10]

    Gustineli, A

    M. Gustineli, A. Miyaguchi, I. Stalter, Multi-Label Plant Species Classification with Self-Supervised Vision Transformers, Conference and Labs of the Evaluation Forum (2024)

    2024

  3. [11]

    S. Foy, S. McLoughlin, Utilizing Dino V2 for Domain Adaptation in Vegetation Plot Analysis, Conference and Labs of the Evaluation Forum (2024)

    2024

  4. [12]

    Chulif, H

    S. Chulif, H. Ishrat, Y. Chang, S. Lee, Patch-wise inference using pretrained vision transformers: Neuon submission to plantclef2024, Conference and Labs of the Evaluation Forum (2024)

    2024

  5. [13]

    d’Andrimont, M

    R. d’Andrimont, M. Yordanov, L. Martinez-Sanchez, P. Haub, O. Buck, C. Haub, B. Eiselt, M. van der Velde, Lucas cover photos 2006–2018 over the eu: 874 646 spatially distributed geo-tagged close-up photos with land cover and plant species label, Earth System Science Data (2022)

    2006

  6. [14]

    Hastie, R

    T. Hastie, R. Tibshirani, J. Friedman, The elements of statistical learning, 2009

    2009

  7. [15]

    Kattenborn, J

    T. Kattenborn, J. Leitloff, F. Schiefer, S. Hinz, Review on convolutional neural networks (cnn) in vegetation remote sensing, ISPRS Journal of Photogrammetry and Remote Sensing (2021)

    2021

  8. [16]

    Reedha, E

    R. Reedha, E. Dericquebourg, R. Canals, A. Hafiane, Transformer neural network for weed and crop classification of high resolution uav images, Remote sensing (2022)

    2022

  9. [17]

    E. H. Adelson, C. H. Anderson, J. R. Bergen, P. J. Burt, J. M. Ogden, Pyramid methods in image processing, RCA Engineer (1984)

    1984

  10. [18]

    C. N. Silla, A. A. Freitas, A survey of hierarchical classification across different application domains, Data mining and knowledge discovery (2011)

    2011

  11. [19]

    J. G. Colonna, J. Gama, E. F. Nakamura, A comparison of hierarchical multi-output recognition approaches for anuran classification, Machine Learning (2018)

    2018

  12. [20]

    J. N. Hernandez, L. E. Sucar, E. F. Morales, A hybrid global-local approach for hierarchical classification., Florida Artificial Intelligence Research Society (2013)

    2013

  13. [21]

    Fiaschi, M

    L. Fiaschi, M. Cococcioni, Informed deep hierarchical classification: a non-standard analysis inspired approach, IEEE Transactions on Neural Networks and Learning Systems (2024)

    2024

  14. [22]

    Shorten, T

    C. Shorten, T. M. Khoshgoftaar, A survey on image data augmentation for deep learning, Journal of Big Data (2019)

    2019

Pith tools

Reviewed August 5, 2026 · model on record in the stance chip above.