Pith. sign in

REVIEW 4 major objections 3 minor 19 references

Handling Imbalanced Pseudolabels for Vision-Language Models with Concept Alignment and Confusion-Aware Calibrated Margin

T0 review · 4 major / 3 minor · reviewed 2026-08-16 · deepseek-v4-flash

Pith's one-line read Vision-language models generate imbalanced pseudolabels because class names can mismatch visual concepts and can blur similar concepts; this paper proposes a framework that detects and repairs both failures and reports a 6.29% relative…

desk verdict Worth a serious referee: real UL gains and a useful diagnosis, but the causal story hinges on an unvalidated detector and the 6.29% headline only holds in one setting. read the letter →

arxiv 2505.02056 v1 pith:GTFPJATD submitted 2025-05-04 cs.CV cs.LG

classification cs.CVcs.LG
keywords vision-languagemodelspseudolabelsclassimbalanceconceptmismatchconfusionCLIPfine-tuningconfidencecalibrationprompttuning
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper claims that the imbalanced pseudolabels CLIP produces when adapting to downstream image classification come from two identifiable flaws, concept mismatch and concept confusion. Concept mismatch is the failure of a class name's text feature to line up with the visual features of its images; concept confusion is the failure of text features to separate similar classes, biasing predictions toward one of them. The paper proposes a concept-adaptive pseudolabeling (CAP) framework that detects mismatched classes by iterative clustering, repairs their text descriptions with a large language model, and trains with a confusion-aware calibrated margin that penalizes overconfident and imbalanced predictions. On six benchmarks across unsupervised, semi-supervised, and transductive zero-shot settings, it reports consistent gains and a relative improvement of 6.29% over the prior state of the art. If correct, the result matters because it makes task adaptation of vision-language models viable without annotated data.

What carries the argument

The load-bearing machinery is the pairing of an iterative mismatch detector with a confusion-aware calibrated margin. The detector repeatedly runs K-Means on image features, scores text features against cluster centroids, and removes the best-matched text-class and its cluster, leaving a small set of suspected concept-mismatched classes; a large language model then writes candidate descriptions and the one most similar to remaining centroids is chosen. The margin uses a logit-adjustment-style loss, $L_m(y,z) = -\log\frac{e^{z_y}}{e^{z_y} + \sum_{c \neq y} e^{z_c + M_{yc}}}$, where the margin matrix $M = S \odot m$ combines inter-class similarity $S$ with class-wise scales $m_c = m\,\Delta\,\delta_c$ derived from the model's prediction-frequency imbalance. Recomputing $M$ each epoch makes the calibration adapt as confusion is resolved. Two separate adapters, one for clean pseudolabels and one for dynamically labeled unlabeled data, prevent errors made on the unlabeled stream from contaminating the high-confidence stream.

What would settle it

Compare the classes Algorithm 1 flags as concept-mismatched against known per-class zero-shot accuracies and cluster purities on a label-available benchmark; if flagged classes are not consistently among the worst zero-shot classes, the detector's cluster-to-class premise fails. A sharper check is EuroSAT: with $t=\lceil C/10\rceil=1$ the loop removes all ten classes, so concept alignment should detect nothing; if CAP still outperforms its no-concept-alignment ablation there, the reported gains cannot be attributed to mismatch detection.

Watch

Extended reading notes

Core claim

On the paper's own terms, the central discovery is that the imbalance in vision-language pseudolabels has two distinct, addressable causes. In concept mismatch, the text embedding of a class is far from that class's image embeddings even though the images cluster tightly, so confident pseudolabeling assigns few or no correct labels to the class; the paper's cluster analysis on RESISC45 shows low-accuracy classes still form coherent clusters, locating the problem on the text side. In concept confusion, text embeddings of similar classes fail to encode the distinguishing visual cues, so zero-shot predictions and pseudolabels become biased toward one class. The CAP framework treats mismatch by detecting the affected classes and enhancing their text descriptions, and treats confusion by adding a similarity- and tendency-aware margin to the training loss, forcing more distinguishable and balanced logits. The paper reports that this combination raises accuracy and balances predictions across classes, with the largest gains on previously underperforming classes.

Load-bearing premise

The weakest assumption is that K-Means clusters of raw image features correspond to the true classes, so that repeatedly removing the best-matched text-cluster pair leaves exactly the classes whose names are misaligned.

Editorial extensions

If this is right

  • Underperforming classes receive more correct pseudolabels through concept alignment, so per-class accuracy on the tail of the zero-shot distribution rises rather than being averaged away.
  • The calibrated margin makes confidence scores better calibrated within confused groups, so a fixed confidence threshold yields more reliable pseudolabels and less confirmation bias.
  • Because pseudolabels become more balanced and accurate, the method improves results in all three learning paradigms it was tested on, including transductive zero-shot learning where only seen classes are labeled.
  • Separating main and pseudo adapters lets the model keep learning from all unlabeled data while insulating the high-confidence pseudolabel stream from the lower-quality dynamic pseudolabels.
  • The method trains once rather than iteratively, making it about 3.5 times faster than the iterative GRIP baseline.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same detect-then-enhance pattern could apply to other vision-language tasks where class names misalign with visuals, such as open-vocabulary detection and segmentation, by treating each output category as a class whose name may need repair.
  • On fine-grained datasets, the detector's reliance on K-Means is the natural place to probe: hierarchical or soft clustering might identify mismatched classes without splitting or merging true classes, and a comparison against per-class zero-shot accuracy would show which detector is more faithful.
  • The margin's class-wise scales could be read each epoch as a live measure of which confusions persist, potentially serving as a diagnostic tool for class granularity rather than only a training loss.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 3 minor

Summary. The paper studies imbalanced pseudolabels produced by vision-language models (CLIP) during unsupervised adaptation. It attributes the imbalance to two causes: concept mismatch (text features of a class are misaligned with its visual concept) and concept confusion (similar classes' text features fail to capture distinguishing visual cues). The proposed CAP framework first detects concept-mismatched classes via an iterative clustering algorithm (Algorithm 1) and augments their text descriptions with an LLM, then trains the model with a confusion-aware calibrated margin that up-weights uncertain and similar-class confusions, using separate adapters for confidently pseudolabeled and remaining unlabeled data. Experiments on six datasets under UL, SSL, and TRZSL paradigms compare with FPL, GRIP, and CPL; the abstract reports a 6.29% relative improvement over the state of the art.

Significance. If the central claims are valid, the paper offers a useful conceptual decomposition of pseudolabel imbalance in VLMs and a practical method that improves UL accuracy consistently across six benchmarks while being substantially faster than iterative baselines (about 3.5x over GRIP). The ablation study (Table 2) indicates both proposed components contribute, and the method's code is publicly available for reproducibility. However, the main novelty of the paper is concept alignment, and its detection mechanism is not quantitatively validated; the reported headline improvement is not representative across all three learning paradigms. These issues limit the current significance but do not invalidate the core UL result.

major comments (4)
  1. [§3.1, Algorithm 1] The mismatch-detection algorithm is load-bearing for the concept-alignment contribution, yet it is never validated against ground truth. The paper provides only a qualitative example (Figure 1) and the number of detected classes (Figure 14); there is no precision/recall analysis comparing the detected YMM with classes that actually have low zero-shot or post-fine-tuning accuracy. The algorithm's assumption that K-Means clusters on raw image features correspond to true class identities is especially questionable on fine-grained datasets such as CUB and FGVC-Aircraft, where clusters can split or merge classes, so the retained centroids need not represent concept-mismatched classes. I ask the authors to add quantitative detection evaluation (e.g., overlap of YMM with the lowest-accuracy classes, or per-class accuracy improvement for detected vs. non-detected classes) and to discuss the failure modes of the clustering assumption.
  2. [§3.1, Algorithm 1 vs. Table 1] The EuroSAT configuration creates an internal inconsistency that undermines the attribution of gains to concept alignment. With C=10 and t=ceil(C/10)=1, the while loop in Algorithm 1 terminates only when |Y|<1, i.e., all classes are removed, so YMM is empty and no LLM-based text augmentation is performed. Nevertheless, Table 1 shows CAP improves UL accuracy on EuroSAT by 7.75 points over CPL (75.01 vs. 67.26). Thus on this dataset the observed improvement cannot be explained by concept alignment, yet the paper does not discuss this case. Please explain why the method still improves substantially on EuroSAT, and clarify which components drive the gain when YMM is empty (e.g., CACM or the two-adapter training).
  3. [Abstract, Conclusion, and Table 1] The headline claim of a 6.29% relative improvement over the state of the art is not representative of the full set of results. In SSL, CAP underperforms CPL on CUB (58.04 vs. 58.53) and FGVC-Aircraft (21.79 vs. 22.48); in TRZSL, it underperforms CPL on CUB (61.35 vs. 66.20) and FGVC-Aircraft (29.03 vs. 30.86). The statement that CAP 'consistently surpasses existing methods' is true only under the UL setting. Please specify the exact setting and computation used for the 6.29% figure, and qualify the consistency claim to match the actual table.
  4. [§4.4, Figures 8 and Appendix D.6, D.7] The sensitivity analyses for the margin scale m (Figure 8), the number of pseudolabels k (Table 5), and the confidence threshold tau (Table 6) are all evaluated on the test set, and the default values are selected based on test accuracy. This constitutes test-set tuning and can inflate reported performance. Please use a held-out validation split for selection, or report results across the full range without cherry-picking the test-best value, and state the selection procedure explicitly in the main text.
minor comments (3)
  1. [Throughout] There are several typos and inconsistencies, e.g., 'avaliable' in the abstract, 'foundamental' in the introduction, 'vairous' in §4.2, 'pesudolabels' in §3.1, 'concpet' near the end of §3.2, 'diveded' in §4.1, 'fuction' in Appendix C.2, and 'RESICS45' in the caption of Figure 14. A thorough proofread is needed.
  2. [Table 1] The zero-shot CLIP rows report standard deviations of 0.00 for all entries. Please clarify whether these are single-run numbers or a typo; if they are intended to be zero due to deterministic inference, say so explicitly.
  3. [Abstract, Conclusion] The paper does not specify how the 6.29% relative improvement is computed (e.g., average of per-dataset relative gains or a single aggregated accuracy). Please include the definition or a reference to the results table so the claim is reproducible.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the central claims are evaluated on held-out test sets, and the proposed components are self-training heuristics rather than derived predictions.

full rationale

The paper's central claim is an empirical one: CAP improves test accuracy and balance over baselines on six benchmarks. All headline numbers (including the 6.29% relative improvement) are post-hoc summaries of Table 1, not quantities predicted from fitted parameters. The two components are not circular by construction. Concept alignment (Algorithm 1) detects 'concept-mismatched' classes using KMeans clustering of image features and text-feature similarity, then intersects the retained set with Ylow-t (classes with fewest predicted samples). This is a heuristic operationalization of 'mismatch', not a definition that assumes the conclusion; the subsequent evaluation of corrected pseudolabel accuracy (Figure 6) is against true labels. The confusion-aware calibrated margin (Eqs. 1-7) is computed from the model's own predictions on unlabeled data and from prototype similarities, which creates a self-training feedback loop, but the margin is not fitted to test labels and the final accuracy is independently measured. The EuroSAT case (C=10, t=1 makes Yfinal empty while CAP still gains 7.75% over CPL in UL) weakens the attribution of the gain to concept alignment on that dataset, but it does not make the derivation circular because the method still contains the margin and adapter components. There are no load-bearing self-citations; the citation to Menon et al. (2021) is for the general logit-adjustment idea, which the paper extends with a similarity- and tendency-based margin rather than renaming. No equation reduces to its own input, and no fitted parameter is relabeled as a prediction. The only concerns are about validation of the mismatch detector and attribution of gains, which are correctness/robustness issues, not circularity.

Assumptions & free parameters 5 free parameters · 6 assumptions · 2 invented entities

The central claim rests on several hand-chosen hyperparameters (t, n, k, m, tau) and on assumptions about K-Means cluster-class alignment, LLM description quality, and the calibrating effect of the margin matrix. The classification taxonomy and the margin matrix are new constructs without external validation beyond the paper's own benchmark results.

free parameters (5)
  • t (mismatch detection threshold) = ceil(C/10)
    Controls how many classes are retained after iterative removal in Algorithm 1; chosen by hand without per-dataset tuning. For EuroSAT (C=10) this gives t=1, causing all classes to be removed and no mismatch classes detected.
  • n (LLM query count per class) = 5
    Number of descriptions generated by ChatGPT for each detected mismatched class; chosen by hand.
  • k (pseudolabels per class) = 16
    Number of top-confidence samples assigned as pseudolabels per class in DPL; ablated in Table 5 on test accuracy, not selected on a validation set.
  • m (margin scale) = 12
    Predefined margin scale in Eq. 6; selected based on sensitivity analysis on RESISC45 and DTD test sets (Figure 8), so it is tuned on the evaluation data.
  • tau (confidence threshold) = 0.85 (UL), 0.5 (SSL/TRZSL)
    Threshold for confidence-based pseudo-labeling in Eq. 3 and for FixMatch-style generation; chosen by hand and ablated on test sets (Table 6).
assumptions (6)
  • domain assumption K-Means clustering of image features produces clusters that correspond to true classes.
    Used throughout Algorithm 1 and concept alignment; if clusters do not align with classes, the detected best-matched classes and the selected LLM descriptions are unreliable.
  • domain assumption The semantic gap in VLMs manifests as the two phenomena of concept mismatch and concept confusion.
    The paper motivates the method with a qualitative analysis of RESISC45 (Figure 1 and footnote 2); this taxonomy is assumed to generalize to all six datasets.
  • domain assumption LLM-generated descriptions, when selected by similarity to cluster centroids, are better aligned with visual concepts than the original class names.
    Text augmentation in Section 3.1 relies on this to improve pseudolabel accuracy; no independent validation that the selected description is semantically correct.
  • domain assumption The margin matrix built from class similarities and prediction tendencies improves calibration and reduces confusion.
    The loss in Eq. 1 with margin Eq. 7 is a heuristic; the paper shows empirical local ECE improvements but no theoretical derivation.
  • domain assumption The model's confidence-based counts sigma(c) are a reliable measure of class-wise prediction tendency for setting margins.
    Eq. 3 uses sigma(c) to define delta_c and Delta; this assumes high-confidence counts reflect true class imbalance rather than miscalibration.
  • domain assumption Using separate adapters for DPL and DUL avoids confirmation bias.
    Section 3.3 and Table 4; the ablation shows independent adapters are not always better (e.g., EuroSAT 76.2 vs 78.3 without), undercutting the stated motivation.
invented entities (2)
  • Concept mismatch and concept confusion taxonomy
    purpose: Categorizes the failure modes of zero-shot VLM predictions to motivate the CAP framework
    The taxonomy is supported only by qualitative examples (Figure 1 and Appendix A) and a heuristic detection algorithm; no formal definition or externally verifiable prediction.
  • Confusion-aware calibrated margin matrix M
    purpose: Modifies the cross-entropy loss to penalize predictions among similar classes and low-tendency classes
    M is computed from the model's own prototypes and confidence counts, so it has no independent falsifiable handle; its effect is only shown in the paper's experiments.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Handling Imbalanced Pseudolabels for Vision-Language Models with Concept Alignment and Confusion-Aware Calibrated Margin." pith.science (2026). https://pith.science/paper/GTFPJATD

@misc{pith2026250502056,
  author       = {Pith},
  title        = {Pith review of: Handling Imbalanced Pseudolabels for Vision-Language Models with Concept Alignment and Confusion-Aware Calibrated Margin},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/GTFPJATD}},
  note         = {Machine review of arXiv:2505.02056}
}
read the original abstract

Adapting vision-language models (VLMs) to downstream tasks with pseudolabels has gained increasing attention. A major obstacle is that the pseudolabels generated by VLMs tend to be imbalanced, leading to inferior performance. While existing methods have explored various strategies to address this, the underlying causes of imbalance remain insufficiently investigated. To fill this gap, we delve into imbalanced pseudolabels and identify two primary contributing factors: concept mismatch and concept confusion. To mitigate these two issues, we propose a novel framework incorporating concept alignment and confusion-aware calibrated margin mechanisms. The core of our approach lies in enhancing underperforming classes and promoting balanced predictions across categories, thus mitigating imbalance. Extensive experiments on six benchmark datasets with three learning paradigms demonstrate that the proposed method effectively enhances the accuracy and balance of pseudolabels, achieving a relative improvement of 6.29% over the SoTA method. Our code is avaliable at https://anonymous.4open.science/r/CAP-C642/

Figures

Figures reproduced from arXiv: 2505.02056 by the authors.

Figure 1
Figure 1. left: The lowest 5 per-class accuracies in RESISC45, right: The distribution of samples of them in clusters. The pink bar represents samples in the cluster in which they appear most frequently, the gray bar represents samples appear in other clusters. previous research (Zhou et al., 2021; Gao et al., 2021; Zhang et al., 2022) shows that they still require adaptation using annotated data from downstream datasets to a… view at source ↗
Figure 2
Figure 2. left: concept mismatch. right: concept confusion. Please see Appendix A for realistic examples of them. the extremely low prediction accuracies for these classes, their image features exhibit good clustering performance, as they mostly concentrated in a single cluster. This indicates that CLIP fails to relate the name of certain classes to the corresponding visual concepts, thus resulting in imbalanced classificatio… view at source ↗
Figure 3
Figure 3. The process of concept alignment. We first take an itera￾tive clustering strategy to detect the concept-mismatched classes. We then utilize LLMs to generate enhanced descriptions for them, and obtain images with top-k similar image features to the en￾hanced text feature each class as pseudolabeled samples. guides VLMs to generate more distinguishable predictions. Overview. The overall workflow of our method can be d… view at source ↗
Figures from the paper (10 more)
Figure 4
Figure 4. Figure 4: Density curve of confidence score for samples in concept￾confused groups by left: zero-shot CLIP and right: CLIP fine-tuned with confusion-aware calibrated margin. using a large language model (LLM) to generate enhanced text descriptions. Specifically, for each class c…
Figure 5
Figure 5. Figure 5: Overview of our framework. In the initialization stage, we use concept alignment to obtain DPL. In the fine-tuning stage, we deploy the main adapter and pseudo adapter to the visual branch, allowing for separate learning from pseudolabeled and unlabeled samples, and we…
Figure 6
Figure 6. Figure 6: Evaluation of concept alignment. left: The accuracy of pseudolabels generated for concept-mismatched classes in Flow￾ers102. right: The test accuracy after fine-tuning under UL setting. 1 2 3 4 Confusion Groups 0.0 0.1 0.2 0.3 0.4 Local ECE 1 2 3 4 Confusion Groups 0.0…
Figure 9
Figure 9. Figure 9: Performance on DTD and RESISC45 under SSL and UL settings with different proportion of unlabeled data. We also present the result of CPL (Zhang et al., 2024b) under SSL setting. Impact of Data Scale. To investigate whether our approach can efficiently leverage limited …
Figure 10
Figure 10. Figure 10: shows examples of concept mismatch. It indicates that although the image features of these classes are relatively distinguishable, the samples represented as pink are completely misclassified. This illustrates that the text features of certain classes fail to capture …
Figure 11
Figure 11. Figure 11: shows examples of concept confusion. The interwoven distribution of image features between these classes suggests a high degree of similarity. In the zero-shot prediction, most of samples are predicted to be a certain class, leaving relatively scarce samples predicted…
Figure 12
Figure 12. Figure 12: Test accuracy after fine-tuning with CAP and without CAP on RESISC45 under UL setting. Note that we still reserve the fine-tuning framework of CAP in the control group. It is clear that CAP forms a significantly more balanced prediction. CAP(Ours) CPL GRIP 29min 1h 14…
Figure 13
Figure 13. Figure 13: Time consumed training on EuroSAT with CAP, CPL and GRIP. D.3. Number of Mismatch Classes Detected We present the number of concept-mismatched classes detected in [PITH_FULL_IMAGE:figures/full_fig_p014_13.png]
Figure 14
Figure 14. Figure 14: Visualization of the number of classes detected with concept mismatch over six datasets. D.4. More Evaluation of Confusion-Aware Calibrated Margin The purpose of confusion-aware calibrated margin is to encourge CLIP to generate more distinguishable logits, thus gradua…
Figure 15
Figure 15. Figure 15: Class-wise test accuracy on RESISC45 under UL setting as an evaluation of confusion-aware calibrated margin. We disable concept alignment here. left: Visualization of lowest-10 class-wise accuracies. right: Visualization of highest-10 class-wise accuracies. D.5. Ablat…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

19 extracted references · 8 canonical work pages

  1. [1]

    R., Sharma, L., and Babu, R

    Addepalli, S., Asokan, A. R., Sharma, L., and Babu, R. V . Leveraging vision-language models for improving do- main generalization in image classification. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2024, Seattle, WA, USA, June 16-22, 2024 , pp. 23922–23932. IEEE,

  2. [3]

    Detailed settings for experiments. Flowers102 RESISC45 DTD CUB EuroSAT FGVCAircraft Statistic data Class number 102 45 47 200 10 100 Training set size 2040 6300 3760 5594 27000 6667 Testing set size 6149 25200 1880 5794 5000 3333 Training Setting Prompt LayersL 8 Prompt per Layer 2 Image Augmentation random resized crop Confidence Thresholdτ 0.85 0.5 k in...

  3. [5]

    Gu, X., Lin, T., Kuo, W., and Cui, Y

    doi: 10.1007/S11263-023-01891-X. Gu, X., Lin, T., Kuo, W., and Cui, Y . Open-vocabulary object detection via vision and language knowledge dis- tillation. In Proc. of ICLR. OpenReview.net,

  4. [9]

    Fine-grained visual classification of aircraft

    Maji, S., Rahtu, E., Kannala, J., Blaschko, M., and Vedaldi, A. Fine-grained visual classification of aircraft. arXiv preprint arXiv:1306.5151,

  5. [10]

    Kim, J., Ku, Y ., Kim, J., Cha, J., and Baek, S

    1109/CVPR52729.2023.01832. Kim, J., Ku, Y ., Kim, J., Cha, J., and Baek, S. Vlm-pl: Advanced pseudo labeling approach for class incremen- tal object detection via vision-language model. 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 4170–4181,

  6. [12]

    doi: 10.1007/978-3-031-72643-9\

  7. [13]

    Florence: A new foundation model for computer vision

    Yuan, L., Chen, D., Chen, Y .-L., Codella, N., Dai, X., Gao, J., Hu, H., Huang, X., Li, B., Li, C., et al. Florence: A new foundation model for computer vision. ArXiv preprint, abs/2111.11432,

  8. [15]

    C., and Liu, Z

    Zhou, K., Yang, J., Loy, C. C., and Liu, Z. Learning to prompt for vision-language models. ArXiv preprint, abs/2109.01134,

Show all 19 references
  1. [16]

    C., and Liu, Z

    Zhou, K., Yang, J., Loy, C. C., and Liu, Z. Condi- tional prompt learning for vision-language models. In IEEE/CVF Conference on Computer Vision and Pat- tern Recognition, CVPR 2022, New Orleans, LA, USA, June 18-24, 2022, pp. 16795–16804. IEEE,

  2. [17]

    Handling Imbalanced Pseudolabels for VLMs with Concept Alignment and Confusion-Aware Calibrated Margin

    doi: 10.1109/CVPR52688.2022.01631. 10 Handling Imbalanced Pseudolabels for VLMs with Concept Alignment and Confusion-Aware Calibrated Margin Appendix for “Handling Imbalanced Pseudolabels for VLMs with Concept Alignment and Confusion-Aware Calibrated Margin” A. Examples of Mis...

  3. [19]

    Comparison Methods We briefly introduce the baselines in this section

    C.2. Comparison Methods We briefly introduce the baselines in this section. Few-pseudolabels (FPL) (Menghini et al., 2023): FPL is the same as UPL (Huang et al., 2022), which generates offline pseudolabels by selecting the top-k confident samples per class in zero-shot predict...

  4. [2011]

    Marvelovd: Marrying object recognition and vision-language models for robust open-vocabulary object detection

    Wang, K., Cheng, L., Chen, W., Zhang, P., Lin, L., Zhou, F., and Li, G. Marvelovd: Marrying object recognition and vision-language models for robust open-vocabulary object detection. In Leonardis, A., Ricci, E., Roth, S., Russakovsky, O., Sattler, T., and Varol, G. (eds.), Com...

  5. [2014]

    Gao, P., Geng, S., Zhang, R., Ma, T., Fang, R., Zhang, Y ., Li, H., and Qiao, Y

    doi: 10.1109/CVPR.2014.461. Gao, P., Geng, S., Zhang, R., Ma, T., Fang, R., Zhang, Y ., Li, H., and Qiao, Y . Clip-adapter: Better vision- language models with feature adapters. ArXiv preprint, abs/2110.04544,

  6. [2017]

    Describing textures in the wild

    Cimpoi, M., Maji, S., Kokkinos, I., Mohamed, S., and Vedaldi, A. Describing textures in the wild. In 2014 IEEE Conference on Computer Vision and Pattern Recog- nition, CVPR 2014, Columbus, OH, USA, June 23-28, 2014, pp. 3606–3613. IEEE Computer Society,

  7. [2018]

    The caltech-ucsd birds-200-2011 dataset

    Wah, C., Branson, S., Welinder, P., Perona, P., and Belongie, S. The caltech-ucsd birds-200-2011 dataset. Technical Report CNS-TR-2011-001, California Institute of Tech- nology,

  8. [2019]

    Unsupervised prompt learning for vision-language models

    Huang, T., Chu, J., and Wei, F. Unsupervised prompt learning for vision-language models. ArXiv preprint, abs/2204.03649,

  9. [2021]

    Zang, Y ., Li, W., Zhou, K., Huang, C., and Loy, C. C. Uni- fied vision and language prompt learning. ArXiv preprint, abs/2210.07225,

  10. [2022]

    U., Rasheed, H

    Khattak, M. U., Rasheed, H. A., Maaz, M., Khan, S. H., and Khan, F. S. Maple: Multi-modal prompt learning. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023, Vancouver, BC, Canada, June 17-24, 2023, pp. 19113–19122. IEEE,

  11. [2024]

    2024.02258

    doi: 10.1109/CVPR52733. 2024.02258. Alayrac, J., Donahue, J., Luc, P., Miech, A., Barr, I., Has- son, Y ., Lenc, K., Mensch, A., Millican, K., Reynolds, M., Ring, R., Rutherford, E., Cabi, S., Han, T., Gong, Z., Samangooei, S., Monteiro, M., Menick, J. L., Borgeaud, S., Brock,...

Pith tools

Reviewed August 16, 2026 · model on record in the stance chip above.