Pith. sign in

REVIEW 4 major objections 4 minor 88 references

ReME: A Data-Centric Framework for Training-Free Open-Vocabulary Segmentation

T0 review · 4 major / 4 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Data quality, not model surgery, decides training-free open-vocabulary segmentation.

desk verdict Solid data-centric OVS paper: the intra-modal filtering result holds up, the ablations are honest, and the main soft spots (error bars, filter precision) are fixable rather than fatal. read the letter →

arxiv 2506.21233 v2 pith:B7EYZACT submitted 2025-06-26 cs.CV

Xiwei Xuan , Ziquan Deng , Kwan-Liu Ma This is my paper
classification cs.CV
keywords open-vocabularysemanticsegmentationtraining-freedata-centricreferencesetconstructionintra-modalfilteringCLIPDINOv2similarityretrieval
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper argues that training-free open-vocabulary segmentation (OVS) is bottlenecked by the quality of the reference data, not by the cleverness of the segmentation or retrieval machinery. To show this, the authors construct a reference set of segment-text pairs from real COCO-2017 images, using a vision-language model to pair segments with noun-phrase labels, then cleaning the pairs by filtering outliers within each label group using same-modality (visual) similarity, and finally enriching labels with synonyms found among text embeddings. With only a simple similarity retrieval, this cleaned set outperforms all 14 prior training-free OVS methods across ten benchmarks, and on VOC-20 it lifts mIoU from 70.03 for the raw base set to 92.34. If the paper is right, then the practical lever for improving training-free dense vision understanding is data curation, building well-aligned, semantically rich reference sets, rather than further post-hoc model adaptation.

What carries the argument

The load-bearing object is the reference set of segment-text pairs, refined by two intra-modal operations. Group-based filtering gathers segments whose labels share a root noun, computes a median visual feature for each group, and drops the configured fraction of segments farthest from that median; semantic enriching then adds synonym labels discovered by pairwise text-embedding similarity among root nouns, e.g., adding 'a small kitten' to a segment labeled 'a small cat'. Retrieval is a two-hop softmax: test segments vote for reference labels, reference labels vote for the given test classes, and the composed votes are summed over each test segment's mask to produce pixel-level predictions. The essential mechanism is collective consistency, since segments that share a label should look alike, mislabeled pairs become detectable outliers in the visual feature space.

What would settle it

Have humans check the segments that ReME's group-based filter drops on visually heterogeneous classes (e.g., 'furniture', 'vehicle', 'bird'): if many dropped pairs prove correctly labeled, the filter is removing good data, not misalignments. A quantitative version: replace the intra-modal filter with an oracle built from ground-truth segment-text labels; if the oracle does not reproduce most of the filtering gain (91.10 vs 70.03 on VOC-20), then the filtering mechanism claimed to carry the result is not the real driver.

Watch

Extended reading notes

Core claim

The paper's central claim is that for training-free open-vocabulary segmentation, the quality of the external reference set, not the sophistication of the retrieval or attention mechanism, determines performance. ReME builds that reference set from real COCO-2017 images alone: class-agnostic segments are paired with noun-phrase labels using CLIP, misaligned pairs are removed by comparing each segment's visual embedding with the median embedding of its root-noun group, and labels are diversified by adding synonym noun phrases discovered from text-embedding similarity. At test time, a simple softmax-weighted similarity retrieval assigns class probabilities to each segment and aggregates them through the class-agnostic masks. On VOC-20 the raw base set scores 70.03 mIoU, group-based filtering alone raises this to 91.10, and the full pipeline reaches 92.34, outperforming all 14 prior training-free OVS methods across ten benchmarks.

Load-bearing premise

The pipeline assumes that every correctly labeled segment for a given root noun looks alike to the visual encoder, so a wrong label appears as an outlier and filtering it never removes good examples.

Editorial extensions

If this is right

  • For a fixed frozen backbone, the remaining headroom in training-free OVS comes mainly from building better segment-text reference sets, not from more elaborate attention or retrieval designs.
  • The cleaned real-image reference set is reusable: replacing FreeDA's synthetic reference data with ReME data improves retrieval-based OVS, and training-based CAT-Seg trained on ReME data beats the version trained on COCO ground-truth segment-text data.
  • A lightweight superpixel segmenter becomes competitive (92.3 mIoU on VOC-20 with no post-processing), meaning expensive mask generators are not needed to benefit from the refined data.
  • A smaller, cleaned reference set (roughly 1.0 million pairs, 4 GB) outperforms a much larger synthetic one (2.2 million pairs, 17 GB), so higher data quality also lowers storage and inference cost.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same group-then-outlier filtering idea could be applied to other multimodal resources, such as image-text or video-caption datasets, to prune misaligned samples before training; the paper's mechanism is not specific to segmentation.
  • Because the largest gain comes from filtering, splitting polysemous root nouns (e.g., 'bat' as animal vs. equipment) or using per-group adaptive drop ratios, as the supplementary weighted variant already explores, should further improve robustness on heterogeneous categories.
  • If data quality is the binding constraint, scaling the real-image corpus beyond COCO-2017 or using even richer captioners should keep lifting performance, and the reference set could become a reusable asset for other OVS models.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 4 minor

Summary. The paper proposes ReME, a training-free open-vocabulary segmentation framework that constructs a reference set of segment-text pairs from real images (COCO-2017) using LLaVA-generated descriptions and CLIP-based pairing, then enhances data quality through two steps: group-based intra-modal filtering (dropping the lowest-similarity segments within each root-noun group) and synonym-based semantic enrichment. At inference, a simple similarity-based retrieval over this reference set assigns labels to class-agnostic test segments. The paper reports state-of-the-art results over 14 training-free OVS baselines on ten benchmarks, with ablations showing that group-based filtering contributes the largest performance gain (VOC-20 mIoU from 70.03 to 91.10), and additional experiments on data robustness, hyperparameters, backbone choices, description generators, and segmenters.

Significance. If the claims hold, this is a meaningful contribution: it demonstrates that data quality, rather than retrieval complexity or model adaptation, can be the main lever for training-free OVS, and it does so with broad empirical coverage (ten benchmarks, 14 baselines, component ablations, hyperparameters tuned on a held-out 1k-image subset, an explicit limitations paragraph, and released code). The same-modal retrieval design (visual-to-visual and text-to-text similarities) is elegant and avoids the known weakness of cross-modal CLIP scores. The main risks are that the largest pipeline component rests on an unquantified unimodality assumption, and that one data-cleaning step is described only in the supplement and excluded from the main ablation.

major comments (4)
  1. [Sec. 3.2, Tables 2 and 3] The group-based filtering step assumes that segments grouped by the same root noun form a visually unimodal cluster, so that misaligned pairs appear as outliers. This assumption is load-bearing because Table 2 attributes the largest single gain to this step (VOC-20: 70.03 to 91.10). The manuscript provides only qualitative UMAP evidence (Fig. 3, Fig. A4) and does not quantify how many root groups are multi-modal or whether the filter's precision/recall against known misalignments is high. Please add a per-group analysis (e.g., distribution of within-group similarities, detected modes) and evaluate the filter on a subset with known ground-truth alignment (e.g., COCO Stuff segments with GT class labels). Without this, the improvement could stem from removing hard but correctly-paired segments rather than from correcting misalignment, which would weaken the central data-quality claim.
  2. [Supplementary B.2 vs. Sec. 3.2, Table 2] The pipeline described in Sec. 3.2 omits the 'Filtering Ambiguous Labels' step, which is only presented in Supplementary B.2. This step removes label roots whose group sizes exceed an 'inflection point' (e.g., 'background', 'scene', 'atmosphere', 'image'), and it appears to be applied before or within the data-enhancing phase. If Table 2's 'Base set (no enhancement)' already includes this filtering, then the ablation does not isolate the contribution of group-based filtering as claimed. Moreover, the inflection point is an additional free parameter that is not part of the grid search reported in Sec. 4.3. Please state exactly which preprocessing steps are included in the base set, ablate the ambiguous-label filter separately, and report how the inflection threshold is selected.
  3. [Table 1, data robustness rows] For the rows 'ReME(Ours - VOC)' and 'ReME(Ours - ADE)', the manuscript does not specify which splits of VOC and ADE are used to construct the reference set. If the validation splits of these datasets (the same ones used for evaluation) are included, the robustness comparison would be affected by evaluation leakage. Please specify the exact image splits used and, if necessary, rerun with train-only images.
  4. [Sec. 4.1 and all result tables] Because LLaVA description generation is stochastic and the reference set construction involves sampling, the reported single-run numbers may vary. This matters for benchmarks where the margin over the second-best method is small (e.g., A-847: 8.4 vs 6.6; PC-459: 14.1 vs 12.0). Please report results over at least three independent runs (or show that decoding is deterministic with a fixed seed) and provide mean and standard deviation for the main comparison tables.
minor comments (4)
  1. [Table 8] The inference-time comparison says 'All experiments are conducted on two NVIDIA 4090 GPUs', but it is unclear whether the reported seconds/image use both GPUs and how the per-image average is computed; please clarify the measurement protocol.
  2. [Supplementary Tables A4-A9] The supplementary tables use the header 'A VG 10', which appears to be a typo for 'AVG10' (average across ten benchmarks); please define this metric in the main text or table captions.
  3. [Sec. 4.2] The sentence 'Across 10 benchmarks, ReME achieves the highest mIoU in 6 benchmarks with VOC and 7 with ADE' should specify that these wins are among SAM-free baselines, since the table also includes SAM-involved methods and the bolding convention applies only to the SAM-free comparison.
  4. [Eqs. (1)-(3)] The binary matrix O_ref represents segment-label associations, but after synonym enrichment a segment can have multiple labels; please clarify that O_ref entries remain binary and that each synonym-enriched phrase is treated as a separate label column.

Circularity Check

0 steps flagged · score 1.0 of 10

No significant circularity: all headline numbers are external benchmark measurements; the two hyperparameters are tuned on a disjoint held-out subset; the retrieval equations are fixed similarity aggregations; self-citations are contextual and not load-bearing.

full rationale

ReME's central claim is that a reference set built from real images and cleaned by group-based intra-modal filtering plus synonym enrichment improves training-free open-vocabulary segmentation. The headline numbers (Tables 1, 2, 3, and supplementary Tables A4/A5) are mIoU scores measured on external validation benchmarks such as VOC, Pascal Context, COCO, Cityscapes, and ADE20K; they are not quantities defined by the method's own equations. The retrieval phase (Eqs. 1-3) is a fixed similarity-based softmax aggregation with no learned or fitted parameters, so there is no fitted input being relabeled as a prediction. The two hyperparameters, delta_filter and k_sim, are selected by grid search on 1k randomly sampled images from the COCO Stuff training split, which the paper explicitly states has no overlap with evaluation data. The group-based filtering is an empirical preprocessing choice; its assumption that segments sharing a root noun are visually coherent is testable and could fail for polysemous or visually diverse labels, but such failure would reduce robustness rather than make the derivation circular. The paper contains several self-citations (e.g., [15] for collective VLM behavior, [78] for spuriousness, [80] for label refinement), but none is used as the load-bearing justification for the central data-quality claim, and no uniqueness theorem or ansatz is imported from the authors' prior work. No equation is defined in terms of the quantity it claims to predict, and no externally measured result is equivalent by construction to an input. Therefore the derivation chain is self-contained against external benchmarks, and no specific circular step can be exhibited.

Assumptions & free parameters 3 free parameters · 7 assumptions · 0 invented entities

The framework rests on five domain assumptions about pretrained embeddings (CLIP pairing correctness, DINOv2 intra-modal discriminability, root-noun visual consistency, LLaVA caption quality, superpixel meaningfulness) plus two tuned hyperparameters. These are stated in the paper and mostly ablated directly (Tables 3, 4, 5, 6). The ambiguous-label knee threshold in Supplementary B.2 is an unablated heuristic. No new physical or conceptual entities are introduced.

free parameters (3)
  • delta_filter (per-group drop ratio) = 30%
    Fraction of segments with lowest intra-modal similarity to the group median that are dropped as misaligned. Chosen by grid search on 1k images sampled from the COCO Stuff training split (Sec 4.3); it is the single most impactful component (Table 2).
  • k_sim (top-similar label pairs) = 30
    Number of top cosine-similar label pairs treated as synonyms in semantic enriching. Tuned on the same held-out 1k images (Sec 4.3).
  • ambiguous-label inflection threshold = knee of group-size distribution
    Hand-set threshold in Supplementary B.2 that filters labels with unusually many segments (for example, 'background', 'scene', 'atmosphere'); not an evaluated hyperparameter.
assumptions (7)
  • domain assumption CLIP embeddings provide a useful degree of segment-label correctness for initial pairing
    Sec 3.1: 'Despite the noises, CLIP still provides a certain degree of correctness for segment labeling.' The base set quality starts from this premise.
  • domain assumption Segments grouped by the same root noun are visually consistent, so outliers in intra-modal feature space are misalignments
    Sec 3.2 Group-Based Filtering: 'their visual features should be inherently consistent, and misaligned data would be automatically highlighted as outliers.' This is the load-bearing premise of the most impactful component.
  • domain assumption Intra-modal visual features are more discriminative than cross-modal CLIP scores for detecting pairing errors
    Sec 3.2 and Fig 3; the paper provides empirical support in Table 3, but the generality across label distributions is assumed.
  • domain assumption LLaVA-1.5 descriptions are rich and accurate enough to supply the label vocabulary
    Sec 3.1 uses LLaVA descriptions; Sec 4.3 ablation (Table 5) shows LLaVA beats BLIP-2 and GT captions, so performance inherits captioning-model quality and hallucination behavior.
  • domain assumption Felzenszwalb superpixel segments are meaningful class-agnostic proposals
    Used to define the retrieval units in both reference construction and inference, following FreeDA (Sec 3.1, Sec 3.3).
  • domain assumption Cosine similarity of text embeddings identifies synonyms across the label corpus
    Sec 3.2 Semantic Enriching assumes top-k text-similar pairs are synonyms (for example, 'cat'-'kitten'); near-synonyms and unrelated similar phrases could be confounded.
  • ad hoc to paper Labels whose group size exceeds the inflection point are abstract or ambiguous and must be removed
    Supplementary B.2: 'background', 'scene', 'image', 'atmosphere' are dropped based on the knee of the group-size curve. This threshold is hand-chosen and not ablated.

how reviews work

0 comments
Cite this review

Pith. "Pith review of ReME: A Data-Centric Framework for Training-Free Open-Vocabulary Segmentation." pith.science (2026). https://pith.science/paper/B7EYZACT

@misc{pith2026250621233,
  author       = {Pith},
  title        = {Pith review of: ReME: A Data-Centric Framework for Training-Free Open-Vocabulary Segmentation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/B7EYZACT}},
  note         = {Machine review of arXiv:2506.21233}
}
read the original abstract

Training-free open-vocabulary semantic segmentation (OVS) aims to segment images given a set of arbitrary textual categories without costly model fine-tuning. Existing solutions often explore attention mechanisms of pre-trained models, such as CLIP, or generate synthetic data and design complex retrieval processes to perform OVS. However, their performance is limited by the capability of reliant models or the suboptimal quality of reference sets. In this work, we investigate the largely overlooked data quality problem for this challenging dense scene understanding task, and identify that a high-quality reference set can significantly benefit training-free OVS. With this observation, we introduce a data-quality-oriented framework, comprising a data pipeline to construct a reference set with well-paired segment-text embeddings and a simple similarity-based retrieval to unveil the essential effect of data. Remarkably, extensive evaluations on ten benchmark datasets demonstrate that our method outperforms all existing training-free OVS approaches, highlighting the importance of data-centric design for advancing OVS without training. Our code is available at https://github.com/xiweix/ReME .

Figures

Figures reproduced from arXiv: 2506.21233 by the authors.

Figure 1
Figure 1. [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. The data pipeline of ReME to construct a high-quality reference set. The pipeline includes two phases: the initial pairing that produces pre-matched segment-text pairs using images as input; and the data enhancing that performs group-based filtering according to more discriminative intra-modal similarity among segment embeddings and semantic enriching with similar labels. data. For instance, CLIP is frequently used … view at source ↗
Figure 3
Figure 3. The superiority of intra-modality over cross￾modality for data issue detection. The plot provides the UMAP projection of segment embeddings in the base set labeled as “dog”, colored by cross-modal similarity scores (CLIP scores). Blue boxes highlight misalignments detected by our filtering; orange boxes are those detected by low CLIP scores, which remove cor￾rect pairings while leaving many misalignments unaddressed… view at source ↗
Figures from the paper (4 more)
Figure 4
Figure 4. Figure 4: The process of similarity-based retrieval from the refer [PITH_FULL_IMAGE:figures/full_fig_p005_4.png]
Figure 5
Figure 5. Figure 5: Qualitative results of ReME in comparison with other training-free OVS methods. Examples are from ADE20K [86] (w/ 150 classes) and COCO Stuff [8] (w/ 171 classes), respectively. SCLIP is based on CLIP attention; ProxyCLIP enhances CLIP attention with DINO features; Fre…
Figure 6
Figure 6. Figure 6: Hyperparameter analysis. δf ilter is the drop ratio in group-based filtering; ksim is the number of top-similar pairs in semantic enriching. Components mIoU VOC-20 PC-59 Object A-150 Base set (no enhancement) 70.03 35.42 39.38 22.03 w/ (i) Group-based filtering 91.10 4…
Figure 7
Figure 7. Figure 7: Image descriptions from different resources. [PITH_FULL_IMAGE:figures/full_fig_p007_7.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

88 extracted references · 58 canonical work pages

  1. [1]

    Gpt-4 technical report

    Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ah- mad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. Gpt-4 technical report. arXiv preprint arXiv:2303.08774 ,

    arXiv

  2. [2]

    Flamingo: a visual language model for few-shot learning

    Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Men- sch, Katherine Millican, Malcolm Reynolds, et al. Flamingo: a visual language model for few-shot learning. Advances in neural information processing systems, 35:23716–23736,

  3. [3]

    Openflamingo: An open- source framework for training large autoregressive vision- language models

    Anas Awadalla, Irena Gao, Josh Gardner, Jack Hessel, Yusuf Hanafy, Wanrong Zhu, Kalyani Marathe, Yonatan Bitton, Samir Gadre, Shiori Sagawa, et al. Openflamingo: An open- source framework for training large autoregressive vision- language models. arXiv preprint arXiv:2308.01390 , 2023. 3

    arXiv 2023

  4. [4]

    Qwen2.5-vl technical report

    Shuai Bai, Keqin Chen, Xuejing Liu, Jialin Wang, Wenbin Ge, Sibo Song, Kai Dang, Peng Wang, Shijie Wang, Jun Tang, et al. Qwen2.5-vl technical report. arXiv preprint arXiv:2502.13923, 2025. 3

    arXiv 2025

  5. [5]

    Fossil: Free open-vocabulary semantic seg- mentation through synthetic references retrieval

    Luca Barsellotti, Roberto Amoroso, Lorenzo Baraldi, and Rita Cucchiara. Fossil: Free open-vocabulary semantic seg- mentation through synthetic references retrieval. InProceed- ings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 1464–1473, 2024. 2

    2024

  6. [6]

    Training-free open- vocabulary segmentation with offline diffusion-augmented prototype generation

    Luca Barsellotti, Roberto Amoroso, Marcella Cornia, Lorenzo Baraldi, and Rita Cucchiara. Training-free open- vocabulary segmentation with offline diffusion-augmented prototype generation. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 3689–3698, 2024. 1, 2, 5, 6, 8, 3, 4, 7

    2024

  7. [7]

    Grounding everything: Emerging localiza- tion properties in vision-language transformers

    Walid Bousselham, Felix Petersen, Vittorio Ferrari, and Hilde Kuehne. Grounding everything: Emerging localiza- tion properties in vision-language transformers. In Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3828–3837, 2024. 2, 5, 6, 7, 8

    2024

  8. [8]

    Coco- stuff: Thing and stuff classes in context

    Holger Caesar, Jasper Uijlings, and Vittorio Ferrari. Coco- stuff: Thing and stuff classes in context. In Proceedings of the IEEE conference on computer vision and pattern recog- nition, pages 1209–1218, 2018. 1, 2, 5, 6, 7, 8, 4, 12

    2018

Show all 88 references
  1. [9]

    Less is more: Removing text-regions improves clip training efficiency and robustness

    Liangliang Cao, Bowen Zhang, Chen Chen, Yinfei Yang, Xi- anzhi Du, Wencong Zhang, Zhiyun Lu, and Yantao Zheng. Less is more: Removing text-regions improves clip training efficiency and robustness. arXiv preprint arXiv:2305.05095,

    arXiv

  2. [10]

    Emerg- ing properties in self-supervised vision transformers

    Mathilde Caron, Hugo Touvron, Ishan Misra, Herv ´e J´egou, Julien Mairal, Piotr Bojanowski, and Armand Joulin. Emerg- ing properties in self-supervised vision transformers. In Pro- ceedings of the IEEE/CVF international conference on com- puter vision, pages 9650–9660, 2021. 3

    2021

  3. [11]

    Learn- ing to generate text-grounded mask for open-world semantic segmentation from only image-text pairs

    Junbum Cha, Jonghwan Mun, and Byungseok Roh. Learn- ing to generate text-grounded mask for open-world semantic segmentation from only image-text pairs. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11165–11174, 2023. 1, 2, 4, 8

    2023

  4. [12]

    Exploring open-vocabulary semantic segmentation from clip vision encoder distillation only

    Jun Chen, Deyao Zhu, Guocheng Qian, Bernard Ghanem, Zhicheng Yan, Chenchen Zhu, Fanyi Xiao, Sean Chang Cu- latana, and Mohamed Elhoseiny. Exploring open-vocabulary semantic segmentation from clip vision encoder distillation only. In Proceedings of the IEEE/CVF International Co...

    2023

  5. [13]

    Cat- seg: Cost aggregation for open-vocabulary semantic seg- mentation

    Seokju Cho, Heeseong Shin, Sunghwan Hong, Anurag Arnab, Paul Hongsuck Seo, and Seungryong Kim. Cat- seg: Cost aggregation for open-vocabulary semantic seg- mentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 4113– 4123, 2024....

    2024

  6. [14]

    The cityscapes dataset for semantic urban scene understanding

    Marius Cordts, Mohamed Omran, Sebastian Ramos, Timo Rehfeld, Markus Enzweiler, Rodrigo Benenson, Uwe Franke, Stefan Roth, and Bernt Schiele. The cityscapes dataset for semantic urban scene understanding. In Proceed- ings of the IEEE conference on computer vision and pattern re...

    2016

  7. [15]

    A reliable framework for human-in-the-loop anomaly detection in time series

    Ziquan Deng, Xiwei Xuan, Kwan-Liu Ma, and Zhaodan Kong. A reliable framework for human-in-the-loop anomaly detection in time series. arXiv preprint arXiv:2405.03234 ,

    arXiv

  8. [16]

    De- coupling zero-shot semantic segmentation

    Jian Ding, Nan Xue, Gui-Song Xia, and Dengxin Dai. De- coupling zero-shot semantic segmentation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 11583–11592, 2022. 1, 4, 8

    2022

  9. [17]

    The pascal visual object classes (voc) challenge

    Mark Everingham, Luc Van Gool, Christopher KI Williams, John Winn, and Andrew Zisserman. The pascal visual object classes (voc) challenge. International journal of computer vision, 88:303–338, 2010. 5

    2010

  10. [18]

    Scaling laws of synthetic images for model training

    Lijie Fan, Kaifeng Chen, Dilip Krishnan, Dina Katabi, Phillip Isola, and Yonglong Tian. Scaling laws of synthetic images for model training... for now. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 7382–7392, 2024. 2

    2024

  11. [19]

    Data filtering networks

    Alex Fang, Albin Madappally Jose, Amit Jain, Ludwig Schmidt, Alexander T Toshev, and Vaishaal Shankar. Data filtering networks. In The Twelfth International Conference on Learning Representations, 2024. 2

    2024

  12. [20]

    Efficient graph-based image segmentation

    Pedro F Felzenszwalb and Daniel P Huttenlocher. Efficient graph-based image segmentation. International journal of computer vision, 59:167–181, 2004. 1, 2, 6, 8, 9

    2004

  13. [21]

    Dat- acomp: In search of the next generation of multimodal datasets

    Samir Yitzhak Gadre, Gabriel Ilharco, Alex Fang, Jonathan Hayase, Georgios Smyrnis, Thao Nguyen, Ryan Marten, Mitchell Wortsman, Dhruba Ghosh, Jieyu Zhang, et al. Dat- acomp: In search of the next generation of multimodal datasets. Advances in Neural Information Processing Sys...

    2024

  14. [22]

    Scal- ing open-vocabulary image segmentation with image-level labels

    Golnaz Ghiasi, Xiuye Gu, Yin Cui, and Tsung-Yi Lin. Scal- ing open-vocabulary image segmentation with image-level labels. In European Conference on Computer Vision, pages 540–557. Springer, 2022. 1, 4, 8

    2022

  15. [23]

    kNN-CLIP: Retrieval enables training-free segmentation on continually expanding large vocabularies

    Zhongrui Gui, Shuyang Sun, Runjia Li, Jianhao Yuan, Zhao- chong An, Karsten Roth, Ameya Prabhu, and Philip Torr. kNN-CLIP: Retrieval enables training-free segmentation on continually expanding large vocabularies. Transactions on Machine Learning Research, 2024. 2, 3

    2024

  16. [24]

    Robustifying token attention for vision transformers

    Yong Guo, David Stutz, and Bernt Schiele. Robustifying token attention for vision transformers. In Proceedings of the IEEE/CVF International Conference on Computer Vi- sion, pages 17557–17568, 2023. 1

    2023

  17. [25]

    Pay attention to your neighbours: Training-free open-vocabulary semantic segmentation

    Sina Hajimiri, Ismail Ben Ayed, and Jose Dolz. Pay attention to your neighbours: Training-free open-vocabulary semantic segmentation. arXiv preprint arXiv:2404.08181, 2024. 5, 6, 7, 8

    2024 arXiv

  18. [26]

    Scaling up visual and vision-language representa- tion learning with noisy text supervision

    Chao Jia, Yinfei Yang, Ye Xia, Yi-Ting Chen, Zarana Parekh, Hieu Pham, Quoc Le, Yun-Hsuan Sung, Zhen Li, and Tom Duerig. Scaling up visual and vision-language representa- tion learning with noisy text supervision. In International conference on machine learning, pages 4904–4916. PMLR,

  19. [27]

    Diffusion models for open-vocabulary segmen- tation

    Laurynas Karazija, Iro Laina, Andrea Vedaldi, and Christian Rupprecht. Diffusion models for open-vocabulary segmen- tation. In European Conference on Computer Vision, pages 299–317. Springer, 2025. 2, 3, 5, 6, 7, 8

    2025

  20. [28]

    Segment any- thing

    Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer White- head, Alexander C Berg, Wan-Yen Lo, et al. Segment any- thing. In Proceedings of the IEEE/CVF International Con- ference on Computer Vision, pages 4015–4026, 2023. 8, 6

    2023

  21. [29]

    Efficient inference in fully connected crfs with gaussian edge potentials

    Philipp Kr ¨ahenb¨uhl and Vladlen Koltun. Efficient inference in fully connected crfs with gaussian edge potentials. Ad- vances in neural information processing systems , 24, 2011. 5

    2011

  22. [30]

    LISA: Reasoning segmentation via large language model

    Xin Lai, Zhuotao Tian, Yukang Chen, Yanwei Li, Yuhui Yuan, Shu Liu, and Jiaya Jia. LISA: Reasoning segmentation via large language model. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 9579–9589, 2024. 3

    2024

  23. [31]

    Veclip: Improving clip training via visual-enriched captions

    Zhengfeng Lai, Haotian Zhang, Bowen Zhang, Wentao Wu, Haoping Bai, Aleksei Timofeev, Xianzhi Du, Zhe Gan, Jiu- long Shan, Chen-Nee Chuah, et al. Veclip: Improving clip training via visual-enriched captions. In European Confer- ence on Computer Vision , pages 111–127. Springer, 2025. 2

    2025

  24. [32]

    Proxyclip: Proxy at- tention improves clip for open-vocabulary segmentation

    Mengcheng Lan, Chaofeng Chen, Yiping Ke, Xinjiang Wang, Litong Feng, and Wayne Zhang. Proxyclip: Proxy at- tention improves clip for open-vocabulary segmentation. In ECCV, 2024. 1, 2, 3, 5, 6, 8, 7

    2024

  25. [33]

    Tagclip: Improving discrimination ability of open-vocabulary semantic segmentation

    Jingyao Li, Pengguang Chen, Shengju Qian, and Ji- aya Jia. Tagclip: Improving discrimination ability of open-vocabulary semantic segmentation. arXiv preprint arXiv:2304.07547, 2023. 1

    2023 arXiv

  26. [34]

    Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models

    Junnan Li, Dongxu Li, Silvio Savarese, and Steven Hoi. Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models. In In- ternational conference on machine learning , pages 19730– 19742. PMLR, 2023. 3, 8, 6

    2023

  27. [35]

    Clip surgery for better explainability with enhancement in open- vocabulary tasks

    Yi Li, Hualiang Wang, Yiqun Duan, and Xiaomeng Li. Clip surgery for better explainability with enhancement in open- vocabulary tasks. arXiv preprint arXiv:2304.05653 , 2023. 1

    2023 arXiv

  28. [36]

    Open-vocabulary semantic segmentation with mask-adapted clip

    Feng Liang, Bichen Wu, Xiaoliang Dai, Kunpeng Li, Yinan Zhao, Hang Zhang, Peizhao Zhang, Peter Vajda, and Diana Marculescu. Open-vocabulary semantic segmentation with mask-adapted clip. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pag...

    2023

  29. [37]

    Microsoft coco: Common objects in context

    Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Doll´ar, and C Lawrence Zitnick. Microsoft coco: Common objects in context. In Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceeding...

    2014

  30. [38]

    Visual instruction tuning

    Haotian Liu, Chunyuan Li, Qingyang Wu, and Yong Jae Lee. Visual instruction tuning. In NeurIPS, 2023. 3, 5, 8, 6

    2023

  31. [39]

    Segclip: Patch aggregation with learnable centers for open-vocabulary semantic segmentation

    Huaishao Luo, Junwei Bao, Youzheng Wu, Xiaodong He, and Tianrui Li. Segclip: Patch aggregation with learnable centers for open-vocabulary semantic segmentation. In In- ternational Conference on Machine Learning, pages 23033– 23044. PMLR, 2023. 1, 4, 8

    2023

  32. [40]

    Emergent open-vocabulary semantic segmenta- tion from off-the-shelf vision-language models

    Jiayun Luo, Siddhesh Khandelwal, Leonid Sigal, and Boyang Li. Emergent open-vocabulary semantic segmenta- tion from off-the-shelf vision-language models. In Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4029–4040, 2024. 2, 3, 5, 6, 7, 8

    2024

  33. [41]

    Sieve: Multimodal dataset pruning using image captioning models

    Anas Mahmoud, Mostafa Elhoushi, Amro Abbas, Yu Yang, Newsha Ardalani, Hugh Leather, and Ari S Morcos. Sieve: Multimodal dataset pruning using image captioning models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 22423–22432, 2024. 2

    2024

  34. [42]

    Towards interactive 3d surgical scene reconstruction: An incremental training and monitoring framework

    Divyanshu Malik, Xiwei Xuan, and Kwan-Liu Ma. Towards interactive 3d surgical scene reconstruction: An incremental training and monitoring framework. In 2025 IEEE 22nd In- ternational Symposium on Biomedical Imaging (ISBI), pages 1–4. IEEE, 2025. 5

    2025

  35. [43]

    The role of context for object detection and semantic segmentation in the wild

    Roozbeh Mottaghi, Xianjie Chen, Xiaobai Liu, Nam-Gyu Cho, Seong-Whan Lee, Sanja Fidler, Raquel Urtasun, and Alan Yuille. The role of context for object detection and semantic segmentation in the wild. In Proceedings of the IEEE conference on computer vision and pattern recogni...

    2014

  36. [44]

    Open vocabulary semantic segmentation with patch aligned con- trastive learning

    Jishnu Mukhoti, Tsung-Yu Lin, Omid Poursaeed, Rui Wang, Ashish Shah, Philip HS Torr, and Ser-Nam Lim. Open vocabulary semantic segmentation with patch aligned con- trastive learning. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages ...

    2023

  37. [45]

    Dataset diffusion: Diffusion-based synthetic data generation for pixel-level semantic segmentation

    Quang Nguyen, Truong Vu, Anh Tran, and Khoi Nguyen. Dataset diffusion: Diffusion-based synthetic data generation for pixel-level semantic segmentation. Advances in Neural Information Processing Systems, 36, 2024. 2

    2024

  38. [46]

    Improving multimodal datasets with image captioning

    Thao Nguyen, Samir Yitzhak Gadre, Gabriel Ilharco, Se- woong Oh, and Ludwig Schmidt. Improving multimodal datasets with image captioning. Advances in Neural Infor- mation Processing Systems, 36, 2024. 2, 3

    2024

  39. [47]

    Maxime Oquab, Timoth ´ee Darcet, Th´eo Moutakanni, Huy V . V o, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel HAZIZA, Francisco Massa, Alaaeldin El-Nouby, Mido Assran, Nicolas Ballas, Wojciech Galuba, Russell Howes, Po-Yao Huang, Shang-Wen Li, Ishan Misra, Michael ...

    2024

  40. [48]

    Kosmos-2: Ground- ing multimodal large language models to the world

    Zhiliang Peng, Wenhui Wang, Li Dong, Yaru Hao, Shaohan Huang, Shuming Ma, and Furu Wei. Kosmos-2: Ground- ing multimodal large language models to the world. arXiv preprint arXiv:2306.14824, 2023. 2, 3

    2023 arXiv

  41. [49]

    and et al

    Yu Q. and et al. Convolutions die hard: Ovs with single frozen convolutional clip. In NeurIPS, 2023. 1

    2023

  42. [50]

    Filtering, distil- lation, and hard negatives for vision-language pre-training

    Filip Radenovic, Abhimanyu Dubey, Abhishek Kadian, Todor Mihaylov, Simon Vandenhende, Yash Patel, Yi Wen, Vignesh Ramanathan, and Dhruv Mahajan. Filtering, distil- lation, and hard negatives for vision-language pre-training. In Proceedings of the IEEE/CVF conference on compute...

    2023

  43. [51]

    Learning transferable visual models from natural language supervi- sion

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervi- sion. In International conference on machine learning, ...

    2021

  44. [52]

    Sam 2: Segment anything in images and videos

    Nikhila Ravi, Valentin Gabeur, Yuan-Ting Hu, Ronghang Hu, Chaitanya Ryali, Tengyu Ma, Haitham Khedr, Roman R¨adle, Chloe Rolland, Laura Gustafson, Eric Mintun, Junt- ing Pan, Kalyan Vasudev Alwala, Nicolas Carion, Chao- Yuan Wu, Ross Girshick, Piotr Doll´ar, and Christoph Feic...

    2024 arXiv

  45. [53]

    Zero- guidance segmentation using zero segment labels

    Pitchaporn Rewatbowornwong, Nattanat Chatthee, Ekapol Chuangsuwanich, and Supasorn Suwajanakorn. Zero- guidance segmentation using zero segment labels. In Pro- ceedings of the IEEE/CVF International Conference on Computer Vision, pages 1162–1172, 2023. 2

    2023

  46. [54]

    High-resolution image synthesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj ¨orn Ommer. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10684–10695, 2022. 2

    2022

  47. [55]

    Laion-400m: Open dataset of clip-filtered 400 million image-text pairs

    Christoph Schuhmann, Richard Vencu, Romain Beaumont, Robert Kaczmarczyk, Clayton Mullis, Aarush Katta, Theo Coombes, Jenia Jitsev, and Aran Komatsuzaki. Laion-400m: Open dataset of clip-filtered 400 million image-text pairs. arXiv preprint arXiv:2111.02114, 2021. 2, 3, 4

    2021 arXiv

  48. [56]

    LAION-5b: An open large-scale dataset for train- ing next generation image-text models

    Christoph Schuhmann, Romain Beaumont, Richard Vencu, Cade W Gordon, Ross Wightman, Mehdi Cherti, Theo Coombes, Aarush Katta, Clayton Mullis, Mitchell Worts- man, Patrick Schramowski, Srivatsa R Kundurthy, Katherine Crowson, Ludwig Schmidt, Robert Kaczmarczyk, and Jenia Jitsev....

    2022

  49. [57]

    Ex- plore the potential of clip for training-free open vocabulary semantic segmentation

    Tong Shao, Zhuotao Tian, Hang Zhao, and Jingyong Su. Ex- plore the potential of clip for training-free open vocabulary semantic segmentation. arXiv preprint arXiv:2407.08268 ,

    arXiv

  50. [58]

    Reco: Re- trieve and co-segment for zero-shot transfer

    Gyungin Shin, Weidi Xie, and Samuel Albanie. Reco: Re- trieve and co-segment for zero-shot transfer. Advances in Neural Information Processing Systems , 35:33754–33767,

  51. [59]

    Is synthetic data all we need? benchmarking the robustness of models trained with synthetic images

    Krishnakant Singh, Thanush Navaratnam, Jannik Holmer, Simone Schaub-Meyer, and Stefan Roth. Is synthetic data all we need? benchmarking the robustness of models trained with synthetic images. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition ...

    2024

  52. [60]

    Clip as rnn: Segment countless visual concepts without training endeavor

    Shuyang Sun, Runjia Li, Philip Torr, Xiuye Gu, and Siyang Li. Clip as rnn: Segment countless visual concepts without training endeavor. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 13171–13182, 2024. 1, 2, 3, 5, 6, 8, 7

    2024

  53. [61]

    Attention is all you need

    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszko- reit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. Advances in neural information processing systems, 30, 2017. 2

    2017

  54. [62]

    Sclip: Rethink- ing self-attention for dense vision-language inference

    Feng Wang, Jieru Mei, and Alan Yuille. Sclip: Rethink- ing self-attention for dense vision-language inference. In European Conference on Computer Vision, pages 315–332. Springer, 2024. 1, 2, 5, 6, 8, 7

    2024

  55. [63]

    Sam-clip: Merging vision foundation models to- wards semantic and spatial understanding

    Haoxiang Wang, Pavan Kumar Anasosalu Vasu, Fartash Faghri, Raviteja Vemulapalli, Mehrdad Farajtabar, Sachin Mehta, Mohammad Rastegari, Oncel Tuzel, and Hadi Pouransari. Sam-clip: Merging vision foundation models to- wards semantic and spatial understanding. In Proceedings of t...

    2024

  56. [64]

    Diffusion model is secretly a training-free open vocabulary semantic segmenter

    Jinglong Wang, Xiawei Li, Jing Zhang, Qingyuan Xu, Qin Zhou, Qian Yu, Lu Sheng, and Dong Xu. Diffusion model is secretly a training-free open vocabulary semantic segmenter. arXiv preprint arXiv:2309.02773, 2023. 1, 2, 5, 6, 7, 8

    2023 arXiv

  57. [65]

    Use: Universal segment embeddings for open-vocabulary image segmentation

    Xiaoqi Wang, Wenbin He, Xiwei Xuan, Clint Sebastian, Jorge Piazentin Ono, Xin Li, Sima Behpour, Thang Doan, Liang Gou, Han-Wei Shen, et al. Use: Universal segment embeddings for open-vocabulary image segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vi- sion ...

    2024

  58. [66]

    Image-to-image matching via foundation models: A new perspective for open-vocabulary semantic segmentation

    Yuan Wang, Rui Sun, Naisong Luo, Yuwen Pan, and Tianzhu Zhang. Image-to-image matching via foundation models: A new perspective for open-vocabulary semantic segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3952–3963, 202...

    2024

  59. [67]

    Probabilistic pixel-adaptive refinement networks

    Anne S Wannenwetsch and Stefan Roth. Probabilistic pixel-adaptive refinement networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11642–11651, 2020. 8

    2020

  60. [68]

    Image-text co- decomposition for text-supervised semantic segmentation

    Ji-Jia Wu, Andy Chia-Hao Chang, Chieh-Yu Chuang, Chun-Pei Chen, Yu-Lun Liu, Min-Hung Chen, Hou-Ning Hu, Yung-Yu Chuang, and Yen-Yu Lin. Image-text co- decomposition for text-supervised semantic segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pa...

    2024

  61. [69]

    Clip-diy: Clip dense infer- ence yields open-vocabulary semantic segmentation for-free

    Monika Wysocza ´nska, Micha ¨el Ramamonjisoa, Tomasz Trzci´nski, and Oriane Sim ´eoni. Clip-diy: Clip dense infer- ence yields open-vocabulary semantic segmentation for-free. In Proceedings of the IEEE/CVF Winter Conference on Ap- plications of Computer Vision, pages 1403–1413...

    2024

  62. [70]

    Florence-2: Advancing a unified representation for a variety of vision tasks

    Bin Xiao, Haiping Wu, Weijian Xu, Xiyang Dai, Houdong Hu, Yumao Lu, Michael Zeng, Ce Liu, and Lu Yuan. Florence-2: Advancing a unified representation for a variety of vision tasks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 481...

    2024

  63. [71]

    Rewrite caption semantics: Bridging seman- tic gaps for language-supervised semantic segmentation.Ad- vances in Neural Information Processing Systems, 36, 2024

    Yun Xing, Jian Kang, Aoran Xiao, Jiahao Nie, Ling Shao, and Shijian Lu. Rewrite caption semantics: Bridging seman- tic gaps for language-supervised semantic segmentation.Ad- vances in Neural Information Processing Systems, 36, 2024. 1, 4, 8

    2024

  64. [72]

    Groupvit: Semantic segmentation emerges from text supervision

    Jiarui Xu, Shalini De Mello, Sifei Liu, Wonmin Byeon, Thomas Breuel, Jan Kautz, and Xiaolong Wang. Groupvit: Semantic segmentation emerges from text supervision. In Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition, pages 18134–18144, 2022. 4, 8

    2022

  65. [73]

    Learning open-vocabulary semantic segmentation models from natural language supervision

    Jilan Xu, Junlin Hou, Yuejie Zhang, Rui Feng, Yi Wang, Yu Qiao, and Weidi Xie. Learning open-vocabulary semantic segmentation models from natural language supervision. In Proceedings of the IEEE/CVF conference on computer vi- sion and pattern recognition, pages 2935–2944, 2023...

    2023

  66. [74]

    A simple baseline for open- vocabulary semantic segmentation with pre-trained vision- language model

    Mengde Xu, Zheng Zhang, Fangyun Wei, Yutong Lin, Yue Cao, Han Hu, and Xiang Bai. A simple baseline for open- vocabulary semantic segmentation with pre-trained vision- language model. In European Conference on Computer Vi- sion, pages 736–753. Springer, 2022. 4, 8

    2022

  67. [75]

    Side adapter network for open-vocabulary semantic segmentation

    Mengde Xu, Zheng Zhang, Fangyun Wei, Han Hu, and Xi- ang Bai. Side adapter network for open-vocabulary semantic segmentation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 2945– 2954, 2023. 1, 4, 8

    2023

  68. [76]

    V AC-CNN: A visual analytics system for compar- ative studies of deep convolutional neural networks

    Xiwei Xuan, Xiaoyu Zhang, Oh-Hyun Kwon, and Kwan- Liu Ma. V AC-CNN: A visual analytics system for compar- ative studies of deep convolutional neural networks. IEEE Transactions on Visualization and Computer Graphics , 28 (6):2326–2337, 2022. 2

    2022

  69. [77]

    Suny: A visual interpretation framework for convolutional neural networks from a necessary and suf- ficient perspective

    Xiwei Xuan, Ziquan Deng, Hsuan-Tien Lin, Zhaodan Kong, and Kwan-Liu Ma. Suny: A visual interpretation framework for convolutional neural networks from a necessary and suf- ficient perspective. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recogniti...

    2024

  70. [78]

    SLIM: Spuriousness mitigation with minimal human annotations

    Xiwei Xuan, Ziquan Deng, Hsuan-Tien Lin, and Kwan-Liu Ma. SLIM: Spuriousness mitigation with minimal human annotations. In European Conference on Computer Vision , pages 215–231. Springer, 2024. 2

    2024

  71. [79]

    AttributionScanner: A visual analytics system for model validation with metadata-free slice finding

    Xiwei Xuan, Jorge Piazentin Ono, Liang Gou, Kwan-Liu Ma, and Liu Ren. AttributionScanner: A visual analytics system for model validation with metadata-free slice finding. IEEE Transactions on Visualization and Computer Graphics, pages 1–12, 2025. 2

    2025

  72. [80]

    VISTA: A visual analytics framework to enhance foundation model-generated data labels

    Xiwei Xuan, Xiaoqi Wang, Wenbin He, Jorge Piazentin Ono, Liang Gou, Kwan-Liu Ma, and Liu Ren. VISTA: A visual analytics framework to enhance foundation model-generated data labels. IEEE Transactions on Visualization and Com- puter Graphics, 2025. 2

    2025

  73. [81]

    Vislix: An xai framework for val- idating vision models with slice discovery and analysis

    Xinyuan Yan, Xiwei Xuan, Jorge Piazentin Ono, Jiajing Guo, Vikram Mohanty, Shekar Arvind Kumar, Liang Gou, Bei Wang, and Liu Ren. Vislix: An xai framework for val- idating vision models with slice discovery and analysis. In Computer Graphics Forum, page e70125. Wiley Online Li...

    2025

  74. [82]

    A simple framework for text- supervised semantic segmentation

    Muyang Yi, Quan Cui, Hao Wu, Cheng Yang, Osamu Yoshie, and Hongtao Lu. A simple framework for text- supervised semantic segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 7071–7080, 2023. 1, 4, 8

    2023

  75. [83]

    Corrclip: Recon- structing correlations in clip with off-the-shelf foundation models for open-vocabulary semantic segmentation

    Dengke Zhang, Fagui Liu, and Quan Tang. Corrclip: Recon- structing correlations in clip with off-the-shelf foundation models for open-vocabulary semantic segmentation. arXiv preprint arXiv:2411.10086, 2024. 3, 5, 6, 8

    2024 arXiv

  76. [84]

    Tip- adapter: Training-free adaption of clip for few-shot classi- fication

    Renrui Zhang, Wei Zhang, Rongyao Fang, Peng Gao, Kun- chang Li, Jifeng Dai, Yu Qiao, and Hongsheng Li. Tip- adapter: Training-free adaption of clip for few-shot classi- fication. In European conference on computer vision, pages 493–510. Springer, 2022. 4

  77. [85]

    Labelvizier: Interactive validation and relabeling for technical text annotations

    Xiaoyu Zhang, Xiwei Xuan, Alden Dima, Thurston Sexton, and Kwan-Liu Ma. Labelvizier: Interactive validation and relabeling for technical text annotations. In 2023 IEEE 16th Pacific Visualization Symposium (PacificVis) , pages 167–

    2023

  78. [86]

    Semantic under- standing of scenes through the ade20k dataset

    Bolei Zhou, Hang Zhao, Xavier Puig, Tete Xiao, Sanja Fi- dler, Adela Barriuso, and Antonio Torralba. Semantic under- standing of scenes through the ade20k dataset. International Journal of Computer Vision, 127:302–321, 2019. 1, 5, 6, 4, 10

    2019

  79. [87]

    Extract free dense labels from clip

    Chong Zhou, Chen Change Loy, and Bo Dai. Extract free dense labels from clip. In European Conference on Com- puter Vision, pages 696–712. Springer, 2022. 1, 2, 3, 5, 6, 7, 8

    2022

  80. [88]

    The room has a cozy atmosphere

    Deyao Zhu, Jun Chen, Kilichbek Haydarov, Xiaoqian Shen, Wenxuan Zhang, and Mohamed Elhoseiny. Chatgpt asks, blip-2 answers: Automatic questioning towards enriched vi- sual descriptions. arXiv preprint arXiv:2303.06594, 2023. 2, 3 ReME: A Data-Centric Framework for Training-Fre...

    2023 arXiv

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.