ENCLIP uses an ensemble of epoch-staggered CLIP fine-tunes plus K-means clustering to rank fashion search results, reporting gains over CLIP and FashionCLIP on a 44k-image dataset.
"Does it come in black?" CLIP-like models are zero-shot recommenders
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
Product discovery is a crucial component for online shopping. However, item-to-item recommendations today do not allow users to explore changes along selected dimensions: given a query item, can a model suggest something similar but in a different color? We consider item recommendations of the comparative nature (e.g. "something darker") and show how CLIP-based models can support this use case in a zero-shot manner. Leveraging a large model built for fashion, we introduce GradREC and its industry potential, and offer a first rounded assessment of its strength and weaknesses.
fields
cs.CV 1years
2024 1verdicts
REJECT 1representative citing papers
citing papers explorer
-
ENCLIP: Ensembling and Clustering-Based Contrastive Language-Image Pretraining for Fashion Multimodal Search with Limited Data and Low-Quality Images
ENCLIP uses an ensemble of epoch-staggered CLIP fine-tunes plus K-means clustering to rank fashion search results, reporting gains over CLIP and FashionCLIP on a 44k-image dataset.