RECORD
Deep Feature Factorization For Concept Discovery
Machine Learning · Submitted 26 Jun 2018
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim DFF can also be used to perform co-segmentation and co-localization, and we report state-of-the-art results on these tasks.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
We propose Deep Feature Factorization (DFF), a method capable of localizing similar semantic concepts within an image or a set of images. We use DFF to gain insight into a deep convolutional neural network's learned features, where we detect hierarchical cluster structures in feature space. This is visualized as heat maps, which highlight semantically matching regions across a set of images, revealing what the network `perceives' as similar. DFF can also be used to perform co-segmentation and co-localization, and we report state-of-the-art results on these tasks.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | We propose Deep Feature Factorization (DFF), a method capable of localizing similar semantic concepts within an image or a set of images. | contribution 0.96 | 0.87 | 0.25 | asserted 0.96 |
| s1 | We use DFF to gain insight into a deep convolutional neural network's learned features, where we detect hierarchical cluster structures in feature space. | contribution 0.57 | 0.93 | 0.13 | asserted 1.00 |
| s2 | This is visualized as heat maps, which highlight semantically matching regions across a set of images, revealing what the network `perceives' as similar. | interpretation 0.45 | 0.85 | 0.13 | asserted 1.00 |
| s3 | DFF can also be used to perform co-segmentation and co-localization, and we report state-of-the-art results on these tasks. | result 0.84 | 0.95 | 0.26 | asserted 0.95 |
What was examined, and what was not
- arXiv listing abstract v5
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
We propose Deep Feature Factorization (DFF), a method capable of localizing similar semantic concepts within an image or a set of images. We use DFF to gain insight into a deep convolutional neural network's learned features, where we detect hierarchical cluster structures in feature space. This is visualized as heat maps, which highlight semantically matching regions across a set of images, revealing what the network `perceives' as similar. DFF can also be used to perform co-segmentation and co-localization, and we report state-of-the-art results on these tasks.
Human review
How the literature uses it
What this paper does with the arXiv papers it cites
What it cites
Uses the method or tool of 1 paper
-
We consider five network architectures in our experiments, namely VGG-16 and VGG-19 [ref] , with and without batch-normalization [ref] , as well as ResNet-101 [ref] .
Very Deep Convolutional Networks for Large-Scale Image Recognition · Neural Network Models. · 0.88
Cites as background 1 paper
-
There has been work extending NMF to multiple layers [ref] , implementing NMF using neural networks [ref] and using NMF approximations as input to a neural network [ref] .
Neural Network Matrix Factorization · Non-negative Matrix Factorization · 0.96
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.