REVIEW 7 cited by
Label Refinery: Improving ImageNet Classification through Label Progression
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Among the three main components (data, labels, and models) of any supervised learning system, data and models have been the main subjects of active research. However, studying labels and their properties has received very little attention. Current principles and paradigms of labeling impose several challenges to machine learning algorithms. Labels are often incomplete, ambiguous, and redundant. In this paper we study the effects of various properties of labels and introduce the Label Refinery: an iterative procedure that updates the ground truth labels after examining the entire dataset. We show significant gain using refined labels across a wide range of models. Using a Label Refinery improves the state-of-the-art top-1 accuracy of (1) AlexNet from 59.3 to 67.2, (2) MobileNet from 70.6 to 73.39, (3) MobileNet-0.25 from 50.6 to 55.59, (4) VGG19 from 72.7 to 75.46, and (5) Darknet19 from 72.9 to 74.47.
Forward citations
Cited by 7 Pith papers
-
Combined Image Data Augmentations diminish the benefits of Adaptive Label Smoothing
Soft augmentation improves training for single homogeneous augmentations like random erasing, but gives no net benefit and can reduce corruption robustness when combined with diverse augmentations like TrivialAugment.
-
Sketch Down the FLOPs: Towards Efficient Networks for Human Sketch
By distilling a large teacher into a MobileNetV2 student and adding a reinforcement-learned canvas selector, the authors reduce FG-SBIR compute from 40.18G to 0.254G FLOPs with accuracy 32.77% vs 33.03%.
-
Confidence Regularized Self-Training
A regularized self-training framework that softens pseudo-labels or network outputs improves unsupervised domain adaptation over the class-balanced self-training baseline.
-
NT-ML: Backdoor Defense via Non-target Label Training and Mutual Learning
NT-ML combines non-target label training and mutual learning to purify a backdoored model using a small set of clean samples.
-
Adaptive Regularization of Labels
Training a classifier with an auxiliary loss that matches its own non-ground-truth class probabilities to a learned per-class residual label improves accuracy on several benchmarks, though gains are small and top-5 Im...
-
Multi-Modality Distillation via Learning the teacher's modality-level Gram Matrix
Proposes a modality relation distillation method that transfers teacher modality relationships via the modality-level Gram Matrix.
-
Efficient Deep Neural Networks
A dissertation showing that deep learning can be made practical on edge devices through four complementary routes: model, data, hardware, and design efficiency.
Discussion (0). Continue with ORCID to comment.