REVIEW 11 cited by
ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoring
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
abstract
We improve the recently-proposed "MixMatch" semi-supervised learning algorithm by introducing two new techniques: distribution alignment and augmentation anchoring. Distribution alignment encourages the marginal distribution of predictions on unlabeled data to be close to the marginal distribution of ground-truth labels. Augmentation anchoring feeds multiple strongly augmented versions of an input into the model and encourages each output to be close to the prediction for a weakly-augmented version of the same input. To produce strong augmentations, we propose a variant of AutoAugment which learns the augmentation policy while the model is being trained. Our new algorithm, dubbed ReMixMatch, is significantly more data-efficient than prior work, requiring between $5\times$ and $16\times$ less data to reach the same accuracy. For example, on CIFAR-10 with 250 labeled examples we reach $93.73\%$ accuracy (compared to MixMatch's accuracy of $93.58\%$ with $4{,}000$ examples) and a median accuracy of $84.92\%$ with just four labels per class. We make our code and data open-source at https://github.com/google-research/remixmatch.
Forward citations
Cited by 11 Pith papers
-
Self-Supervised Visual Representation Learning: Pretrain-Finetuning or Joint Training?
Jointly optimizing self-supervised and supervised losses often saves training time and helps in low-label settings, but pretrain-then-finetune remains better for several contrastive methods and specialized domains.
-
Semi-MedRef: Semi-Supervised Medical Referring Image Segmentation with Cross-Modal Alignment
Semi-MedRef introduces T-PatchMix, PosAug, and ITCL within a teacher-student SSL setup to preserve image-text alignment under augmentation for medical referring segmentation on QaTa-COV19 and MosMedData+.
-
JanusNet: Hierarchical Slice-Block Shuffle and Displacement for Semi-Supervised 3D Multi-Organ Segmentation
Slice-block shuffle plus confidence-guided displacement reports 72.67% average Dice on Synapse with 20% labels and 63.99% on AMOS with 5% labels.
-
FixCLR: Negative-Class Contrastive Learning for Semi-Supervised Domain Generalization
A plug-and-play contrastive regularization term, FixCLR, repels different pseudo-classes across domains and improves semi-supervised domain generalization accuracy when combined with FixMatch-based methods.
-
ZeroVO: Visual Odometry with Minimal Assumptions
A two-frame visual odometry model using estimated depth, language priors, and semi-supervised pseudo-label filtering achieves zero-shot metric-scale pose estimation across multiple driving datasets.
-
Improving realistic semi-supervised learning with doubly robust estimation
Doubly robust estimation of the unlabeled class distribution improves pseudo-labeling methods for realistic long-tailed semi-supervised learning.
-
RegMixMatch: Optimizing Mixup Utilization in Semi-Supervised Learning
RegMixMatch combines clean-plus-mixed training with class-aware Mixup for low-confidence unlabeled samples, achieving state-of-the-art semi-supervised image classification.
-
P3Net: Progressive and Periodic Perturbation for Semi-Supervised Medical Image Segmentation
A progressive, periodic interpolation schedule and a boundary-focused loss improve semi-supervised medical image segmentation on four standard datasets.
-
Glioma Multimodal MRI Analysis System for Tumor Layered Diagnosis via Multi-task Semi-supervised Learning
An integrated MRI analysis system jointly segments gliomas and predicts grade, IDH, 1p/19q, and MGMT status, with added robustness to missing MRI modalities.
-
DyConfidMatch: Dynamic Thresholding and Re-sampling for 3D Semi-supervised Learning
DyConfidMatch sets per-class pseudo-label thresholds and re-sampling weights from class-level confidence, improving semi-supervised 3D classification and detection.
-
Learning from Limited and Imperfect Data
A doctoral thesis compiling nine peer-reviewed papers on long-tailed image generation, long-tailed recognition, semi-supervised learning, and domain adaptation.
Discussion (0). Continue with ORCID to comment.