REVIEW 10 cited by
ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoring
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
abstract
We improve the recently-proposed "MixMatch" semi-supervised learning algorithm by introducing two new techniques: distribution alignment and augmentation anchoring. Distribution alignment encourages the marginal distribution of predictions on unlabeled data to be close to the marginal distribution of ground-truth labels. Augmentation anchoring feeds multiple strongly augmented versions of an input into the model and encourages each output to be close to the prediction for a weakly-augmented version of the same input. To produce strong augmentations, we propose a variant of AutoAugment which learns the augmentation policy while the model is being trained. Our new algorithm, dubbed ReMixMatch, is significantly more data-efficient than prior work, requiring between $5\times$ and $16\times$ less data to reach the same accuracy. For example, on CIFAR-10 with 250 labeled examples we reach $93.73\%$ accuracy (compared to MixMatch's accuracy of $93.58\%$ with $4{,}000$ examples) and a median accuracy of $84.92\%$ with just four labels per class. We make our code and data open-source at https://github.com/google-research/remixmatch.
Forward citations
Cited by 10 Pith papers
-
SeBA: Semi-supervised few-shot learning via Separated-at-Birth Alignment for tabular data
SeBA is a joint-embedding framework that separates tabular data into two complementary views and aligns one view's representations to the nearest-neighbor structure of the other, improving feature-label relationships ...
-
Self-Supervised Visual Representation Learning: Pretrain-Finetuning or Joint Training?
Jointly optimizing self-supervised and supervised losses often saves training time and helps in low-label settings, but pretrain-then-finetune remains better for several contrastive methods and specialized domains.
-
Geometric Gradient Rectification for Safe Open-Set Semi-Supervised Learning
GGR is a gradient-space projection technique that rectifies auxiliary updates in open-set SSL to avoid first-order opposition with supervised learning while retaining orthogonal signals.
-
Semi-MedRef: Semi-Supervised Medical Referring Image Segmentation with Cross-Modal Alignment
A teacher–student semi-supervised framework with alignment-preserving patch mixing, position-aware text augmentation, and positional contrastive learning improves medical referring segmentation at low label ratios.
-
JanusNet: Hierarchical Slice-Block Shuffle and Displacement for Semi-Supervised 3D Multi-Organ Segmentation
Slice-block shuffle plus confidence-guided displacement reports 72.67% average Dice on Synapse with 20% labels and 63.99% on AMOS with 5% labels.
-
FixCLR: Negative-Class Contrastive Learning for Semi-Supervised Domain Generalization
A plug-and-play contrastive regularization term, FixCLR, repels different pseudo-classes across domains and improves semi-supervised domain generalization accuracy when combined with FixMatch-based methods.
-
Revisiting Feature Prediction for Learning Visual Representations from Video
V-JEPA models trained only on feature prediction from 2 million public videos achieve 81.9% on Kinetics-400, 72.2% on Something-Something-v2, and 77.9% on ImageNet-1K using frozen ViT-H/16 backbones.
-
Semi-MedRef: Semi-Supervised Medical Referring Image Segmentation with Cross-Modal Alignment
Semi-MedRef introduces T-PatchMix, PosAug, and ITCL within a teacher-student SSL setup to preserve image-text alignment under augmentation for medical referring segmentation on QaTa-COV19 and MosMedData+.
-
Uncertainty-Guided Edge Learning for Deep Image Regression in Remote Sensing
UGEL employs deep beta regression to estimate uncertainty in one forward pass, enabling faster convergence in edge learning for remote sensing image regression than active or semi-supervised baselines.
-
Learning from Limited and Imperfect Data
A doctoral thesis compiling nine peer-reviewed papers on long-tailed image generation, long-tailed recognition, semi-supervised learning, and domain adaptation.
Discussion (0). Sign in to comment.