REVIEW 3 cited by
94% on CIFAR-10 in 3.29 Seconds on a Single GPU
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
CIFAR-10 is among the most widely used datasets in machine learning, facilitating thousands of research projects per year. To accelerate research and reduce the cost of experiments, we introduce training methods for CIFAR-10 which reach 94% accuracy in 3.29 seconds, 95% in 10.4 seconds, and 96% in 46.3 seconds, when run on a single NVIDIA A100 GPU. As one factor contributing to these training speeds, we propose a derandomized variant of horizontal flipping augmentation, which we show improves over the standard method in every case where flipping is beneficial over no flipping at all. Our code is released at https://github.com/KellerJordan/cifar10-airbench.
Forward citations
Cited by 3 Pith papers
-
AgentHPOBench: A Benchmark For Evaluating LLM Agents as Sequential Hyperparameter Optimizers
A new 30-task benchmark shows LLM agents can improve real ML experiments through sequential hyperparameter choices, but their gains are uneven and often not retained.
-
An Embarrassingly Simple Way to Optimize Orthogonal Matrices at Scale
POGO uses a two-step tangent-plus-normal update with lambda = 1/2 to keep iterates near the Stiefel manifold at the cost of five matrix multiplications, making large-scale orthogonality constraints practical.
-
Powerful Design of Small Vision Transformer on CIFAR10
A Tiny ViT on CIFAR-10 reaches 93.95% accuracy with two classifier tokens at reduced width, while low-rank query compression causes only a small accuracy drop.
Discussion (0). Continue with ORCID to comment.