REVIEW 4 cited by
NAS-Bench-101: Towards Reproducible Neural Architecture Search
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Recent advances in neural architecture search (NAS) demand tremendous computational resources, which makes it difficult to reproduce experiments and imposes a barrier-to-entry to researchers without access to large-scale computation. We aim to ameliorate these problems by introducing NAS-Bench-101, the first public architecture dataset for NAS research. To build NAS-Bench-101, we carefully constructed a compact, yet expressive, search space, exploiting graph isomorphisms to identify 423k unique convolutional architectures. We trained and evaluated all of these architectures multiple times on CIFAR-10 and compiled the results into a large dataset of over 5 million trained models. This allows researchers to evaluate the quality of a diverse range of models in milliseconds by querying the pre-computed dataset. We demonstrate its utility by analyzing the dataset as a whole and by benchmarking a range of architecture optimization algorithms.
Forward citations
Cited by 4 Pith papers
-
Auto-FP: An Experimental Study of Automated Feature Preprocessing for Tabular Data
Experimental comparison of 15 HPO and NAS algorithms for automated feature preprocessing on 45 tabular datasets finds evolution-based methods and random search as top performers.
-
Improving Routability Prediction via NAS Using a Smooth One-shot Augmented Predictor
A new neural architecture search pipeline that averages multiple one-shot networks and augments the predictor data achieves a 0.9802 ROC-AUC for chip routing hotspot detection.
-
Delta-NAS: Difference of Architecture Encoding for Predictor-based Evolutionary Neural Architecture Search
Delta-NAS encodes pairs of one-edit-away architectures as sparse differences and learns to predict the accuracy gap, using that predictor to guide evolutionary search.
-
On Accelerating Edge AI: Optimizing Resource-Constrained Environments
The paper argues that model compression, neural architecture search, and compiler optimizations work together to accelerate edge AI, but it provides no new experimental evidence.
Discussion (0). Continue with ORCID to comment.