REVIEW 3 cited by
Low-Cost Recurrent Neural Network Expected Performance Evaluation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Recurrent neural networks are a powerful tool, but they are very sensitive to their hyper-parameter configuration. Moreover, training properly a recurrent neural network is a tough task, therefore selecting an appropriate configuration is critical. Varied strategies have been proposed to tackle this issue. However, most of them are still impractical because of the time/resources needed. In this study, we propose a low computational cost model to evaluate the expected performance of a given architecture based on the distribution of the error of random samples of the weights. We empirically validate our proposal using three use cases. The results suggest that this is a promising alternative to reduce the cost of exploration for hyper-parameter optimization.
Forward citations
Cited by 3 Pith papers
-
GreenFactory: Ensembling Zero-Cost Proxies to Estimate Performance of Neural Networks
A random forest trained on 21 zero-cost proxies and network metadata predicts NATS-Bench test accuracy with Kendall correlations above 0.9 on held-out splits.
-
Random Error Sampling-based Recurrent Neural Network Architecture Optimization
RESN uses a training-free random-sampling error estimate to guide an evolutionary search over LSTM architectures, matching or beating several baselines at about half the optimization time.
-
GreenMachine: Automatic Design of Zero-Cost Proxies for Energy-Efficient NAS
GreenMachine evolves new zero-cost proxy formulas that rank untrained neural networks by expected accuracy, reaching a best Kendall correlation of 0.89 on NATS-Bench size search space with CIFAR-10.
Discussion (0). Continue with ORCID to comment.