A Survey on Universal Approximation Theorems
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 reserved pith:D2ZMRA6Rrecord.jsonopen to challenge →
read the original abstract
This paper discusses various theorems on the approximation capabilities of neural networks (NNs), which are known as universal approximation theorems (UATs). The paper gives a systematic overview of UATs starting from the preliminary results on function approximation, such as Taylor's theorem, Fourier's theorem, Weierstrass approximation theorem, Kolmogorov - Arnold representation theorem, etc. Theoretical and numerical aspects of UATs are covered from both arbitrary width and depth.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
Learning the Universe: Posterior Reliability of Neural Generative Models in High-Dimensional Field-Level Inference of Cosmic Initial Conditions
Generative models for cosmological field-level inference can reproduce posterior means and cross-correlations yet fail to capture correct uncertainty geometry when validated against HMC reference samples.
-
Hybrid Least Squares/Gradient Descent Methods for MIONets
A hybrid least squares / gradient descent method accelerates MIONet training by exploiting multilinear structure in last-layer branch parameters via alternating least squares with Kronecker/Khatri-Rao factorization.
-
A Cubing Strategy for Identifying Stable Hyperparameter Regions for Uncertainty Quantification in Spatial Deep Learning
A recursive cubing framework identifies stable hyperparameter regions for MC dropout uncertainty quantification in spatial deep learning and produces competitive or superior predictive intervals versus a statistical b...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.