REVIEW 1 cited by
Expressivity of Shallow and Deep Neural Networks for Polynomial Approximation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Expressivity of Shallow and Deep Neural Networks for Polynomial Approximation
read the original abstract
This study explores the number of neurons required for a Rectified Linear Unit (ReLU) neural network to approximate multivariate monomials. We establish an exponential lower bound on the complexity of any shallow network approximating the product function over a general compact domain. We also demonstrate this lower bound doesn't apply to normalized Lipschitz monomials over the unit cube. These findings suggest that shallow ReLU networks experience the curse of dimensionality when expressing functions with a Lipschitz parameter scaling with the dimension of the input, and that the expressive power of neural networks is more dependent on their depth rather than overall complexity.
Forward citations
Cited by 1 Pith paper
-
Approximation of Analytic Functions by ReLU Neural Networks with Adjustable Depth and Width
ReLU nets of width N and depth L approximate analytic functions at rate O(N^{-C L^tau}) with tau depending on N-L scaling, so depth dominates width.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.