A natural-gradient optimizer that expands neural networks when their tangent space misaligns with the ideal Hilbert-space gradient reaches target accuracy on several toy regression, PDE, and model-reduction problems.
Best approximation results and essential boundary conditions for novel types of weak adversarial network discretizations for PDEs
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
In this paper, we provide a theoretical analysis of the recently introduced weakly adversarial networks (WAN) method, used to approximate partial differential equations in high dimensions. We address the existence and stability of the solution, as well as approximation bounds. More precisely, we prove the existence of discrete solutions, intended in a suitable weak sense, for which we prove a quasi-best approximation estimate similar to Cea's lemma, a result commonly found in finite element methods. We also propose two new stabilized WAN-based formulas that avoid the need for direct normalization. Furthermore, we analyze the method's effectiveness for the Dirichlet boundary problem that employs the implicit representation of the geometry. The key requirement for achieving the best approximation outcome is to ensure that the space for the test network satisfies a specific condition, known as the inf-sup condition, essentially requiring that the test network set is sufficiently large when compared to the trial space. The method's accuracy, however, is only determined by the space of the trial network. We also devise a pseudo-time XNODE neural network class for static PDE problems, yielding significantly faster convergence results than the classical DNN network.
citation-role summary
citation-polarity summary
fields
math.OC 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
Expansive Natural Neural Gradient Flows for Energy Minimization
A natural-gradient optimizer that expands neural networks when their tangent space misaligns with the ideal Hilbert-space gradient reaches target accuracy on several toy regression, PDE, and model-reduction problems.