REVIEW 4 cited by
Neural Tangent Kernel: A Survey
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
A seminal work [Jacot et al., 2018] demonstrated that training a neural network under specific parameterization is equivalent to performing a particular kernel method as width goes to infinity. This equivalence opened a promising direction for applying the results of the rich literature on kernel methods to neural nets which were much harder to tackle. The present survey covers key results on kernel convergence as width goes to infinity, finite-width corrections, applications, and a discussion of the limitations of the corresponding method.
Forward citations
Cited by 4 Pith papers
-
CogGen: Cognitive-Load-Inspired Fully Unsupervised Deep Generative Modeling for Compressively Sampled MRI Reconstruction
CogGen schedules MRI k-space measurements from low- to high-frequency during unsupervised reconstruction, reporting sharper images and faster convergence than prior methods.
-
Efficient Adversarial Attacks on High-dimensional Offline Bandits
Perturbing the reward model's weights before offline bandit training can force UCB/ETC/epsilon-greedy to select a suboptimal arm, and the minimum perturbation norm decreases with input dimension.
-
Learning to Execute Graph Algorithms Exactly with Graph Neural Networks
A GNN with an ensemble of MLPs can exactly execute any LOCAL-model graph algorithm after learning a polynomial-size set of local template instructions.
-
Random at First, Fast at Last: NTK-Guided Fourier Pre-Processing for Tabular DL
Fixed random Fourier projections on tabular inputs are claimed to bound the NTK, speed up gradient descent, and improve accuracy across four architectures and eight benchmarks.
Discussion (0). Sign in to comment.