Optimizers like Adam reduce to steepest descent under particular norms, opening a design space of norm assignments tailored to layer roles.
Kingma and Jimmy Ba
2 Pith papers cite this work. Polarity classification is still indexing.
2
Pith papers citing it
fields
cs.LG 2representative citing papers
FANoS-v2 augments momentum optimization with feedback-controlled thermostat damping, delivering small top-1 accuracy gains over AdamW on MNIST-scale tasks while increasing wall-clock time by roughly 50%.
citing papers explorer
-
Old Optimizer, New Norm: An Anthology
Optimizers like Adam reduce to steepest descent under particular norms, opening a design space of norm assignments tailored to layer roles.
-
FANoS-v2: Feedback-Controlled Momentum with Thermostat Damping for Lightweight Neural Optimization
FANoS-v2 augments momentum optimization with feedback-controlled thermostat damping, delivering small top-1 accuracy gains over AdamW on MNIST-scale tasks while increasing wall-clock time by roughly 50%.