RDBP combines a new activation (ReLUDown) with decaying backpropagation to achieve strong stability and plasticity on Continual ImageNet with low overhead.
: Baby, Dog, Bridge, Bird, Oven A.3 A CTIVATION FUNCTIONS Figure 6 illustrates the activation functions used in our experiments
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
A Simple Baseline for Stable and Plastic Neural Networks
RDBP combines a new activation (ReLUDown) with decaying backpropagation to achieve strong stability and plasticity on Continual ImageNet with low overhead.