SplitLoRA picks the LoRA update subspace size from previous-task gradient singular values using a hyperparameter alpha, and freezes the projection to keep updates in that subspace.
Inflora: Interference-free low-rank adaptation for continual learning
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
contradiction 1
citation-polarity summary
fields
cs.LG 1years
2025 1verdicts
REJECT 1roles
contradiction 1polarities
contest 1representative citing papers
citing papers explorer
-
SplitLoRA: Balancing Stability and Plasticity in Continual Learning Through Gradient Space Splitting
SplitLoRA picks the LoRA update subspace size from previous-task gradient singular values using a hyperparameter alpha, and freezes the projection to keep updates in that subspace.