FORA uses function-space projectors from activation covariances to enable capability-preserving fine-tuning of LLMs, outperforming weight-space methods on preservation tasks.
IEEE Transactions on Pattern Analysis and Machine Intelligence , volume=
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Fora: From Weight-Space to Function-Space Protection in Capability-Preserving Fine-Tuning
FORA uses function-space projectors from activation covariances to enable capability-preserving fine-tuning of LLMs, outperforming weight-space methods on preservation tasks.