A mean-field dynamical analysis of LoRA in transformers identifies phase transitions in catastrophic forgetting driven by perturbation norm and transformer depth.
QL o RA : Efficient finetuning of quantized LLM s
2 Pith papers cite this work. Polarity classification is still indexing.
2
Pith papers citing it
verdicts
UNVERDICTED 2representative citing papers
MAGELLAN augments LLM agents with online metacognitive LP prediction via semantic generalization to scale curriculum learning in open-ended goal spaces.
citing papers explorer
-
Understanding Catastrophic Forgetting In LoRA via Mean-Field Attention Dynamics
A mean-field dynamical analysis of LoRA in transformers identifies phase transitions in catastrophic forgetting driven by perturbation norm and transformer depth.
-
MAGELLAN: Metacognitive predictions of learning progress guide autotelic LLM agents in large goal spaces
MAGELLAN augments LLM agents with online metacognitive LP prediction via semantic generalization to scale curriculum learning in open-ended goal spaces.