RadarGate rotates LoRA outputs before mixing them, expanding the set of reachable outputs beyond plain weighted sums.
Omoe: Diversifying mixture of low-rank adaptation by orthogonal finetuning
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Two Is Better Than One: Rotations Scale LoRAs
RadarGate rotates LoRA outputs before mixing them, expanding the set of reachable outputs beyond plain weighted sums.